Q2_BATCHM_MAX_M

Constant Q2_BATCHM_MAX_M 

Source
pub const Q2_BATCHM_MAX_M: u32 = 8;
Expand description

2026-09-25: Row cap of the q2_0_gemv_vec_batchm kernel (MAX_M in the .cu). The kernel stages M activation rows into s_A[MAX_M * TILE_K], so M > MAX_M writes past that tile, and its compute and store loops stop at MAX_M, so rows from 8 on are never written. q2_0_gemv_vec_batchm chunks larger m itself.