pub fn kquant_mmvq_groups_w(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
w_blocks: DevicePtr,
y_q8: DevicePtr,
out_bf16: DevicePtr,
n: u32,
k: u32,
m: u32,
n_groups: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: kquant_mmvq_q2_k_groups_w: n_groups independent [n, k] GEMVs in one launch.
Group g takes weight rows [g*n, (g+1)*n) (w_blocks is [n_groups * n][k/256]) against
activation columns [g*k, (g+1)*k) of the block_q8_1 [m][n_groups * k / 32] buffer
y_q8, and writes columns [g*n, (g+1)*n) of out_bf16 ([m][n_groups * n]). Each group
runs the per-row code of kquant_mmvq_w with offsets.