kquant_mmvq_groups_w

Function kquant_mmvq_groups_w 

Source
pub fn kquant_mmvq_groups_w(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    w_blocks: DevicePtr,
    y_q8: DevicePtr,
    out_bf16: DevicePtr,
    n: u32,
    k: u32,
    m: u32,
    n_groups: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: kquant_mmvq_q2_k_groups_w: n_groups independent [n, k] GEMVs in one launch. Group g takes weight rows [g*n, (g+1)*n) (w_blocks is [n_groups * n][k/256]) against activation columns [g*k, (g+1)*k) of the block_q8_1 [m][n_groups * k / 32] buffer y_q8, and writes columns [g*n, (g+1)*n) of out_bf16 ([m][n_groups * n]). Each group runs the per-row code of kquant_mmvq_w with offsets.