pub fn q2_0_gemv(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
input: DevicePtr,
weight: &PackedQ2Weight,
output: DevicePtr,
stream: u64,
) -> Result<()>Expand description
2026-09-25: Q2_0 GEMV for M=1 decode: C[1,N] = A[1,K] @ dequant(B)^T. A and C are
BF16; B is the raw block_q2_0 buffer, and each weight is dequantized as (code-1)*d
inside the dot product.