pub fn kquant_mmvq_experts(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
vxs: DevicePtr,
y_q8: DevicePtr,
out_bf16: DevicePtr,
n: u32,
k: u32,
m: u32,
n_experts: u32,
y_stride_bytes: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: kquant_mmvq_*_experts: one launch over n_experts experts whose block
pointers sit in the device table vxs. The activation for expert e is
y_q8 + e * y_stride_bytes (0 = shared), its output out_bf16 + e * m * n. Each expert’s
rows go through the same device function as kquant_mmvq.