pub fn nvfp4_mmq_gemm(
gpu: &dyn GpuBackend,
kernel_nc: KernelHandle,
kernel_wc: KernelHandle,
a_fp4: DevicePtr,
w_nvfp4: DevicePtr,
out_bf16: DevicePtr,
m: u32,
n: u32,
k: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: C[m, n] = A[m, k] x W[n, k] in BF16, without weight_scale_2,
on the 128-wide M tile. a_fp4 is block_fp4_mmq, w_nvfp4 the
nvfp4_mmq_repack output. kernel_wc is used when n is not a multiple
of 128.