pub fn nvfp4_pipe_gemm(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
a_fp4: DevicePtr,
w_nvfp4: DevicePtr,
out_bf16: DevicePtr,
m: u32,
n: u32,
k: u32,
out_scale: Option<f32>,
stream: u64,
) -> Result<()>Expand description
2026-09-28: C[m, n] = A[m, k] x W[n, k] in BF16, without weight_scale_2, through
metrale_nvfp4_gemm_pipe (same operands and output as nvfp4_mmq_gemm, bit-identical).
k must be a multiple of 256. Grid of 128-channel x 192-token tiles, 256 threads. With out_scale,
each output is multiplied by it as nvfp4_scale_bf16 does in place, bit for bit.