nvfp4_pipe_gemm

Function nvfp4_pipe_gemm 

Source
pub fn nvfp4_pipe_gemm(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    a_fp4: DevicePtr,
    w_nvfp4: DevicePtr,
    out_bf16: DevicePtr,
    m: u32,
    n: u32,
    k: u32,
    out_scale: Option<f32>,
    stream: u64,
) -> Result<()>
Expand description

2026-09-28: C[m, n] = A[m, k] x W[n, k] in BF16, without weight_scale_2, through metrale_nvfp4_gemm_pipe (same operands and output as nvfp4_mmq_gemm, bit-identical). k must be a multiple of 256. Grid of 128-channel x 192-token tiles, 256 threads. With out_scale, each output is multiplied by it as nvfp4_scale_bf16 does in place, bit for bit.