nvfp4_gemm_bf16_act_weight_t

Function nvfp4_gemm_bf16_act_weight_t 

Source
pub fn nvfp4_gemm_bf16_act_weight_t(
    act: u64,
    weight_packed_t: u64,
    weight_scale_t: u64,
    weight_scale_2: f32,
    out: u64,
    m: u32,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: NVFP4 dense projection with BF16 output: out[M,N] = quant_nvfp4(act[M,K]) @ weight[N,K]^T, scaled by weight_scale_2.

weight_packed_t is the CUTLASS [N,K/2] K-contiguous byte layout that pack_bf16_weight_to_nvfp4_t writes and transpose_nvfp4_packed_kton produces from [K/2,N]; weight_scale_t is E4M3 [K/16,N]. The wrapper quantizes the activation and swizzles the weight scales into the shared workspace before the GEMM.