cutlass_nvfp4_proj_from_fp8

Function cutlass_nvfp4_proj_from_fp8 

Source
pub fn cutlass_nvfp4_proj_from_fp8(
    ctx: &ForwardContext<'_>,
    act: DevicePtr,
    fp8w: &Fp8Weight,
    out: DevicePtr,
    m: u32,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: CUTLASS NVFP4 projection for an FP8 weight. On first use the weight is dequantized into a transient BF16 buffer, packed into NVFP4 data and scales, and the pair is memoized for later calls.