cutlass_nvfp4_proj

Function cutlass_nvfp4_proj 

Source
pub fn cutlass_nvfp4_proj(
    ctx: &ForwardContext<'_>,
    act: DevicePtr,
    weight_t: &QuantizedWeight,
    out: DevicePtr,
    m: u32,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: Route a projection out[M,N] = act[M,K] @ weightᵀ through CUTLASS NVFP4. weight_t is an NVFP4 weight with [K/2,N] packed bytes; the bytes are transposed once to [N,K/2] and memoized.