nvfp4_mmq_repack

Function nvfp4_mmq_repack 

Source
pub fn nvfp4_mmq_repack(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    packed: DevicePtr,
    scales: DevicePtr,
    out_blocks: DevicePtr,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: Repack a checkpoint NVFP4 weight (E2M1 [n, k/2], low nibble = even k, and E4M3 [n, k/16] scales) for the MMQ kernel. Each row holds k/64 blocks as all nibble bytes (32 per block) followed by all scale bytes (4 per block). Codes and scale bytes are copied, not requantized.