pub fn nvfp4_mmq_repack(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
packed: DevicePtr,
scales: DevicePtr,
out_blocks: DevicePtr,
n: u32,
k: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: Repack a checkpoint NVFP4 weight (E2M1 [n, k/2], low nibble =
even k, and E4M3 [n, k/16] scales) for the MMQ kernel. Each row holds
k/64 blocks as all nibble bytes (32 per block) followed by all scale bytes
(4 per block). Codes and scale bytes are copied, not requantized.