pub fn w4a16_gemv_sw_raw(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
input: DevicePtr,
packed: DevicePtr,
scale: DevicePtr,
scale_2: f32,
output: DevicePtr,
n: u32,
k: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: The launch of w4a16_gemv_sw for callers that hold the NVFP4 packed weight,
scale and global scale as separate values rather than a QuantizedWeight (the GLM-5.3
MLP in model-arch/src/glm5next_mlp/forward.rs). It keeps the grid on
w4a16_gemv_sw_grid_x.