w4a16_gemv_sw_raw

Function w4a16_gemv_sw_raw 

Source
pub fn w4a16_gemv_sw_raw(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    input: DevicePtr,
    packed: DevicePtr,
    scale: DevicePtr,
    scale_2: f32,
    output: DevicePtr,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: The launch of w4a16_gemv_sw for callers that hold the NVFP4 packed weight, scale and global scale as separate values rather than a QuantizedWeight (the GLM-5.3 MLP in model-arch/src/glm5next_mlp/forward.rs). It keeps the grid on w4a16_gemv_sw_grid_x.