w4a16_gemv_batchm

Function w4a16_gemv_batchm 

Source
pub fn w4a16_gemv_batchm(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    input: DevicePtr,
    weight: &QuantizedWeight,
    output: DevicePtr,
    m: u32,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: w4a16_gemv for m contiguous rows in one pass over the weight. kernel is the CUDA-core w4a16_gemv_batch{M} tier the caller picked (W4a16BatchmTiers::kernel); gemv_tc::tc_kernel replaces it with the tensor-core w4a16_gemv_tc8/tc16 when it routes the shape.