w8a16_gemm_pipelined_by_m

Function w8a16_gemm_pipelined_by_m 

Source
pub fn w8a16_gemm_pipelined_by_m(
    gpu: &dyn GpuBackend,
    full_kernel: KernelHandle,
    m32_kernel: KernelHandle,
    m64_kernel: KernelHandle,
    input: DevicePtr,
    weight: DevicePtr,
    block_scale: DevicePtr,
    output: DevicePtr,
    m: u32,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: Contiguous block-scaled W8A16 GEMM, tile chosen by w8a16_pipelined_prefers_m32: the 32-tile twin on m32_kernel, else (2026-09-26) w8a16_pipelined_prefers_m64’s 64-tile twin on m64_kernel, else the 128-tile w8a16_gemm_pipelined on full_kernel. The GDN in_proj_qkvz / out_proj batched-verify arms (trait_decode_batched.rs) call it.