pub fn w8a16_gemm_pipelined_by_m(
gpu: &dyn GpuBackend,
full_kernel: KernelHandle,
m32_kernel: KernelHandle,
m64_kernel: KernelHandle,
input: DevicePtr,
weight: DevicePtr,
block_scale: DevicePtr,
output: DevicePtr,
m: u32,
n: u32,
k: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: Contiguous block-scaled W8A16 GEMM, tile chosen by
w8a16_pipelined_prefers_m32: the 32-tile twin on m32_kernel, else
(2026-09-26) w8a16_pipelined_prefers_m64’s 64-tile twin on m64_kernel,
else the 128-tile w8a16_gemm_pipelined on full_kernel. The GDN
in_proj_qkvz / out_proj batched-verify arms (trait_decode_batched.rs)
call it.