pub fn quantize_weight_q4k(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
input_bf16: DevicePtr,
out_q4k: DevicePtr,
nrows: u32,
n_per_row: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: Quantize BF16 weights [nrows, n_per_row] to block_q4_K, one
thread per 256-value block.