W4A16_VIA_FP8_MIN_M

Constant W4A16_VIA_FP8_MIN_M 

Source
pub const W4A16_VIA_FP8_MIN_M: u32 = 1024;
Expand description

2026-09-28: Rows at or above which w4a16_t_via_fp8_ldmab beats w4a16_gemm_t_m128 on the dense 27B attention projections (dgx2: x1.23-1.35 at 1024 rows, x0.69 at 300, x2.15 at 8192): below it the per-call weight dequant dominates.