pub const DENSE_GEMV_BATCHM_DECODE_MAX_M: u32 = 8;Expand description
2026-09-25: The widest batch that the MTP row dispatch
(mtp_head/row_dispatch.rs) and the BF16 arm of the model’s
lm_head_batched (impl_a3_lm_head.rs) hand to dense_gemv_bf16_batchm;
target_defaults::BASELINE_BATCHM_MAX is set from it. Above it those paths
choose other kernels, some of which accumulate in a different order, so
this value decides which bits a decode of a given width produces.