resolve_batchm_max

Function resolve_batchm_max 

Source
pub fn resolve_batchm_max(default_max: u32, raw: Option<&str>) -> Resolved<u32>
Expand description

2026-09-25: The BF16 decode head’s batched-GEMV band: the widest m that takes dense_gemv_batchm. Wider batches take a tile GEMM that reassociates the reduction, so moving the edge changes the head’s output bits.

Clamped to DENSE_GEMV_BATCHM_MAX_M, the kernel’s row bound: dense_gemv_batchm returns an error above it, which would fail every decode step. An unparseable or 0 environment value keeps the target’s declaration; the band has no “off”.