pub fn padded_batch_n(n: usize) -> usizeExpand description
2026-09-25: The padded batch size for n live sequences: the smallest rung of the ladder
that is at least n, or n itself above 128. Batched decode pads to a rung so its CUDA
graphs are keyed by a few batch shapes instead of one per n.