MAX_DECODE_SPLITS

Constant MAX_DECODE_SPLITS 

Source
pub const MAX_DECODE_SPLITS: u32 = 16;
Expand description

2026-09-25: Ceiling on the split count under every policy but Legacy, and so on the split-K workspace, which is rows * num_q_heads * num_splits * (head_dim + 2) F32 values. Without it a model with few q heads would ask for 2 * sm_count / num_q_heads splits (264 for one head on 132 SMs). At 24 q heads on the 148-SM targets (kernels/b200, kernels/b300) auto asks for 13. A pinned count is clamped to it.