mtp_max_seqs

Function mtp_max_seqs 

Source
pub fn mtp_max_seqs() -> usize
Expand description

2026-09-29: The multi-sequence MTP dispatch cap the serve published (set_mtp_max_seqs); before publication (unit tests, tools) the engine default.

The scheduler runs a speculative step only while the active count is at most this (SchedLevers::mtp_max_seqs, checked in lane_decode.rs), and the model sizes its verify pools and its single-sequence MTP structures from the same value (ssm_reserve::mtp_state_slots, speculative::mtp_multi_seq_mode).