RETAIN_CAP

Constant RETAIN_CAP 

Source
pub const RETAIN_CAP: usize = 8192;
Expand description

2026-09-26: Gaps retained per response for the percentiles. Equal to the concurrency driver’s largest osl, which is its max_tokens, so no concurrency response is truncated; a longer response keeps counting online and reports the truncation through GapStats::retained.