tps_probe

metrale_bench::benchmarks::serve_matrix::probes

Function tps_probe 

Source 
pub async fn tps_probe(
    target: &TargetEndpoint,
    timeout: Duration,
    budget: usize,
    tag: &str,
) -> (Option<f64>, Option<String>)
Expand description

2026-09-26: Decode tok/s from the client’s TPOT (ChatOutcome::tpot_ms) on a budget-token request. None when TPOT is undefined (no delta arrived, or fewer than two completion tokens); a failed request reports 0 with its error.