Expand description
2026-09-26: The concurrency leg shared by the video and vision benchmarks:
for each of LEVELS, that many copies of one request are sent at once and
scored for how many returned, how many were correct, and whether they
agree on one prompt-token count.
It checks correctness, not throughput: wall_ms is recorded and never
read by ok, ok_against or sweep_ok. The copies are identical, so this
leg cannot see one request answered with another’s input;
media_integrity::heterogeneous_concurrency covers that.
Owner: bench, video and vision. Invariants: none beyond the types.
Structs§
- Level
Result - 2026-09-26: One level’s outcome.
Constants§
- LEVELS
- 2026-09-26: The levels swept, in order.
sweep_okneeds one result per level, and the first (C=1) sets the prompt-token baseline.