Module coherence 

2026-09-26: A known-answer probe of the endpoint, run by the executor before a benchmark loads.

crate::http::probe only checks that /v1/models answers with a 2xx status line; it never parses the body. This probe also reads the model list (a wrong model name), checks the served model against the benchmark’s crate::benchmark::ModelExpectation (a wrong family), and asks the two CHECKS questions (an endpoint that does not generate sense). It is not a quality measurement.

Owner: bench. Invariants:

• probe and probe_for never return an error: a transport failure is recorded in Report::transport_error.

Structs

Answer

2026-09-26: What one check produced, kept so a failure can quote it back.

Check

2026-09-26: A question whose answer is not a matter of opinion.

Report

2026-09-26: The outcome of a probe: what was asked, what came back, and whether it fit.

Enums

CoherencePolicy

2026-09-26: Whether a run probes the endpoint before it starts.

Constants

CHECKS

2026-09-26: Two facts: one arithmetic, one recall.

Functions

probe

2026-09-26: probe_for without a model expectation.

probe_for

2026-09-26: Read the model list, check the served model against expectation when one is given, then ask every CHECKS question.