Module ngram

Module ngram 

Source
Expand description

2026-09-25: Prompt-lookup draft proposer: finds the longest suffix of the token history (prompt and generated tokens) that occurred earlier, and proposes the token that followed it. Host code only.

Owner: speculative. Invariants: none beyond the types.

Structsยง

NgramProposer
2026-09-25: The proposer. It keeps no index: propose searches the history it is given.