Expand description
2026-09-25: What the core asks the device to run (StepPlan) and what comes back
(StepResult). Generic over the device’s logits handle P.
Owner: scheduler. Invariants: none beyond the types.
Structs§
Enums§
- Decode
CtxCommit - 2026-09-25: The DFlash context commit a decode step performs between its forward and its readback (the drafter’s view of the serial tokens).
- Decode
Rows - 2026-09-25: The rows of a decode step after the readback.
- Feed
Source - 2026-09-25: Where a fed decode row’s input token comes from.
- Readback
- 2026-09-25: How the logits of a decode step come back to the host.
- Step
Outcome - Step
Plan - 2026-09-25: One device step. The sequence rows it advances travel beside it as
&mut S.
Traits§
- Label
- 2026-09-25: A short label for traces.
Type Aliases§
- RowMask
- 2026-09-25: The two token ids the host would re-pick around for a row on the
argmax fast path (
u32::MAX= none): the closed-thinking mask.