Expand description
2026-09-28: A compiled circuit program: the straight-line launches of one plan, with every host decision (kernel, grid, sizes, pointers into the model’s fixed buffers and the workspace) made at compile time.
Owner: model-layers circuit executor. Invariants:
- A step reads only
StepEnv: the stream, each row’s GDN state pointers and the block-table width uploaded for the step. Everything else a launch uses was fixed when it was compiled, so a CUDA-graph capture ofProgram::runreplays correctly for any step with the same state pointers (the graph caches key on the sequence’s slot). runissues no synchronize and no device-to-host copy, so it may be captured.- A program holds exactly
FusionPlan::launcheskernel launches andFusionPlan::copiescopies.
Structs§
- Draft
Programs - 2026-09-30: The draft head’s compiled programs, one per row count, ascending (one row first).
- GdnState
- 2026-09-28: One sequence’s recurrent state in one GatedDeltaNet layer.
- Launch
- 2026-09-28: One kernel launch or copy.
- Program
- 2026-09-28: The compiled launches of one plan.
- StepEnv
- 2026-09-28: What varies between two runs of one program.
Enums§
- Launch
Kind - 2026-09-29: What a launch puts on the stream.
Constants§
- MAX_
VERIFY_ STEPS - 2026-09-29: The most rollback points an MTP verify writes: one per row but the last, at K = 4.
Traits§
- Draft
Runner - 2026-09-29: A program another component runs in place of its own forward (the MTP draft head’s step), without GDN state. 2026-09-30: One program per row count: one row for a single sequence’s draft, n rows for the batched propose’s.