Enum StepPlan 

pub enum StepPlan<'a> {
    Decode {
        tokens: Vec<u32>,
        ctx: DecodeCtxCommit,
        readback: Readback<'a>,
    },
    DecodeFed {
        sources: Vec<FeedSource>,
        masks: Vec<RowMask>,
        ctx: DecodeCtxCommit,
    },
}

2026-09-25: One device step. The sequence rows it advances travel beside it as &mut S.

Variants

Decode

2026-09-25: Batched decode of one token per row, the context commit, then the readback.

Fields

tokens: Vec<u32>

2026-09-25: The pending decode input of each row, in row order.

ctx: DecodeCtxCommit

readback: Readback<'a>

DecodeFed

2026-09-25: A decode step launched while the previous one is still in flight: each row’s input is resolved on the device from sources, the readback is the masked feed argmax, and the host bookkeeping the plain step performs at launch (tokens.push, seq_len += 1) is deferred to the core, which applies it once the previous step is committed. The context commit runs between the forward and the readback, as it does for the plain step.

Fields

sources: Vec<FeedSource>

masks: Vec<RowMask>

ctx: DecodeCtxCommit

Trait Implementations

impl<'a> Debug for StepPlan<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Label for StepPlan<'_>

fn label(&self) -> String