Enum Effect 

pub enum Effect<'a, S, P> {
    ReleaseSeq {
        seq: &'a mut S,
        cache: bool,
        what: &'static str,
    },
    CompactSlot {
        seq: &'a mut S,
        target: usize,
    },
    DetachSlot {
        seq: &'a mut S,
    },
    SaveSequenceState {
        seq: &'a S,
        writer: &'a mut dyn Write,
    },
    ReadLogits {
        logits: P,
        rows: usize,
        into: &'a mut Vec<u8>,
    },
    MarconiCheckpoint {
        seq: &'a mut S,
    },
    SsmSnapshotSave {
        seq: &'a S,
        slot: usize,
    },
    SsmSnapshotRestore {
        seq: &'a S,
        slot: usize,
    },
    SaveHiddenCatchup {
        row: usize,
        pos: usize,
    },
    SyncSecondary,
    EpShutdown,
    Quiesce {
        stream: u64,
    },
    ReserveKv {
        seq: &'a mut S,
    },
    Rollback {
        seq: &'a mut S,
    },
}

Variants

ReleaseSeq

2026-09-25: Release a sequence’s device resources: optionally offer its KV to the prefix cache, free it, then tell the EP worker.

Fields

seq: &'a mut S

cache: bool

what: &'static str

2026-09-25: The caller’s label, for the failure log lines.

CompactSlot

2026-09-25: Migrate a live sequence onto slot target.

Fields

seq: &'a mut S

target: usize

DetachSlot

2026-09-25: Disown a sequence’s slot after it was migrated to another sequence, so a later free or drop cannot release it twice.

Fields

seq: &'a mut S

SaveSequenceState

2026-09-25: Stream a sequence’s device state into writer (spill).

Fields

seq: &'a S

writer: &'a mut dyn Write

ReadLogits

2026-09-25: Copy the logits block logits (rows rows) to the host.

Fields

logits: P

rows: usize

into: &'a mut Vec<u8>

MarconiCheckpoint

2026-09-25: Block-aligned Marconi SSM checkpoint after a decode step.

Fields

seq: &'a mut S

SsmSnapshotSave

Fields

seq: &'a S

slot: usize

SsmSnapshotRestore

Fields

seq: &'a S

slot: usize

SaveHiddenCatchup

2026-09-25: save_hidden_for_catchup(row, pos): copy row row’s hidden into the MTP catch-up ring at label pos.

Fields

row: usize

pos: usize

SyncSecondary

2026-09-25: Make the default stream wait for the secondary stream.

EpShutdown

2026-09-25: Every worker slot down.

Quiesce

2026-09-25: Synchronise stream before teardown.

Fields

stream: u64

ReserveKv

2026-09-25: Make sure the KV block for the sequence’s next decode position exists before a step is launched ahead of the host; answers Reserved with the blocks it added (0 when the block was already there) or Exhausted when the allocation fails.

Fields

seq: &'a mut S

Rollback

2026-09-25: The over-run of a fed step was discarded for this sequence: release the blocks the latest ReserveKv added for it. Only a router that reserves ahead supports it; the synchronous router returns an error.

Fields

seq: &'a mut S

Trait Implementations

impl<S, P> Label for Effect<'_, S, P>

fn label(&self) -> String