pub enum StepKind {
Show 17 variants
Gather,
Act,
Weight,
Mma,
Accumulate,
Scale,
Compute,
Move,
Cache,
Scores,
Softmax,
State,
Score,
Scatter,
Combine,
Reduce,
Compare,
}Expand description
2026-10-02: A step of a node’s pipeline. Each has one value shape (vocab::shape_of).
Variants§
Gather
2026-10-02: Rows gathered by expert id (or embedding rows by token id): their format.
Act
2026-10-02: The format the activation is rounded or quantized to before the multiply.
Weight
2026-10-02: The stored weight format and the precision of its unscaled values as multiplied.
Mma
2026-10-02: The multiply’s operand precisions, activation first.
Accumulate
2026-10-02: The precision dot products (or attention’s PV sums) accumulate in.
Scale
2026-10-02: The precision weight and activation scales are applied in; none without scales.
Compute
2026-10-02: The precision of an element-wise op’s or a reduction’s arithmetic.
Move
2026-10-02: Data moved without arithmetic: its format.
Cache
2026-10-02: The KV-cache dtype read or written.
Scores
2026-10-02: Attention: the precision of the QK dot products.
Softmax
2026-10-02: Attention: the precision of the softmax.
State
2026-10-02: The precision of the recurrent state as stored and updated.
Score
2026-10-02: Routing: the precision of the scoring function and of the routing weights.
Scatter
2026-10-02: Blend: the precision of the weighted sum of each token’s top-k expert rows.
Combine
2026-10-02: Blend: the precision the (gated) shared expert is added in; none without one.
Reduce
2026-10-02: A cross-rank reduction’s precision.
Compare
2026-10-02: Greedy selection: the format of the values compared.
Trait Implementations§
Source§impl Ord for StepKind
impl Ord for StepKind
Source§impl PartialOrd for StepKind
impl PartialOrd for StepKind
impl Copy for StepKind
impl Eq for StepKind
impl StructuralPartialEq for StepKind
Auto Trait Implementations§
impl Freeze for StepKind
impl RefUnwindSafe for StepKind
impl Send for StepKind
impl Sync for StepKind
impl Unpin for StepKind
impl UnwindSafe for StepKind
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Comparable<K> for Q
impl<Q, K> Comparable<K> for Q
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.