pub enum WeightSlot {
Show 19 variants
InputNorm,
PostNorm,
Linear(LinearRole),
FfnGate,
FfnUp,
QNorm,
KNorm,
GdnALog,
GdnDtBias,
GdnConv1d,
GdnNorm,
Transposed(LinearRole),
FfnGateMmq,
FfnUpMmq,
FfnDownMmq,
EmbedNorm,
HiddenNorm,
FinalNorm,
LmHead,
}Expand description
2026-09-28: Which weight of a layer a circuit node reads.
Variants§
InputNorm
2026-09-28: The mixer’s input RMSNorm.
PostNorm
2026-09-28: The FFN’s input RMSNorm (post_attention_layernorm).
Linear(LinearRole)
2026-09-28: A projection; GateUp is bound as WeightSlot::FfnGate and
WeightSlot::FfnUp.
FfnGate
2026-09-28: The dense FFN’s gate projection.
FfnUp
2026-09-28: The dense FFN’s up projection.
QNorm
2026-09-28: Attention’s per-head Q RMSNorm.
KNorm
2026-09-28: Attention’s per-head K RMSNorm.
GdnALog
2026-09-28: GatedDeltaNet A_log.
GdnDtBias
2026-09-28: GatedDeltaNet dt_bias.
GdnConv1d
2026-09-28: GatedDeltaNet conv1d taps.
GdnNorm
2026-09-28: GatedDeltaNet output norm.
Transposed(LinearRole)
2026-09-28: The transposed twin of a projection, which the tile GEMMs read.
FfnGateMmq
2026-09-28: The dense FFN’s gate, repacked for the NVFP4 MMQ GEMM.
FfnUpMmq
2026-09-28: The dense FFN’s up, repacked for the NVFP4 MMQ GEMM.
FfnDownMmq
2026-09-28: The dense FFN’s down, repacked for the NVFP4 MMQ GEMM.
EmbedNorm
2026-09-29: The MTP draft head’s norm of the token embedding (pre_fc_norm_embedding).
HiddenNorm
2026-09-29: The MTP draft head’s norm of the target hidden (pre_fc_norm_hidden).
FinalNorm
2026-09-29: The MTP draft head’s final norm.
LmHead
2026-09-29: The MTP draft head’s vocabulary projection.
Trait Implementations§
Source§impl Clone for WeightSlot
impl Clone for WeightSlot
Source§fn clone(&self) -> WeightSlot
fn clone(&self) -> WeightSlot
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl Debug for WeightSlot
impl Debug for WeightSlot
Source§impl Hash for WeightSlot
impl Hash for WeightSlot
Source§impl Ord for WeightSlot
impl Ord for WeightSlot
Source§fn cmp(&self, other: &WeightSlot) -> Ordering
fn cmp(&self, other: &WeightSlot) -> Ordering
1.21.0 · Source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
Source§impl PartialEq for WeightSlot
impl PartialEq for WeightSlot
Source§impl PartialOrd for WeightSlot
impl PartialOrd for WeightSlot
impl Copy for WeightSlot
impl Eq for WeightSlot
impl StructuralPartialEq for WeightSlot
Auto Trait Implementations§
impl Freeze for WeightSlot
impl RefUnwindSafe for WeightSlot
impl Send for WeightSlot
impl Sync for WeightSlot
impl Unpin for WeightSlot
impl UnwindSafe for WeightSlot
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Comparable<K> for Q
impl<Q, K> Comparable<K> for Q
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.