pub enum LayerType {
FullAttention,
SlidingAttention,
LinearAttention,
Moe,
SparseAttention,
}Variants§
FullAttention
SlidingAttention
LinearAttention
Moe
2026-09-26: A layer with no mixer, only the routed-expert FFN (Nemotron-H pattern E,
Puzzle moe).
SparseAttention
2026-09-26: Sparse attention (deepseek_sparse_attention): a full-rank mixer whose
visible key set an indexer selects per query at run time.
Implementations§
Trait Implementations§
Source§impl<'de> Deserialize<'de> for LayerType
impl<'de> Deserialize<'de> for LayerType
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Copy for LayerType
impl Eq for LayerType
impl StructuralPartialEq for LayerType
Auto Trait Implementations§
impl Freeze for LayerType
impl RefUnwindSafe for LayerType
impl Send for LayerType
impl Sync for LayerType
impl Unpin for LayerType
impl UnwindSafe for LayerType
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.