pub enum ProjFamily {
Gdn,
Attn,
Ffn,
Moe,
LmHead,
}Expand description
2026-09-30: The projection families a family override can name.
Variants§
Gdn
2026-09-30: GDN (linear attention) in_proj_qkvz, in_proj_ba and out_proj.
Attn
2026-09-30: Full attention q (+gate), k, v and o.
Ffn
2026-09-30: Dense MLP gate, up and down.
Moe
2026-09-30: MoE router, routed experts and shared expert.
LmHead
2026-09-30: The LM head.
Implementations§
Trait Implementations§
Source§impl Clone for ProjFamily
impl Clone for ProjFamily
Source§fn clone(&self) -> ProjFamily
fn clone(&self) -> ProjFamily
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ProjFamily
impl Debug for ProjFamily
Source§impl Hash for ProjFamily
impl Hash for ProjFamily
Source§impl Ord for ProjFamily
impl Ord for ProjFamily
Source§fn cmp(&self, other: &ProjFamily) -> Ordering
fn cmp(&self, other: &ProjFamily) -> Ordering
1.21.0 · Source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
Compares and returns the maximum of two values. Read more
Source§impl PartialEq for ProjFamily
impl PartialEq for ProjFamily
Source§impl PartialOrd for ProjFamily
impl PartialOrd for ProjFamily
impl Copy for ProjFamily
impl Eq for ProjFamily
impl StructuralPartialEq for ProjFamily
Auto Trait Implementations§
impl Freeze for ProjFamily
impl RefUnwindSafe for ProjFamily
impl Send for ProjFamily
impl Sync for ProjFamily
impl Unpin for ProjFamily
impl UnwindSafe for ProjFamily
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Comparable<K> for Q
impl<Q, K> Comparable<K> for Q
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.