pub enum AttnPositionEncoding {
Rope,
None,
}Expand description
2026-09-29: What full attention does to Q and K before the dot product.
Variants§
Rope
2026-09-29: Rotary embedding over rotary_dim() dims at rope_theta, or the layer’s
RoPE variant (YaRN, proportional, MRoPE) where the loader configures one.
None
2026-09-29: No positional encoding: Q and K enter attention as projected. Nemotron-H
attention has none; position reaches it through the Mamba-2 layers only (HF
NemotronHAttention.forward never calls apply_rotary_pos_emb).
Trait Implementations§
Source§impl Clone for AttnPositionEncoding
impl Clone for AttnPositionEncoding
Source§fn clone(&self) -> AttnPositionEncoding
fn clone(&self) -> AttnPositionEncoding
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for AttnPositionEncoding
impl Debug for AttnPositionEncoding
Source§impl PartialEq for AttnPositionEncoding
impl PartialEq for AttnPositionEncoding
impl Copy for AttnPositionEncoding
impl Eq for AttnPositionEncoding
impl StructuralPartialEq for AttnPositionEncoding
Auto Trait Implementations§
impl Freeze for AttnPositionEncoding
impl RefUnwindSafe for AttnPositionEncoding
impl Send for AttnPositionEncoding
impl Sync for AttnPositionEncoding
impl Unpin for AttnPositionEncoding
impl UnwindSafe for AttnPositionEncoding
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.