pub enum LoraSites {
PairFallback,
MultiSeq,
}Expand description
2026-10-03: Which attention LoRA sites a step of one sequence runs.
Variants§
PairFallback
2026-10-03: Sites that fold the installed pair when no slot buffer is given: one-row decode
(apply_q_lora, apply_kv_lora, the o_proj fold) and prefill (prefill_one_proj,
paged_oproj).
MultiSeq
2026-10-03: The multi-sequence sites an MTP verify’s K rows run (ms_qkv_apply_lora,
ms_o_proj_lora): they have no pair fallback and fold nothing without a slot buffer.
Trait Implementations§
impl Copy for LoraSites
impl Eq for LoraSites
impl StructuralPartialEq for LoraSites
Auto Trait Implementations§
impl Freeze for LoraSites
impl RefUnwindSafe for LoraSites
impl Send for LoraSites
impl Sync for LoraSites
impl Unpin for LoraSites
impl UnwindSafe for LoraSites
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.