pub enum DsaShard {
Replicated,
HeadRows,
HeadCols,
}Expand description
2026-09-25: How one DSA tensor maps onto TP ranks.
Variants§
Replicated
2026-09-25: Every rank holds the whole tensor: the indexer, the latent KV projection, and the low-rank down-projections and norms.
HeadRows
2026-09-25: Leading dim is heads * per_head: slice by this rank’s head range.
HeadCols
2026-09-25: Trailing (input) dim is heads * v_head_dim: a row-parallel GEMM, sliced on the
input dim, whose output is all-reduced.
Trait Implementations§
impl Copy for DsaShard
impl Eq for DsaShard
impl StructuralPartialEq for DsaShard
Auto Trait Implementations§
impl Freeze for DsaShard
impl RefUnwindSafe for DsaShard
impl Send for DsaShard
impl Sync for DsaShard
impl Unpin for DsaShard
impl UnwindSafe for DsaShard
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.