pub enum StateDtype {
F32,
F16,
Bf16,
Fp8,
U8,
I32,
U32,
U64,
}Expand description
2026-09-30: The storage element of a state.
Variants§
F32
F16
Bf16
Fp8
2026-09-30: One E4M3 byte per element; its scales live outside the state (a static per-layer KV scale).
U8
2026-10-02: Integer elements of the caches: masks and flags (u8), token ids and
counts (i32, u32), keys and device pointers (u64).
I32
U32
U64
Implementations§
Trait Implementations§
Source§impl Clone for StateDtype
impl Clone for StateDtype
Source§fn clone(&self) -> StateDtype
fn clone(&self) -> StateDtype
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for StateDtype
impl Debug for StateDtype
Source§impl Hash for StateDtype
impl Hash for StateDtype
Source§impl Ord for StateDtype
impl Ord for StateDtype
Source§fn cmp(&self, other: &StateDtype) -> Ordering
fn cmp(&self, other: &StateDtype) -> Ordering
1.21.0 · Source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
Compares and returns the maximum of two values. Read more
Source§impl PartialEq for StateDtype
impl PartialEq for StateDtype
Source§impl PartialOrd for StateDtype
impl PartialOrd for StateDtype
impl Copy for StateDtype
impl Eq for StateDtype
impl StructuralPartialEq for StateDtype
Auto Trait Implementations§
impl Freeze for StateDtype
impl RefUnwindSafe for StateDtype
impl Send for StateDtype
impl Sync for StateDtype
impl Unpin for StateDtype
impl UnwindSafe for StateDtype
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Comparable<K> for Q
impl<Q, K> Comparable<K> for Q
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.