pub enum ActFormat {
Bf16,
Fp8,
Fp4,
}Expand description
2026-09-28: The activation format a layer runs at in decode.
Variants§
Bf16
2026-09-28: BF16 activations.
Fp8
2026-09-28: E4M3 activations with a per-token (or per-group) scale.
Fp4
2026-09-28: NVFP4 activations.
Trait Implementations§
impl Copy for ActFormat
impl Eq for ActFormat
impl StructuralPartialEq for ActFormat
Auto Trait Implementations§
impl Freeze for ActFormat
impl RefUnwindSafe for ActFormat
impl Send for ActFormat
impl Sync for ActFormat
impl Unpin for ActFormat
impl UnwindSafe for ActFormat
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.