Enum QuantFormat 

pub enum QuantFormat {
    Nvfp4,
    Fp8,
}

2026-09-25: Runtime quantization format of a loader’s weights, which the qwen3 and qwen35 loaders resolve from the checkpoint’s NVFP4 variant.

Variants

Nvfp4

2026-09-25: NVFP4 E2M1; every variant other than Fp8Dequanted.

Fp8

2026-09-25: FP8 E4M3 block-scaled, served natively (Fp8Dequanted).

Implementations

impl QuantFormat

pub fn peak_memory_multiplier(&self) -> f64

2026-09-25: Peak GPU memory as a multiple of on-disk weight bytes, for an OOM pre-flight estimate.

Trait Implementations

impl Clone for QuantFormat

fn clone(&self) -> QuantFormat

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantFormat

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for QuantFormat

fn eq(&self, other: &QuantFormat) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for QuantFormat

impl Eq for QuantFormat

impl StructuralPartialEq for QuantFormat