Enum QuantWeight 

pub enum QuantWeight {
    Nvfp4(QuantizedWeight),
    Fp8(Fp8Weight),
    Dense(DenseWeight),
    PackedQ2(PackedQ2Weight),
}

2026-09-25: A weight in any supported format. ops::quant_gemv / ops::quant_gemm match on it to pick the kernel.

Variants

Nvfp4(QuantizedWeight)

2026-09-25: NVFP4 E2M1: packed nibbles + FP8 group scales + f32 global scale. Kernel: w4a16_gemv / w4a16_gemm.

Fp8(Fp8Weight)

2026-09-25: FP8 E4M3 weights and their scale buffer. Kernel: w8a16_gemv / w8a16_gemm.

Dense(DenseWeight)

2026-09-25: BF16 dense (unquantized). Kernel: dense_gemv / dense_gemm.

PackedQ2(PackedQ2Weight)

2026-09-25: Keep-packed Q2_0: raw block_q2_0 bytes kept 2-bit on the device. quant_gemv / quant_gemm refuse it: decode runs q2_0_gemv_vec and prefill dequantizes to BF16 first.

Implementations

impl QuantWeight

pub fn null() -> Self

2026-09-25: An NVFP4 weight with NULL pointers.

pub fn is_null(&self) -> bool

2026-09-25: Whether this weight’s data pointer is NULL.

pub fn as_packed_q2(&self) -> Option<&PackedQ2Weight>

2026-09-25: The keep-packed Q2_0 weight, if this is that variant.

pub fn as_nvfp4(&self) -> Option<&QuantizedWeight>

2026-09-25: The NVFP4 weight, if this is that variant.

pub fn as_fp8(&self) -> Option<&Fp8Weight>

2026-09-25: The FP8 weight, if this is that variant.

pub fn as_dense(&self) -> Option<&DenseWeight>

2026-09-25: The dense weight, if this is that variant.

Trait Implementations

impl Clone for QuantWeight

fn clone(&self) -> QuantWeight

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantWeight

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<DenseWeight> for QuantWeight

fn from(w: DenseWeight) -> Self

Converts to this type from the input type.

impl From<Fp8Weight> for QuantWeight

fn from(w: Fp8Weight) -> Self

Converts to this type from the input type.

impl From<PackedQ2Weight> for QuantWeight

fn from(w: PackedQ2Weight) -> Self

Converts to this type from the input type.

impl From<QuantizedWeight> for QuantWeight

fn from(w: QuantizedWeight) -> Self

Converts to this type from the input type.

impl Copy for QuantWeight