Enum Granularity 

pub enum Granularity {
    Tensor,
    Channel,
    Token,
    Group(u32),
    TensorGroup(u32),
    Block(u32, u32),
    Unstated,
}

2026-09-28: How many values share one scale.

Variants

Tensor

2026-09-28: One scale for the whole tensor.

Channel

2026-09-28: One scale per output channel (weights).

Token

2026-09-28: One scale per token (activations).

Group(u32)

2026-09-28: One scale per n consecutive values along K.

TensorGroup(u32)

2026-09-28: One scale per n values plus a per-tensor global scale (compressed-tensors tensor_group, ModelOpt NVFP4).

Block(u32, u32)

2026-09-28: One scale per [rows, cols] block (weights).

Unstated

2026-09-28: Not stated by the checkpoint.

Trait Implementations

impl Clone for Granularity

fn clone(&self) -> Granularity

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Granularity

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Granularity

fn eq(&self, other: &Granularity) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Granularity

impl Eq for Granularity

impl StructuralPartialEq for Granularity