Enum GroupedRouting 

pub enum GroupedRouting {
    Batched,
    PerRow,
    PerToken,
}

2026-09-26: Which router arithmetic forward_fp8_grouped_decode_routed runs.

Variants

Batched

2026-09-27: The batched gate GEMM (NVFP4 or BF16) and the batched softmax or sigmoid top-k: the MTP drafter and the METRALE_FP8_MOE_GROUPED_DECODE arm.

PerRow

2026-09-27: The router of MoeLayer::forward, row by row.

PerToken

2026-09-27: The router of MoeLayer::forward_batched with BF16 logits.

Trait Implementations

impl Clone for GroupedRouting

fn clone(&self) -> GroupedRouting

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GroupedRouting

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for GroupedRouting

fn eq(&self, other: &GroupedRouting) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for GroupedRouting

impl Eq for GroupedRouting

impl StructuralPartialEq for GroupedRouting