Struct W4a16BatchmTiers 

pub struct W4a16BatchmTiers { /* private fields */ }

2026-09-25: Resolved handles for the narrow w4a16_gemv_batch{M} family.

A zero handle means “this target did not load that tier”; consumers check .0 != 0, and Self::kernel returns a zero handle rather than panicking when nothing in the family covers m.

Implementations

impl W4a16BatchmTiers

pub fn resolve(gpu: &dyn GpuBackend) -> Self

2026-09-25: Resolve every tier in the family. A missing kernel is a zero handle, and select_tier skips it.

pub fn edge(&self, w: &QuantizedWeight) -> u32

2026-09-28: The row edge for w, from its activation stamp (edge_of).

pub fn declares_a4(&self, w: &QuantizedWeight) -> bool

2026-09-28: w declares FP4 activations and this backend has the W4A4 kernels. The published tier decides what that means for a dense FFN’s narrow steps (WeightQuantTier::ffn_small_batch_w4a4).

pub fn ffn_edge(&self, w: &QuantizedWeight) -> u32

2026-09-28: Self::edge capped at w4a4_proj::W4A4_MAX_M: the dense FFN’s narrow arms stop at 32 rows, and 33..=64 go to forward_prefill.

pub fn kernel_for(&self, m: u32, w: &QuantizedWeight) -> KernelHandle

2026-09-28: Self::kernel for a projection over w, within Self::edge.

pub fn kernel(&self, m: u32) -> KernelHandle

2026-09-25: Narrowest resolved tier covering m rows, or KernelHandle(0) when this family cannot serve m, for a projection without a policy stamp (the lm_head, the MTP head): within the edge of an unstamped weight (2026-09-28: the W4A16 edge, or under nvfp4 with --w4a4-downcast the lever’s edge, as before the tiers).

pub fn width(&self, m: u32) -> Option<u32>

2026-09-25: Width of the tier select_tier picks for m (the narrow family only; kernel hands out wide/wide32 above 8 rows).

pub fn has_base(&self) -> bool

2026-09-25: Is the base w4a16_gemv_batch4 tier resolved? Capability probes for NVFP4 batched decode ask this one.

Trait Implementations

impl Clone for W4a16BatchmTiers

fn clone(&self) -> W4a16BatchmTiers

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for W4a16BatchmTiers

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for W4a16BatchmTiers

2026-09-25: The “no NVFP4 kernels” state: an all-zero table, for which kernel returns a zero handle at every m.

fn default() -> Self

Returns the “default value” for a type.

impl Copy for W4a16BatchmTiers