Struct Fp8ActQuant 

pub struct Fp8ActQuant {
    pub shared: KernelHandle,
    pub hopper: KernelHandle,
}

2026-09-25: The FP8 activation quantizer a layer launches: the shared kernel, plus the Hopper twin when the image has one.

Fields

shared: KernelHandle

2026-09-25: per_token_group_quant_fp8, or KernelHandle(0) when the image lacks it.

hopper: KernelHandle

2026-09-25: per_token_group_quant_fp8_hopper, or KernelHandle(0) when the image lacks it.

Implementations

impl Fp8ActQuant

pub fn resolve(gpu: &dyn GpuBackend) -> Self

2026-09-25: Probe both kernels; a missing one resolves to KernelHandle(0).

pub fn shared_only(shared: KernelHandle) -> Self

2026-09-25: A quantizer with only the shared kernel.

pub fn available(&self) -> bool

2026-09-25: Is there a quantizer to launch at all? True when either handle is loaded, whatever the width; Self::pick is the per-launch choice.

pub fn twin_present(&self) -> bool

2026-09-25: Is the twin in this image? Whether a launch uses it is Fp8QuantPick::twin.

pub fn pick(&self, m: u32, k: u32) -> Fp8QuantPick

2026-09-25: Which kernel this (m, k) launches, on which grid, and why not the other, from the resolved fp8_act_quant_hopper lever and the compiled target’s SM count. Self::pick_with is the pure form.

pub fn pick_with( &self, requested: bool, m: u32, k: u32, sm_count: u32, ) -> Fp8QuantPick

2026-09-25: Self::pick over an explicit lever value and SM count. Pure, so CPU tests can grade any (m, k).

pub fn kernel(&self, m: u32, k: u32) -> KernelHandle

2026-09-25: The handle this (m, k) launches.

pub fn grid(&self, m: u32, k: u32) -> [u32; 3]

2026-09-25: The grid for (m, k), from the same pick as Self::kernel.

Trait Implementations

impl Clone for Fp8ActQuant

fn clone(&self) -> Fp8ActQuant

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Fp8ActQuant

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Fp8ActQuant

fn default() -> Self

2026-09-25: No quantizer: both handles are 0.

impl Copy for Fp8ActQuant