Struct W8a8Kernels 

pub struct W8a8Kernels { /* private fields */ }

2026-09-28: The quantizers and the ten GEMV entry points (2 scale layouts x the five row entries, mb1_ku8 to mb16). A handle is 0 when its module is not compiled.

Implementations

impl W8a8Kernels

pub fn quant(&self, scale: W8a8Scale) -> KernelHandle

2026-09-30: The quantizer of scale’s layout.

pub fn quant_silu(&self, scale: W8a8Scale) -> KernelHandle

2026-09-30: The SiLU·mul quantizer of scale’s layout.

pub fn gemv_entry(&self, scale: W8a8Scale, rows: usize) -> Option<KernelHandle>

2026-09-30: The GEMV entry of one launch of rows rows; None above one launch.

impl W8a8Kernels

pub fn load(gpu: &dyn GpuBackend) -> Self

pub fn none() -> Self

2026-09-28: No kernel resolved (a build without the modules).

pub fn resolved(&self, scale: W8a8Scale) -> bool

2026-09-28: Whether every kernel of scale’s layout resolved (both quantizers and every GEMV entry).

Trait Implementations

impl Clone for W8a8Kernels

fn clone(&self) -> W8a8Kernels

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for W8a8Kernels

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Copy for W8a8Kernels