Struct W8a8Scratch 

pub struct W8a8Scratch {
    pub q: DevicePtr,
    pub q_bytes: usize,
    pub scale: DevicePtr,
    pub scale_bytes: usize,
}

2026-09-28: Device scratch for one quantized activation: [rows, k] E4M3 and its FP32 scales. One per model; every W8A8 projection on the stream quantizes into it immediately before its GEMV.

Fields

q: DevicePtr

q_bytes: usize

scale: DevicePtr

scale_bytes: usize

Implementations

impl W8a8Scratch

pub fn packed(base: DevicePtr, rows: usize, k: u32, scale: W8a8Scale) -> Self

2026-09-30: One activation of rows rows packed from base: [rows, k] E4M3, then its FP32 scales (the circuit’s fp8/token edge, Format::bytes).

impl W8a8Scratch

pub fn alloc(gpu: &dyn GpuBackend, max_k: u32) -> Result<Self>

2026-09-28: Room for W8A8_MAX_ROWS rows of a max_k-wide activation in either scale layout.

Trait Implementations

impl Clone for W8a8Scratch

fn clone(&self) -> W8a8Scratch

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for W8a8Scratch

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Copy for W8a8Scratch