Struct OverlayKernels 

pub struct OverlayKernels {
    pub rowdiff: KernelHandle,
    pub embed_overlay: KernelHandle,
    pub lmhead_overlay_bf16: KernelHandle,
    pub lmhead_overlay_f32: KernelHandle,
}

2026-09-25: The four token-overlay kernels, resolved once at model construction with try_kernel. A missing kernel gives KernelHandle(0): the forward hooks then return without a launch, and build_overlay refuses an adapter that ships overlay tensors.

Fields

rowdiff: KernelHandle

embed_overlay: KernelHandle

lmhead_overlay_bf16: KernelHandle

lmhead_overlay_f32: KernelHandle

Implementations

impl OverlayKernels

pub fn new(gpu: &dyn GpuBackend) -> Self

Trait Implementations

impl Clone for OverlayKernels

fn clone(&self) -> OverlayKernels

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for OverlayKernels

fn default() -> Self

2026-09-25: All handles zero, as if no overlay kernel were loaded. KernelHandle does not derive Default, so this is spelled out.

impl Copy for OverlayKernels