pub struct OverlayRaw {
pub embed_base: Option<DevicePtr>,
pub embed_delta: Option<DevicePtr>,
pub embed_r: u32,
pub embed_t: u32,
pub lmhead_base: Option<DevicePtr>,
pub lmhead_delta: Option<DevicePtr>,
pub lmhead_r: u32,
pub lmhead_t: u32,
}Expand description
2026-09-25: The adapter’s overlay tensors copied to device buffers of their
own, with their row counts: *_base is [*_r, h] and *_delta is
[*_t, h]. *_base holds either the token_adapter base table or a
modules_to_save full table.
Fields§
§embed_base: Option<DevicePtr>§embed_delta: Option<DevicePtr>§embed_r: u32§embed_t: u32§lmhead_base: Option<DevicePtr>§lmhead_delta: Option<DevicePtr>§lmhead_r: u32§lmhead_t: u32Trait Implementations§
Source§impl Clone for OverlayRaw
impl Clone for OverlayRaw
Source§fn clone(&self) -> OverlayRaw
fn clone(&self) -> OverlayRaw
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for OverlayRaw
impl Debug for OverlayRaw
Source§impl Default for OverlayRaw
impl Default for OverlayRaw
Source§fn default() -> OverlayRaw
fn default() -> OverlayRaw
Returns the “default value” for a type. Read more
impl Copy for OverlayRaw
Auto Trait Implementations§
impl Freeze for OverlayRaw
impl RefUnwindSafe for OverlayRaw
impl Send for OverlayRaw
impl Sync for OverlayRaw
impl Unpin for OverlayRaw
impl UnwindSafe for OverlayRaw
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more