Glm5NextDsaWorkspace

metrale_model_arch::glm5next_dsa::layer

Struct Glm5NextDsaWorkspace

pub struct Glm5NextDsaWorkspace { /* private fields */ }

Expand description

2026-09-25: Scratch reused across decode_k calls; each layer owns one.

Implementations§

impl Glm5NextDsaWorkspace

pub fn new( gpu: &dyn GpuBackend, cfg: &Glm5NextDsaConfig, max_rows: usize, ) -> Result<Self>

2026-09-25: max_rows (at least 1) is the largest k this workspace serves. Sized by it: the projection outputs, attn_out, sl, the batched-selector buffers, and the selection scratch, which is planned at super::super::state::max_dsa_context tokens and max_rows query rows. The staging rows and bt do not depend on it.

Auto Trait Implementations§

impl Freeze for Glm5NextDsaWorkspace

impl RefUnwindSafe for Glm5NextDsaWorkspace

impl Send for Glm5NextDsaWorkspace

impl Sync for Glm5NextDsaWorkspace

impl Unpin for Glm5NextDsaWorkspace

impl UnwindSafe for Glm5NextDsaWorkspace

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T> Instrument for T

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T> Same for T

type Output = T

Should always be Self

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

fn vzip(self) -> V

impl<T> WithSubscriber for T

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,