Glm5NextMoeWeights

metrale_model_arch::glm5next_mlp::weights

Struct Glm5NextMoeWeights

pub struct Glm5NextMoeWeights {
    pub router: DevicePtr,
    pub router_bias: DevicePtr,
    pub shared: Glm5NextDenseMlpWeights,
    pub experts: Vec<Glm5NextExpertWeights>,
    pub ptrs: Glm5NextMoePtrTables,
}

Expand description

2026-09-25: A routed MoE site’s weights for this rank.

Fields§

§router: DevicePtr

2026-09-25: [num_experts, hidden] BF16 router, the full matrix on every rank (see the module header). Run through the FP32-output GEMM.

§router_bias: DevicePtr

2026-09-25: [num_experts] F32 selection bias (gate.e_score_correction_bias). It steers selection only; the emitted weight is the chosen expert’s unbiased score.

§shared: Glm5NextDenseMlpWeights

2026-09-25: The shared expert: dense BF16, TP-sharded, added to every token unscaled.

§experts: Vec<Glm5NextExpertWeights>

2026-09-25: local_experts entries in ascending global id, indexed by Glm5NextMlpConfig::local_slot(global_id), never by the global id.

§ptrs: Glm5NextMoePtrTables

2026-09-25: Global-id-indexed pointer tables over the same experts, for the device-dispatched forward. Null entries mark remote ids.

Auto Trait Implementations§

impl Freeze for Glm5NextMoeWeights

impl RefUnwindSafe for Glm5NextMoeWeights

impl Send for Glm5NextMoeWeights

impl Sync for Glm5NextMoeWeights

impl Unpin for Glm5NextMoeWeights

impl UnwindSafe for Glm5NextMoeWeights

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T> Instrument for T

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T> Same for T

type Output = T

Should always be Self

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

fn vzip(self) -> V

impl<T> WithSubscriber for T

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,