pub struct Glm5NextMhcSiteWeights {
pub hc_fn: DevicePtr,
pub hc_fn_bf16: bool,
pub hc_scale: DevicePtr,
pub hc_base: DevicePtr,
pub mix: DevicePtr,
}Expand description
2026-09-25: One mHC site’s weights; a layer has one set for the attention site and one for the FFN site.
Fields§
§hc_fn: DevicePtr2026-09-25: [mix_hc, hc_mult * hidden] (see mix_hc): BF16 when hc_fn_bf16 is set,
FP32 otherwise. The loader uploads it as BF16.
hc_fn_bf16: bool2026-09-25: Whether hc_fn is BF16; the loader sets it.
hc_scale: DevicePtr2026-09-25: [3] FP32: the logit scales of pre, post and comb, in that order.
hc_base: DevicePtr2026-09-25: [mix_hc] FP32.
mix: DevicePtr2026-09-25: [mhc_mix_max_tokens(), mix_hc] FP32 scratch that hc_mix writes and
hc_finish reads; the loader allocates one per site.
Trait Implementations§
Source§impl Clone for Glm5NextMhcSiteWeights
impl Clone for Glm5NextMhcSiteWeights
Source§fn clone(&self) -> Glm5NextMhcSiteWeights
fn clone(&self) -> Glm5NextMhcSiteWeights
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for Glm5NextMhcSiteWeights
impl Debug for Glm5NextMhcSiteWeights
impl Copy for Glm5NextMhcSiteWeights
Auto Trait Implementations§
impl Freeze for Glm5NextMhcSiteWeights
impl RefUnwindSafe for Glm5NextMhcSiteWeights
impl Send for Glm5NextMhcSiteWeights
impl Sync for Glm5NextMhcSiteWeights
impl Unpin for Glm5NextMhcSiteWeights
impl UnwindSafe for Glm5NextMhcSiteWeights
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more