pub struct HcHeadWeights {
pub hc_fn: DevicePtr,
pub hc_base: DevicePtr,
pub hc_scale: DevicePtr,
pub lowrank: Option<HcLowRank>,
}Expand description
2026-09-25: Model-level HC head parameters: the final stream collapse before the LM head. Only the last model layer uses them.
Fields§
§hc_fn: DevicePtr2026-09-25: Mix projection head_fn: [hc_mult, hc_mult*hidden] FP32.
hc_base: DevicePtr2026-09-25: Mix bias head_base: [hc_mult] FP32.
hc_scale: DevicePtr2026-09-25: Mix scale: [1] FP32.
lowrank: Option<HcLowRank>2026-09-25: Low-rank variant of the model-level mixer. Some selects
the low-rank kernels; its inject_w is NULL.
Trait Implementations§
Source§impl Clone for HcHeadWeights
impl Clone for HcHeadWeights
Source§fn clone(&self) -> HcHeadWeights
fn clone(&self) -> HcHeadWeights
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for HcHeadWeights
impl RefUnwindSafe for HcHeadWeights
impl Send for HcHeadWeights
impl Sync for HcHeadWeights
impl Unpin for HcHeadWeights
impl UnwindSafe for HcHeadWeights
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more