pub struct GlmVitBlock {Show 14 fields
pub norm1_w: DevicePtr,
pub qkv_w: DevicePtr,
pub qkv_b: DevicePtr,
pub q_norm_w: DevicePtr,
pub k_norm_w: DevicePtr,
pub proj_w: DevicePtr,
pub proj_b: DevicePtr,
pub norm2_w: DevicePtr,
pub gate_w: DevicePtr,
pub gate_b: DevicePtr,
pub up_w: DevicePtr,
pub up_b: DevicePtr,
pub down_w: DevicePtr,
pub down_b: DevicePtr,
}Expand description
2026-09-25: One ViT block’s BF16 weights.
Fields§
§norm1_w: DevicePtr§qkv_w: DevicePtr§qkv_b: DevicePtr§q_norm_w: DevicePtr2026-09-25: Per-head RMSNorm weight for Q, [head_dim]. The kernel applies
it after the QKV split and before the rotary transform.
k_norm_w: DevicePtr§proj_w: DevicePtr§proj_b: DevicePtr§norm2_w: DevicePtr§gate_w: DevicePtr§gate_b: DevicePtr§up_w: DevicePtr§up_b: DevicePtr§down_w: DevicePtr§down_b: DevicePtrAuto Trait Implementations§
impl Freeze for GlmVitBlock
impl RefUnwindSafe for GlmVitBlock
impl Send for GlmVitBlock
impl Sync for GlmVitBlock
impl Unpin for GlmVitBlock
impl UnwindSafe for GlmVitBlock
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more