Expand description
2026-09-25: The ModelWeightLoader trait, and one loader per architecture that turns a
flat WeightStore into typed TransformerLayers.
Owner: model-arch weight loader. Invariants: none beyond the types.
Re-exports§
pub use deepseek_v4::DeepSeekV4WeightLoader;pub use dflash_loader::DflashConfig;pub use dflash_loader::DflashLayerWeights;pub use dflash_loader::DflashSubConfig;pub use dflash_loader::DflashWeights;pub use dflash_loader::load_dflash_weights;pub use dflash_loader::store_has_dflash_weights;pub use glm5_next_load::Glm5NextWeightLoader;
Modules§
- deepseek_
v4 - 2026-09-25: DeepSeek-V4 weight loader: layers, embedding, final norm and lm_head.
- deepseek_
v41 - 2026-09-25: DeepSeek-V4.1 loader: assembles
DeepSeekV41Layers from a GGUF checkpoint. - dflash_
loader - 2026-09-25: DFlash drafter loader: parses the drafter’s
config.jsonand loads its weights intoDflashWeightsforcrate::dflash_head::BlockDiffusionDraftHead. - fp8_
residency - 2026-09-25: The native-FP8 dense loader’s derived-copy decision table and the shape arithmetic that prices it. 2026-09-25: Which derived weight copies the native-FP8 dense route builds, and a tally of the derived bytes the loader kept, skipped and freed.
- glm5_
next - 2026-09-25: GLM-5.3 checkpoint tensor classification (
classify). 2026-09-25: GLM-5.3 (glm5_next) tensor accounting:classifygives the role of a checkpoint tensor name, andaccounttotals a name list by role. Nothing is loaded. - glm5_
next_ load - 2026-09-25:
Glm5NextWeightLoader: builds the GLM-5.3 text stack from aWeightStore, plus the helpers the MTP loader shares. - glm5_
next_ mtp - 2026-09-25: Load GLM-5.3’s MTP block,
model.language_model.layers.{num_hidden_layers}, as the body of the draft proposer. - glm5_
next_ vision - 2026-09-25: Bind the GLM-5.3 vision tower (
*.visual.*) as BF16 device pointers. - predicted_
residency - 2026-09-25: That table evaluated from the config before the checkpoint loads; preflight’s headroom check reads it. 2026-09-25: The derived-weight bytes of the native-FP8 dense route, predicted from the config and the environment before the checkpoint loads.
Structs§
- Gemma4
Weight Loader - Laguna
Weight Loader - Longcat
Weight Loader - Minimax
M2Weight Loader - NemotronH
Weight Loader - Nllb
Weight Loader - Qwen3VL
Weight Loader - Qwen3
Weight Loader - Qwen4
ExpWeight Loader - Qwen35
Dense Weight Loader - Qwen35
Weight Loader - Step3p7
Weight Loader
Enums§
- Quant
Format - 2026-09-25: Runtime quantization format of a loader’s weights, which the qwen3 and qwen35 loaders resolve from the checkpoint’s NVFP4 variant.
- Weight
Format - 2026-09-25: On-disk weight format, derived from
detect_nvfp4_variant.
Traits§
- Model
Weight Loader - 2026-09-25: Loads weights from a
WeightStoreinto typed layer objects.