Expand description
2026-09-25: Qwen3.5-family loaders: the separate-projection linear-attention weights and three MoE loaders (NVFP4, native FP8 experts, no shared expert).
Owner: model-layers (weight loading). Invariants: none beyond the types.
Structs§
- Nvfp4
MoeCopies - 2026-09-27: Which NVFP4 copies
load_moe_qwen35builds. A projection it does not build is NULL (QuantizedWeight::null()). - SsmWeights
Qwen35 - 2026-09-25: Qwen3.5 linear-attention weights with separate projections. The
projections,
conv1dandnormare BF16;a_loganddt_biasare FP32.
Functions§
- load_
moe_ no_ shared - 2026-09-25: Load a MoE block that has no shared expert. A zero-filled shared
expert of real expert size stands in: its packed codes, scales and
weight_scale_2are all 0, so it contributes 0. Routed experts go throughquantized_auto, which panics forFp8DequantedandBf16Raw. - load_
moe_ qwen35 - 2026-09-25: Load a Qwen3.5 MoE block (
{layer_prefix}.mlp) as NVFP4. - load_
moe_ qwen35_ fp8_ experts - 2026-09-25: Load the routed experts of
{layer_prefix}.mlpas native FP8 block-scaled tables, one entry per expert id. Experts this rank does not hold are NULL entries taggedFp8BlockScaled. - load_
ssm_ qwen35 - 2026-09-25: Load the Qwen3.5
{layer_prefix}.linear_attnweights.