load_v4_mtp_module

metrale_model_arch::weight_loader::deepseek_v4::mtp

Function load_v4_mtp_module 

Source 
pub fn load_v4_mtp_module(
    store: &WeightStore,
    config: &ModelConfig,
    gpu: &dyn GpuBackend,
    layer_kv_dtypes: &[KvCacheDtype],
) -> Result<Option<DeepseekV4MtpModule>>
Expand description

2026-09-25: Loads the DeepSeek-V4 MTP draft module.

Returns Ok(None), loading nothing, when num_mtp_modules == 0 or the store has no mtp.0.enorm.weight. Any other missing mtp.0.* tensor is an error.