generate_speculative

Function generate_speculative 

Source
pub fn generate_speculative(
    model: &dyn Model,
    prompt_tokens: &[u32],
    params: &SamplingParams,
    num_drafts: usize,
) -> Result<GenerateResult>
Expand description

2026-09-25: Generate with MTP speculative decoding, delegated to Model::generate_speculative.