Struct BeamReq 

pub struct BeamReq {
    pub prompt_tokens: Vec<u32>,
    pub src_lang_id: u32,
    pub tgt_lang_id: u32,
    pub adapter_slot: i32,
    pub num_beams: usize,
    pub max_new: usize,
    pub length_penalty: f32,
    pub early_stopping: bool,
}

2026-09-26: One beam-search request for a translation model (NLLB): the per-request parameters the scheduler copies from the sequence. ModelForward::generate_beam_batch runs the search to completion.

Fields

prompt_tokens: Vec<u32>

2026-09-25: Source subword ids; the model adds the source-language id and EOS itself.

src_lang_id: u32

2026-09-25: Source and target language token ids; 0 uses the deployment default.

tgt_lang_id: u32

adapter_slot: i32

2026-09-25: LoRA slot: >= 0 applies the adapter, -1 runs the base model.

num_beams: usize

max_new: usize

length_penalty: f32

early_stopping: bool

Trait Implementations

impl Clone for BeamReq

fn clone(&self) -> BeamReq

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BeamReq

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.