pub struct PromptLookupConfig {
pub ngram: usize,
pub max_drafts: usize,
pub max_seqs: usize,
pub min_match: usize,
pub miss_backoff: usize,
}Expand description
2026-10-02: Serve-wide prompt-lookup settings (--prompt-lookup-*).
Fields§
§ngram: usize2026-10-02: n-gram length that must match (--prompt-lookup-ngram).
max_drafts: usize2026-10-02: Most tokens one copy proposes (--prompt-lookup-max-drafts);
the copy window’s ceiling.
max_seqs: usize2026-10-02: Widest batch that proposes copies (--prompt-lookup-max-seqs).
min_match: usize2026-10-02: Tokens a copy’s match must span, counted back from the
history’s end (--prompt-lookup-min-match, at least ngram).
miss_backoff: usize2026-10-02: Most rounds a sequence skips copying after copies that
matched nothing (--prompt-lookup-miss-backoff); 0 never skips.
Trait Implementations§
Source§impl Clone for PromptLookupConfig
impl Clone for PromptLookupConfig
Source§fn clone(&self) -> PromptLookupConfig
fn clone(&self) -> PromptLookupConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for PromptLookupConfig
impl Debug for PromptLookupConfig
Source§impl PartialEq for PromptLookupConfig
impl PartialEq for PromptLookupConfig
impl Copy for PromptLookupConfig
impl Eq for PromptLookupConfig
impl StructuralPartialEq for PromptLookupConfig
Auto Trait Implementations§
impl Freeze for PromptLookupConfig
impl RefUnwindSafe for PromptLookupConfig
impl Send for PromptLookupConfig
impl Sync for PromptLookupConfig
impl Unpin for PromptLookupConfig
impl UnwindSafe for PromptLookupConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.