PromptLookupSeq

Struct PromptLookupSeq 

Source
pub struct PromptLookupSeq { /* private fields */ }
Expand description

2026-10-02: One sequence’s prompt-lookup state: its index, its copy window, and the length of the copy now awaiting verification (0 when the pending drafts are the model drafter’s).

Implementations§

Source§

impl PromptLookupSeq

Source

pub fn new(cfg: &PromptLookupConfig) -> Self

2026-10-02: Fresh state. The window starts at WINDOW_START (or the ceiling, if lower), so an untested sequence’s first copies are short and a wrong one costs few verify rows.

Source

pub fn propose(&mut self, history: &[u32], max_len: usize) -> Option<Vec<u32>>

2026-10-02: Proposes a copy of at most max_len tokens for history (prompt, generated tokens and the token about to be verified), and marks it in flight. None (and nothing in flight) when there is no match or max_len is 0. The caller bounds max_len, normally by window.

No copy is proposed while a miss backoff is cooling down (each call counts one round), or when the match spans fewer than min_match tokens.

Source

pub fn propose_with( &mut self, history: &[u32], max_len: usize, shared: impl FnOnce(&[u32], usize) -> Option<Vec<u32>>, ) -> Option<Vec<u32>>

2026-10-04: propose, but when the sequence’s own history has no match, asks shared (the cross-request cache) for a copy of at most max_len tokens. The own history is asked first; the cooldown applies to both; a shared copy is settled like an own one.

Source

pub fn in_flight_shared(&self) -> bool

2026-10-04: The in-flight copy came from the cross-request cache.

Source

pub fn in_flight(&self) -> usize

2026-10-02: Length of the copy awaiting verification; 0 when none.

Source

pub fn settle(&mut self, accepted: usize) -> usize

2026-10-02: Closes the in-flight copy: accepted of its tokens matched. Returns the copy’s length (0 when none was in flight, which changes nothing).

A copy that matched nothing starts (or doubles) a backoff of up to miss_backoff rounds; any accepted token clears it.

Source

pub fn abandon(&mut self)

2026-10-02: Drops an in-flight copy without judging it (its drafts were discarded unverified).

Source

pub fn window(&self) -> usize

2026-10-02: The current copy window.

Trait Implementations§

Source§

impl Clone for PromptLookupSeq

Source§

fn clone(&self) -> PromptLookupSeq

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for PromptLookupSeq

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,