pub struct DraftFixed {
pub embed: DevicePtr,
pub meta: AttnMetadataDev,
pub k_pool: DevicePtr,
pub v_pool: DevicePtr,
pub block_size: u32,
pub cache_stride: u64,
pub vocab: u32,
pub rows: Option<DraftRows>,
}Expand description
2026-09-29: The MTP draft head’s fixed buffers.
Fields§
§embed: DevicePtr2026-09-29: Where the host puts the token’s embedding row (MtpHead::forward_one’s
ssm_qkvz).
meta: AttnMetadataDev2026-09-29: The draft step’s attention metadata (mtp_meta::mtp_attn_meta_dev);
max_blocks_per_seq is ignored.
k_pool: DevicePtr2026-09-29: The draft cache’s pools and geometry.
v_pool: DevicePtr§block_size: u32§cache_stride: u64§vocab: u322026-09-29: The vocabulary rows the draft lm_head scores (DraftBinding::vocab).
rows: Option<DraftRows>2026-09-30: The head’s n-row draft (the batched propose) facts (DraftBinding::rows);
None when the head drafts one row at a time.
Implementations§
Source§impl DraftFixed
impl DraftFixed
Sourcepub fn meta_rows(&self, n: u64) -> Result<AttnMetadataDev>
pub fn meta_rows(&self, n: u64) -> Result<AttnMetadataDev>
2026-09-30: The attention metadata an n-row draft step uploads: the batched
propose’s, at its allocation (mtp_meta::mtp_attn_meta_batch_dev); one row reads the
single-row step’s.
Trait Implementations§
Source§impl Clone for DraftFixed
impl Clone for DraftFixed
Source§fn clone(&self) -> DraftFixed
fn clone(&self) -> DraftFixed
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for DraftFixed
impl RefUnwindSafe for DraftFixed
impl Send for DraftFixed
impl Sync for DraftFixed
impl Unpin for DraftFixed
impl UnwindSafe for DraftFixed
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more