pub struct Fp8KvWriteTarget {
pub kernel: KernelHandle,
pub k_pool: DevicePtr,
pub v_pool: DevicePtr,
pub block_size: u32,
pub cache_stride: u64,
pub key_stride: u32,
pub value_stride: u32,
pub slot: DevicePtr,
}Expand description
2026-09-25: Where the caller’s live FP8 write goes, so the replay can
repeat it (qwen3_attention/decode/write_kv_cache_fp8.rs builds it).
Fields§
§kernel: KernelHandle2026-09-25: The layer’s reshape_cache_k handle.
k_pool: DevicePtr§v_pool: DevicePtr§block_size: u32§cache_stride: u642026-09-25: Pool stride per block, in elements (PagedKvCache::cache_stride).
key_stride: u322026-09-25: Source K row stride in elements, as passed to the live write.
value_stride: u322026-09-25: Source V row stride in elements, as passed to the live write.
slot: DevicePtr2026-09-25: This batch’s slot_mapping, staged with the K/V so the
replay writes the same cache entries.
Trait Implementations§
Source§impl Clone for Fp8KvWriteTarget
impl Clone for Fp8KvWriteTarget
Source§fn clone(&self) -> Fp8KvWriteTarget
fn clone(&self) -> Fp8KvWriteTarget
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for Fp8KvWriteTarget
impl Debug for Fp8KvWriteTarget
impl Copy for Fp8KvWriteTarget
Auto Trait Implementations§
impl Freeze for Fp8KvWriteTarget
impl RefUnwindSafe for Fp8KvWriteTarget
impl Send for Fp8KvWriteTarget
impl Sync for Fp8KvWriteTarget
impl Unpin for Fp8KvWriteTarget
impl UnwindSafe for Fp8KvWriteTarget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more