pub struct SlotPlan<'a> {
pub request: SlotRequest,
pub reserve_for: &'a dyn Fn(usize) -> Result<usize>,
}Expand description
2026-10-01: The slot request and the pre-load reserve as a function of the slot count (the
preflight’s plan, inference_reserve(slots)), which KV sizing evaluates at the count it
builds.
Fields§
§request: SlotRequest§reserve_for: &'a dyn Fn(usize) -> Result<usize>Auto Trait Implementations§
impl<'a> Freeze for SlotPlan<'a>
impl<'a> !RefUnwindSafe for SlotPlan<'a>
impl<'a> !Send for SlotPlan<'a>
impl<'a> !Sync for SlotPlan<'a>
impl<'a> Unpin for SlotPlan<'a>
impl<'a> !UnwindSafe for SlotPlan<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more