Struct MemoryInputs 

pub struct MemoryInputs<'a> {

    pub served: &'a Circuit,
    pub declared: &'a Circuit,
    pub copies: &'a [CopyRule],
    pub settings: &'a BTreeMap<String, String>,
    pub states: &'a StateInputs,
    pub draft_kv_dtype: Option<StateDtype>,
    pub caches: &'a CacheInputs,
    pub runs: &'a [ActivationRun<'a>],
    pub families: Option<(&'a Families, u64)>,
    pub legacy_arena: Option<u64>,
    pub driver: DriverTerms,
    pub budget_bytes: u64,
    pub chunk_slack: u64,
}

2026-10-02: Everything a memory model is evaluated from.

Fields

served: &'a Circuit

2026-10-02: The circuit at the served formats.

declared: &'a Circuit

2026-10-02: The same model at its checkpoint’s declared formats.

copies: &'a [CopyRule]

2026-10-02: Derived-copy rules.

settings: &'a BTreeMap<String, String>

2026-10-02: Serve settings the copy rules read.

states: &'a StateInputs

2026-10-02: Recurrent slots and KV blocks (the engine’s counts).

draft_kv_dtype: Option<StateDtype>

2026-10-02: The draft head’s KV element type when it differs from the target’s (an MTP head keeps its own pool, kv_cache_dtype of the draft section’s states).

caches: &'a CacheInputs

2026-10-02: Cache units (the engine’s counts).

runs: &'a [ActivationRun<'a>]

2026-10-02: Activation runs; the largest arena is the term.

families: Option<(&'a Families, u64)>

2026-10-02: Kernel families for the workspaces, and the device’s SM count they read.

legacy_arena: Option<u64>

2026-10-02: The legacy buffer arena the default forward allocates, bytes.

driver: DriverTerms

2026-10-02: The class’s driver terms and the util budget, bytes.

budget_bytes: u64

2026-10-02: device memory x util.

chunk_slack: u64

2026-10-02: Small-allocation chunk slack measured from a ledger; 0 when unknown.

Trait Implementations

impl<'a> Clone for MemoryInputs<'a>

fn clone(&self) -> MemoryInputs<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for MemoryInputs<'a>