Struct RuleLevelCache 

pub struct RuleLevelCache { /* private fields */ }

Cross-grammar adaptive-token-mask cache. Cheap to clone — the inner state is shared via Arc, matching the C++ pimpl shared_ptr.

Implementations

impl RuleLevelCache

pub fn new(max_cache_memory_size: usize) -> Self

Construct a cache bounded by max_cache_memory_size bytes. Pass UNLIMITED_SIZE for no bound. Port of the C++ RuleLevelCache(size_t) constructor.

pub fn get(&self, key: &RuleMaskKey) -> Option<Arc<AdaptiveTokenMask>>

Look up the cached mask for key, marking it most-recently-used on a hit. Port of RuleLevelCache::GetCache.

pub fn add(&self, key: RuleMaskKey, mask: Arc<AdaptiveTokenMask>) -> bool

Insert mask under key. Returns true if it was stored, false if rejected (already present, or larger than the whole budget). Port of RuleLevelCache::AddCache.

pub fn get_or_compute<F>( &self, key: RuleMaskKey, compute: F, ) -> Arc<AdaptiveTokenMask>

where F: FnOnce() -> AdaptiveTokenMask,

Get-or-compute: returns the cached mask if present, otherwise runs compute, inserts the result, and returns it. This is the single call site compile.rs uses — it keeps the “hash on compile; on hit reuse, on miss compute + insert” logic in one place. The computed value is always returned even if the insert is rejected (e.g. the mask exceeds the whole budget).

pub fn entries(&self) -> Vec<(RuleMaskKey, Arc<AdaptiveTokenMask>)>

Snapshot every cached entry in LRU order (least-recently-used first), for cross-process persistence — see #918 and super::mask_snapshot.

Returns clones of the Arcs, so the caller can encode the masks without holding the cache lock.

pub fn clear(&self)

Drop every cached entry. Port of RuleLevelCache::ClearCache.

pub fn max_size(&self) -> usize

The configured memory bound in bytes (UNLIMITED_SIZE when unbounded). Port of RuleLevelCache::GetMaxSize.

pub fn memory_size(&self) -> usize

Approximate bytes held by the cache — the sum of every cached mask’s memory_size(). Port of MemorySize(const RuleLevelCache&).

pub fn hit_miss(&self) -> (u64, u64)

Lifetime (hits, misses) over Self::get — the deterministic oracle behind the #918 snapshot hit/miss tests. Not reset by Self::clear: they count lookups, not residency.

pub fn len(&self) -> usize

Number of cached entries — for tests / introspection.

pub fn is_empty(&self) -> bool

True if the cache holds no entries.

Trait Implementations

impl Clone for RuleLevelCache

fn clone(&self) -> RuleLevelCache

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RuleLevelCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.