Struct MemoryCache 

pub struct MemoryCache { /* private fields */ }

In-memory LRU cache store.

Enforces a maximum byte limit. When the limit is exceeded, the least recently accessed entries are evicted. Thread-safe via Mutex.

Implementations

impl MemoryCache

pub fn new(max_bytes: usize) -> Self

Create a new memory cache with a maximum byte limit.

pub fn len(&self) -> usize

Number of entries currently in the cache.

pub fn is_empty(&self) -> bool

Whether the cache is empty.

pub fn current_bytes(&self) -> usize

Current memory usage in bytes.

pub fn clear(&self)

Clear all entries.

Trait Implementations

impl CacheStore for MemoryCache

fn put_with_origin( &self, key: &CacheKey, value: &Value, origin: &Origin, ) -> Result<()>

Overridden because the trait’s default drops the origin, and MemoryCache is the default store — so unless it records provenance, most entries in most runs have none. It used to write Computed { node_id: "", run_id: "" } for everything, which reads as provenance while carrying none.

fn get(&self, key: &CacheKey) -> Result<Option<Value>>

Look up the value stored under key, None on a miss.

fn put(&self, key: &CacheKey, value: &Value) -> Result<()>

Store value under key, replacing any existing entry.

fn exists(&self, key: &CacheKey) -> Result<bool>

Whether key has an entry, without loading the value.

fn remove(&self, key: &CacheKey) -> Result<()>

Delete the entry under key; absent keys are not an error.

fn metadata(&self, key: &CacheKey) -> Result<Option<EntryMeta>>

The entry’s [EntryMeta], without loading the value.

fn put_computed( &self, key: &CacheKey, value: &Value, origin: &Origin, compute: Duration, deterministic: bool, ) -> Result<(), SomaError>

Store a freshly-computed value with its full provenance record: origin, wall-clock compute cost, and the producer’s determinism declaration. Cost-aware eviction needs the compute time — a tiny value that took days must outlive a huge one that took seconds. The default discards the extra metadata.

fn tier(&self) -> CacheTier

Which tier this store is, for reporting.

fn get_located( &self, key: &CacheKey, ) -> Result<Option<(Value, CacheTier)>, SomaError>

Like [CacheStore::get], but also reports which tier served the value.

impl Default for MemoryCache

fn default() -> Self

Returns the “default value” for a type.