AccuralAI Cache Memory

In-memory cache implementations.

class accuralai_cache.memory.MemoryCacheOptions(*args: Any, **kwargs: Any)

Bases: CacheConfig

Configuration options for in-memory cache behaviour.

eager_expiry: bool = True

class accuralai_cache.memory.MemoryCache(*, options: MemoryCacheOptions | None = None)

Bases: BaseCache

LRU-style cache with TTL support.

__init__(*, options: MemoryCacheOptions | None = None) → None

async get(key: str, *, request: GenerateRequest) → GenerateResponse | None

async set(key: str, value: GenerateResponse, *, ttl_s: int | None = None) → None

async invalidate(key: str) → None

async invalidate_prefix(prefix: str) → None

Optional hook for derived caches; default routes to individual invalidation.

async accuralai_cache.memory.build_memory_cache(*, config: Mapping[str, Any] | Any | None = None, **_: Any) → MemoryCache

Factory for registering the advanced memory cache.

accuralai_cache.memory.AdvancedMemoryCache

alias of MemoryCache

accuralai_cache.memory.CacheOptions

alias of MemoryCacheOptions