MES-719: Local Caching

[markovejnovic]

No description provided.

[mesa-dot-dev]

Mesa Description

This PR introduces a new, asynchronous, file-based caching library designed to improve performance by storing data locally on disk.

The core of this new functionality resides in the new lib/cache module, which provides a generic, trait-based framework for caching operations.

Key changes include:

• File-Based Cache (fcache): An async-safe FileCache implementation that stores entries as files. It manages the total cache size and automatically evicts items when the max_size_bytes limit is reached.
• LRU Eviction Policy: A new LruEvictionTracker runs in a background task to efficiently track item usage and remove the least recently used entries from the cache.
• Generic Cache Traits: A set of ReadableCache and WritableCache traits define a unified interface for both synchronous and asynchronous cache implementations.
• Library Structure: The project is now configured as a library (lib/lib.rs), creating a clear home for shared components like the new cache and I/O utilities.

^{Description generated by Mesa. Update settings}

[mesa-dot-dev]

Performed full review of d6db315...26ecc80

Analysis

1. The caching library relies on nightly-only Rust features but doesn't enable all necessary unstable gates, making it incompilable on both stable and nightly.

2. The FileCache implementation always wipes the target directory on initialization, preventing cache persistence across restarts and undermining the purpose of a file-backed cache.

3. Eviction operations mix synchronous filesystem calls in async workers without proper blocking isolation, risking runtime stalls during large batch evictions.

4. The architecture splits caching into a separate crate, but the integration has inconsistencies that may impact production usability.

Tip

Help

Slash Commands:

• /review - Request a full code review
• /review latest - Review only changes since the last review
• /describe - Generate PR description. This will update the PR body or issue comment depending on your configuration
• /help - Get help with Mesa commands and configuration options

^{0 files reviewed | 1 comments | Edit Agent Settings • Read Docs}