Semantic-Caching
Filed under
1 post
One Door to the Models, Part 6: Semantic Caching and Its Failure Modes
A semantic cache is a correctness surface, not just a cost lever. Part 6 tunes the threshold, isolates tenants, and handles the day the cache is gone.