semantic cache expire #11707
-
In this example of Semantic Caching, I noticed the implementation logic. As a beginner, I have a question: Caching should inherently involve expiration mechanisms, and semantic caching is no exception. For instance, if I want to cache the result of a specific query for 1 hour, what would be a good way to implement this? The IVectorStore interface doesn’t seem to expose a direct way to set expiration times when writing data. Does this mean I need to manually manage the deletion logic myself? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
You should be able to have triggers in the cache that invalidate it for certain scenarios. Tagging @dmytrostruk |
Beta Was this translation helpful? Give feedback.
You should be able to have triggers in the cache that invalidate it for certain scenarios. Tagging @dmytrostruk