Hybrid Cache experiment

[thangchung]

Ref: https://devblogs.microsoft.com/dotnet/hybrid-cache-is-now-ga/

[thangchung]

if we type unknown or a beef => our system return and unknown message, then show up the menu.
Then trying it second time, this time it needs to be cached

[thangchung]

Context management ref: https://github.com/AzureManagedRedis/semantic-caching-demo-and-calculator/blob/main/backend/services.py#L256

• user_preferences
• conversation_history
• context_memory

[thangchung]

I'm working on it at https://github.com/thangchung/semantic-caching-demo