Problem:
Every question sent via the GenAI module hits the Sugar-AI
server even if the same question was asked recently. This
wastes quota and slows response time for children.
Proposed Solution
- Add a simple local dict-based or JSON cache in the GenAI folder
- Cache responses for identical questions per session
- Add a cache size limit to avoid memory issues
Expected Outcome
Faster responses for repeated questions + reduced server load.
I'm a GSoC 2026 contributor and would love to work on this!
Problem:
Every question sent via the GenAI module hits the Sugar-AI
server even if the same question was asked recently. This
wastes quota and slows response time for children.
Proposed Solution
Expected Outcome
Faster responses for repeated questions + reduced server load.
I'm a GSoC 2026 contributor and would love to work on this!