When conversations become really long or that we have many conversations, all of it might not fit into the LLM context window. Thus we'll need some kind of compression to make the context smaller. This will become increasingly important as we get more information into invincible-voice, for example by fetching information from the calendar, mails, etc...
A simple solution might be to ask an LLM to summarize old conversations/emails and only keep important information.
We could trigger some kind of "compacting" task turning 100 old conversations into a document in the settings, and then the old conversations would get deleted.
When conversations become really long or that we have many conversations, all of it might not fit into the LLM context window. Thus we'll need some kind of compression to make the context smaller. This will become increasingly important as we get more information into invincible-voice, for example by fetching information from the calendar, mails, etc...
A simple solution might be to ask an LLM to summarize old conversations/emails and only keep important information.
We could trigger some kind of "compacting" task turning 100 old conversations into a document in the settings, and then the old conversations would get deleted.