[Feature request] store activity data on disk

[de-wim]

Hi,

I'd like to be able to have requests sent to llama-swap stored to disk. I implemented this in #679 but got no response.

The changes in that PR were made invalid by the changes from #710.

I want this for a number of reasons:

• To be able to inspect request/responses even after a llama-swap restart
• To keep this data present and available for future use

I use the activity view to see how other tools are using LLMs when writing my own tools/harness, but I also want to use this to passively collect real usage data and response/requests from larger LLMs for finetuning smaller models.

Let me know if you'd be open to such functionality being added to llama-swap.

[mostlygeek]

Hi,

I have a design in mind and will be implementing that with some other changes. So I won't be taking any PRs for the functionality.

[aw1597]

Love to get this feature. I rely on the activity log a lot to understand and debug issues. Anytime I have to restart llamaswap, the idea of losing the activity log makes me re-think a bit.