Settings: support for setting data retention

[domeq]

Would it be possible to add support for data retention settings? Meaning automatically delete data older than X?

I was thinking it would make sense to have this set per site, ideally separately for session replays (typically shorter retention) vs other events (typically longer).

As far as I understand, right now the setup is basically to store everything forever, right?

[goldflag]

Right now the default retention for session replays is 30 days. For web analytics and other things retention is infinite, but it is very unlikely that you will ever encounter disk space issues with non session replay events.

In the future I will probably add custom data retention policies.

[domeq]

That is great to hear! Must've missed this in the docs, 30 days for replays seems reasonable for now 👍🏻
I just started sending events to a self-hosted rybbit instance so I lack the experience of longterm disk space usage.

[jvllmr]

Would there be interest in a PR that adds UI settings for configuring retention policies with all kinds of data?

[goldflag]

Would there be interest in a PR that adds UI settings for configuring retention policies with all kinds of data?

Right now the self hosted version doesn't have a proper admin panel yet, so there's no place to put this unless you want to build an entire admin panel which brings up more issues because of how self-hosted account creation works right now.

To keep everything lightweight I would just set retention policies directly in clickhouse. https://rybbit.com/docs/managing-your-installation#edit-session-replay-retention-policy

[jvllmr]

Would there be interest in a PR that adds UI settings for configuring retention policies with all kinds of data?

Right now the self hosted version doesn't have a proper admin panel yet, so there's no place to put this unless you want to build an entire admin panel which brings up more issues because of how self-hosted account creation works right now.

To keep everything lightweight I would just set retention policies directly in clickhouse. rybbit.com/docs/managing-your-installation#edit-session-replay-retention-policy

I wouldn't see it as a global setting per se, but more as a per-site setting. Some sites might have more traffic than others and accumulate more data in a shorter time. A per-site setting would allow sites with less traffic to show a longer span of data.