-
Notifications
You must be signed in to change notification settings - Fork 1.9k
Description
Bug description
I'm currently maintaining a self hosted signoz instance (v0.106.0) on k8s in my workspace.
Since v0.100.0 the sqlite database, used by signoz instance itself, ends up getting locked. This then leads to anything depending on the database not working including alerts.
Error: database is locked
To unlock the database I need to exec into the pod, recreate the file for the database (copy to temp file, overwrite current file with temp file). This is a method that has been mentioned on multiple places online to unlock the database.
Expected behavior
SQLite database not getting locked. Alerts firing as usual
How to reproduce
While I do not have the specific steps to reproduce this issue, I've noticed that happens most often when an alert or dashboard is being updated.
Version information
- Signoz version: 0.106.0
- Browser version: Safari 26.2
- Your OS and version: Ubuntu 22.04
- Your CPU Architecture(ARM/Intel): x86
Additional context
Signoz is deployed using the helm chart.
We have seen a maximum of 5 concurrent users at a time.
We also have 47 alert rules defined, each evaluated at 5 minutes frequency. The alerts are created using the query builder and are split between metrics and traces based alerts.