-
Notifications
You must be signed in to change notification settings - Fork 68
adding prometheus alert rule for pod high memory usage #564
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
adding prometheus alert rule for pod high memory usage #564
Conversation
/ok-to-test |
@rh-gwinn please also implement unit tests for this. You can find several examples of unit tests in https://github.com/redhat-appstudio/o11y/tree/main/test/promql/tests/data_plane |
Also, if it helps there's a reference for these unit tests here: https://prometheus.io/docs/prometheus/latest/configuration/unit_testing_rules/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think most of these rules are missing thresholds, so I'm not sure if they will always go off, or never go off. I think there might be some duplication in the last 3 alerts in the file, too. And in a couple of cases it looks like the description / summary is wrong or incomplete.
rhobs/alerting/data_plane/prometheus.high_memory_usage_alert.yaml
Outdated
Show resolved
Hide resolved
rhobs/alerting/data_plane/prometheus.high_memory_usage_alert.yaml
Outdated
Show resolved
Hide resolved
rhobs/alerting/data_plane/prometheus.high_memory_usage_alert.yaml
Outdated
Show resolved
Hide resolved
rhobs/alerting/data_plane/prometheus.high_memory_usage_alert.yaml
Outdated
Show resolved
Hide resolved
rhobs/alerting/data_plane/prometheus.high_memory_usage_alert.yaml
Outdated
Show resolved
Hide resolved
rhobs/alerting/data_plane/prometheus.high_memory_usage_alert.yaml
Outdated
Show resolved
Hide resolved
rhobs/alerting/data_plane/prometheus.high_memory_usage_alert.yaml
Outdated
Show resolved
Hide resolved
rhobs/alerting/data_plane/prometheus.high_memory_usage_alert.yaml
Outdated
Show resolved
Hide resolved
indent line 40
prometheus / grafana alert setting