Commit 14627f6
authored
Add ClickHouse query for nightly binary pipeline failure alert (#8231)
## Summary
Adds the ClickHouse query that backs a new Grafana alert for **nightly
binary build pipeline failures** (e.g. the
`linux-aarch64-binary-manywheel` / `manywheel-cpu-aarch64-build`
failures on the `nightly` branch).
Stored under `clickhouse_db_schema/grafana_alerts/` to match the
existing convention (queries in source control; the Grafana rule itself
is created in the UI).
## Query
Counts nightly-branch binary-build jobs that completed with `conclusion
= 'failure'` in the last 24h; the Grafana rule fires when count > 0.
## Tunables (call out for review)
- `workflow_name LIKE '%-binary-%'` scopes to the binary pipeline; drop
it to alert on *any* `nightly`-branch failure.
- 24h window matches the daily nightly cadence.
- Threshold (`> 0`) / team / priority live in the Grafana rule
annotations, not the SQL.
## Next step (manual, not in this repo)
Create the rule in `pytorchci.grafana.net/alerting/` using this query,
with `Teams` + `Priority` annotations and advanced notification routing
-> flows to alerting-infra -> GitHub issue. Then backfill the rule URL
into the SQL comment.1 parent 8a8caea commit 14627f6
1 file changed
Lines changed: 17 additions & 0 deletions
Lines changed: 17 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
0 commit comments