This repository was archived by the owner on Feb 28, 2025. It is now read-only.
This repository was archived by the owner on Feb 28, 2025. It is now read-only.
Warn on NTP time drift #1495
Open
Description
If nodes running different opni components are out of sync, a variety of hard-to-diagnose issues can come up. For example, if the node running the gateway or cortex has drifted too far in the past, Grafana will make queries in the future relative to cortex. Cortex can handle a small amount of time drift but not much (this may be configurable), and will likely just silently fail such queries.
To help with this, we could add an alert to warn when any nodes are out of sync. It might also be good to check time sync between opni agents as well.