alerts: Add "Ring Failures" to MimirCompactorNotRunningCompaction runbook#14391
Open
alerts: Add "Ring Failures" to MimirCompactorNotRunningCompaction runbook#14391
Conversation
![cursor[bot]](https://avatars.githubusercontent.com/in/1210556?s=60&v=4){kind=small}
This comment was marked as outdated.
This comment was marked as outdated.
Sorry, something went wrong.
Contributor
|
💻 Deploy preview available (alerts: Adjust MimirCompactorNotRunningCompaction to fire after 10 minutes of sustained failures): |
This comment was marked as outdated.
This comment was marked as outdated.
juliusmh
force-pushed
the
jmh/adjust_MimirCompactorNotRunningCompaction
branch
from
8ec5710 to
a22f17b
Compare
juliusmh
changed the title
juliusmh
force-pushed
the
jmh/adjust_MimirCompactorNotRunningCompaction
branch
from
a22f17b to
edae79c
Compare
Contributor
|
💻 Deploy preview available (alerts: Add "Ring Failures" to MimirCompactorNotRunningCompaction runbook): |
juliusmh
force-pushed
the
jmh/adjust_MimirCompactorNotRunningCompaction
branch
from
edae79c to
ae7c59f
Compare
tacole02
reviewed
Feb 17, 2026
Contributor
tacole02
left a comment
tacole02
left a comment
There was a problem hiding this comment.
Docs look good! Thank you!
pracucci
reviewed
Feb 17, 2026
| - Search compactor logs for `unhealthy instances`. | ||
| - Check the [compactor ring web page](../../references/http-api/#compactor-ring-status) for unhealthy instances. | ||
| - **What it means**: The compactor ring contains unhealthy instances and compactor(s) cannot check the tenant-shard relationship. | ||
| - **How to mitigate**: Ring failures are typically transient and the alert self-resolves after ten minutes. Otherwise: consider manually forgetting unexpected instances in an `Unhealthy` state on the compactor ring web page. |
Collaborator
There was a problem hiding this comment.
Ring failures are typically transient and the alert self-resolves after ten minutes
Uhm... then the alert shouldn't trigger in the first place. Let's discuss it offline.
Contributor
Author
There was a problem hiding this comment.
Ah yeah, this comment is wrong. Updated it.
juliusmh
force-pushed
the
jmh/adjust_MimirCompactorNotRunningCompaction
branch
from
ae7c59f to
10bb980
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this PR does
This PR adjusts the
CompactorNotRunningCompactionrunbook to contain a section on "Ring Failures".Checklist
CHANGELOG.mdupdated - the order of entries should be[CHANGE],[FEATURE],[ENHANCEMENT],[BUGFIX]. If changelog entry is not needed, please add thechangelog-not-neededlabel to the PR.about-versioning.mdupdated with experimental features.Note
Low Risk
Documentation-only update (runbook text plus changelog entry) with no code or runtime behavior changes.
Overview
Adds a new Ring failures troubleshooting section to the
MimirCompactorNotRunningCompactionrunbook, including detection steps (log search forunhealthy instancesand checking the compactor ring status page) and mitigation guidance (typically transient; optionally forget unexpectedUnhealthyinstances).Updates
CHANGELOG.mdto record this documentation enhancement.Written by Cursor Bugbot for commit 10bb980. This will update automatically on new commits. Configure here.