Skip to content

Log probe outcome failures at info instead of error - #1630

Open
locker95 wants to merge 1 commit into
prometheus:masterfrom
locker95:fix-1510-probe-failure-log-level
Open

Log probe outcome failures at info instead of error#1630
locker95 wants to merge 1 commit into
prometheus:masterfrom
locker95:fix-1510-probe-failure-log-level

Conversation

@locker95

Copy link
Copy Markdown

Description

Since v0.28.0, failed probes are logged at error, which can't be filtered with --log.prober (highest filter is still error). That turns routine probe outcomes — timeouts, refused connections, expected-fail TCP modules, regex mismatches — into the same severity as real exporter problems.

This demotes probe outcome failures to info. Configuration / local setup failures stay at error.

Operators who want quiet probe logs can use --log.prober=warn or --log.prober=error.

Fixes #1510

How to verify

go test ./...

# optional smoke:
# run blackbox with a module that fails (e.g. tcp to a closed port),
# confirm "Probe failed" / dial errors are level=INFO
# and disappear with --log.prober=error
[BUGFIX] Log probe outcome failures at info instead of error so they can be filtered with --log.prober #1510

Probe failures are operational results (target down, expected-fail
modules, flaky networks), not blackbox_exporter errors. Logging them
at error made them impossible to silence with --log.prober and mixed
them with real exporter problems.

Keep error level for configuration and local setup failures.

Fixes prometheus#1510

Signed-off-by: Dean Chen <862469039@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Version 0.28.0 always logs probe failures (as 'ERROR' level failures) with no way to turn it off

1 participant