Conversation
Benthos CheckSkip guard requires test.run to be non-empty and match the test name. With --unit we were omitting -run entirely, causing all integration tests to skip. Use -run ^Test instead to match all test functions while satisfying the guard.
…e repair Two-stage pipeline that uses Claude agents to triage and fix integration test failures automatically. The triage agent (sonnet) classifies each failure as test_infra or code_bug, tracks it in Jira under CON-381 with structured output. The fix agent (opus) operates in an isolated git worktree per package, applies targeted fixes with one commit per issue, then cherry-picks results back to the current branch. Cherry-picks are mutex-serialized so concurrent agents don't step on each other. Two entry points: - run --fix [--fix-max-parallel N]: dispatches triage+fix in the background as packages fail, waits for all agents before exiting. - fix <output-file.txt>: standalone mode for re-triaging a previously captured test output file. Other changes: - Worktree recovery on startup picks up commits from prior interrupted runs. - splitFlagsAndArgs allows interspersed flags and positional filters (e.g. "run --fix kafka --debug"). - All agent activity logged to shared agents.log with per-package prefixes. Triage cost/duration always logged since these are real dollars. - Fixed JSON schema mismatch (failures vs issues) that would silently produce empty triage results. - Fixed file handle leak in triage output error path.
Adds --loop N flag to repeat runs until N successful clean iterations, retrying in-place while fix agents may apply repairs. Packages currently being fixed are postponed within an iteration instead of running against stale code, and mgr.Wait() now runs on every iteration (not only on failure). Adds Manager.IsFixing for the postpone check.
Add confluent, cypher, iceberg/integration, mssqlserver/replication, ollama, oracledb/replication, otlp, postgresql/pglogicalstream, redpanda, and spicedb to the integration test package list. Document skipped packages (cohere, cyborgdb, tigerbeetle, zeromq) inline with a "skip" reason field. The loader filters them out automatically.
Contributor
Author
|
Re-creating with correct spelling and stats. |
|
Commits Review LGTM |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
cassandra
#4296
cockroachdb
#4297
confluent
#4298
elasticsearch
#4299
kafka
#4301
migrator
#4302
mongodb
#4303
mssqlserver
#4304
mysql
#4305
ollama
#4306
oracledb
#4307
postgresql
#4308
pulsar
#4309
redis
#4310
redpanda
#4311
redpanda_migrator
#4312
redpandatest
#4313
sql
#4314