[Flaky Test Fixer] Let the agent read Buildkite artifacts#271916
Conversation
| - defaults | ||
| - buildkite.com | ||
| - '*.buildkite.com' | ||
| - buildkiteartifacts.com |
There was a problem hiding this comment.
Whitelist buildkiteartifacts.com so the agent can download the test failure screenshot (when available). I'd get a 403 error otherwise.
| env: | ||
| BK_VERSION: 3.44.0 | ||
| BK_SHA256: 88867c0b983ad2afe1efc26f0df6b46b5673577c1aea95eba76992636fb9abe9 | ||
| OPS_BUILDKITE_TOKEN: ${{ secrets.OPS_BUILDKITE_TOKEN }} |
There was a problem hiding this comment.
Interact with Buildkite via the bk CLI and using the OPS_BUILDKITE_TOKEN token stored in Kibana's repository secrets.
| ## Comment format | ||
|
|
||
| Post exactly one comment. Keep the visible portion very short and easy to read: | ||
| Post exactly one comment on the issue. Keep it concise, actionable, and prioritize the most critical findings at the very top. Adapt the sections below to best fit the specific failure. **Use `####` for all subsections** (e.g., `#### Proposed Fix`, `#### Root Cause`). |
There was a problem hiding this comment.
Improve the comment formatting to make reading the investigations easier.
csr
changed the title
OPS_BUILDKITE_TOKEN to workflow, improve comment format
csr
added
backport:skip
steliosmavro
left a comment
steliosmavro
left a comment
There was a problem hiding this comment.
flaky-test-investigator looks good!
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Found one regression risk in the prompt-format change: the human-readable format can change, but the previously documented machine-readable findings block should remain stable for downstream consumers.
Generated by Codex Reviewer for issue #271916
There was a problem hiding this comment.
Found one prompt/CLI mismatch that can break artifact listing during investigations.
Generated by Codex Reviewer for issue #271916
💛 Build succeeded, but was flaky
Failed CI StepsTest Failures
Metrics [docs]
History
cc @csr |
4 participants
This PR equips the Failed Test Investigator workflow with a
bkCLI and a repository-provided Buildkite token so it can read failure screenshots, DOM snapshots, orkibana.logfrom the failing build. We also tighten the comment format for an improved reading experience.All changes were tested with the
gh aw trialcommand using a sample GitHub issue. Sample command: