-
Notifications
You must be signed in to change notification settings - Fork 592
CI Testing Upgrade #5430
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
CI Testing Upgrade #5430
Changes from 19 commits
Commits
Show all changes
35 commits
Select commit
Hold shift + click to select a range
7ff7dd2
Switch from VSTest to MTP
Mackamuir 13d269c
Update CI
Mackamuir 49811d6
Cleanup
Mackamuir 876c6e1
Push initial timing baseline
Mackamuir 217bb66
Fix race condition
Mackamuir 85fe5a8
Fix issue with run artifacts being deleted
Mackamuir 73967a0
Merge branch 'starlight-dev' into big-test-p1
Mackamuir 35572d7
Merge branch 'starlight-dev' into big-test-p1
Mackamuir be0a9d3
Bump shards back up to 6
Mackamuir 090bf6b
Merge remote-tracking branch 'origin/big-test-p1' into big-test-p1
Mackamuir b835ff4
I may have not be running all tests >.<
Mackamuir 5455758
Add some more verbosity to harvest
Mackamuir 51dc7a4
Run editor config rather than a python script
Mackamuir b929948
spaces in filenames
Mackamuir ecb707a
update clrf checker
Mackamuir f45c51e
Fix rabbits comments
Mackamuir 7b123d2
force a testfail
Mackamuir 8a8e136
typo
Mackamuir d678d09
Give reviewdog a go
Mackamuir eab3431
remove ansi
Mackamuir 3f949e4
revert reviewdog from editorconfig lint
Mackamuir 8afb80d
Merge branch 'starlight-dev' into big-test-p1
Mackamuir dea5924
remo
Mackamuir 6532d21
Wow reviewdog reviewing and doggin
Mackamuir 4a27576
Add reviewdog BACK to the editorconfig linter so we can only warn on …
Mackamuir 06e70c2
revert testfail
Mackamuir 5308e19
6 shard test
Mackamuir 7483758
Merge remote-tracking branch 'origin/big-test-p1' into big-test-p1
Mackamuir 5dc4c20
up to 8
Mackamuir e086c96
reduce to 4
Mackamuir 3fc12a8
Timeouts and such
Mackamuir 36c38be
Merge branch 'starlight-dev' into big-test-p1
Mackamuir 036c598
Merge branch 'starlight-dev' into big-test-p1
Mackamuir 31f09af
simplify if statement
Rinary1 194d4aa
fix falsy bug and ws
Mackamuir File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| <?xml version="1.0" encoding="UTF-8"?> | ||
| <RunSettings> | ||
| <NUnit> | ||
| <MapWarningTo>Failed</MapWarningTo> | ||
| <ConsoleOut>0</ConsoleOut> | ||
| </NUnit> | ||
| </RunSettings> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,76 @@ | ||
| name: Publish Test Report | ||
|
|
||
| # Second half of build-test-debug | ||
| # see https://github.com/ctrf-io/github-test-reporter/blob/main/docs/fork-pull-requests.md | ||
|
|
||
| on: | ||
| workflow_run: | ||
| workflows: [ 'Build & Test Debug' ] | ||
| types: [ completed ] | ||
|
|
||
| permissions: {} | ||
|
|
||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.workflow_run.head_sha }} | ||
| cancel-in-progress: true | ||
|
|
||
| jobs: | ||
| report: | ||
| name: Comment Test Results | ||
| if: >- | ||
| github.event.workflow_run.event == 'pull_request' && | ||
| github.event.workflow_run.conclusion != 'cancelled' && | ||
| github.event.workflow_run.conclusion != 'skipped' | ||
| runs-on: ubuntu-slim | ||
| permissions: | ||
| actions: read | ||
| contents: read | ||
| pull-requests: write | ||
| steps: | ||
| - name: Download CTRF test results | ||
| continue-on-error: true | ||
| uses: actions/download-artifact@v8 | ||
| with: | ||
| run-id: ${{ github.event.workflow_run.id }} | ||
| github-token: ${{ secrets.GITHUB_TOKEN }} | ||
| pattern: test-nunit-* | ||
| path: /tmp/ctrf-results | ||
|
|
||
| - name: Determine PR number | ||
| id: pr | ||
| env: | ||
| GH_TOKEN: ${{ secrets.GITHUB_TOKEN }} | ||
| GH_REPO: ${{ github.repository }} | ||
| HEAD_SHA: ${{ github.event.workflow_run.head_sha }} | ||
| run: | | ||
| PR_NUM=$(gh api "repos/${GH_REPO}/commits/${HEAD_SHA}/pulls" \ | ||
| --jq "[.[] | select(.state == \"open\" and .head.sha == \"${HEAD_SHA}\") | .number] | first // empty" || true) | ||
|
|
||
| if [ -z "$PR_NUM" ]; then | ||
| PR_NUM=$(gh pr list --state open --limit 100 --json number,headRefOid \ | ||
| --jq "[.[] | select(.headRefOid == \"${HEAD_SHA}\") | .number] | first // empty" || true) | ||
| fi | ||
|
|
||
| if [ -z "$PR_NUM" ]; then | ||
| echo "No open PR found for head SHA ${HEAD_SHA}; skipping comment" | ||
| else | ||
| echo "Commenting on PR #${PR_NUM}" | ||
| fi | ||
|
|
||
| echo "number=${PR_NUM}" >> "$GITHUB_OUTPUT" | ||
|
|
||
| - name: Comment test results on PR | ||
| if: ${{ steps.pr.outputs.number != '' }} | ||
| uses: ctrf-io/github-test-reporter@v1 | ||
| with: | ||
| report-path: '/tmp/ctrf-results/**/*.json' | ||
| title: Content + Integration Test Results | ||
| community-report: true | ||
| community-report-name: cobra-report | ||
| issue: ${{ steps.pr.outputs.number }} | ||
| overwrite-comment: true | ||
| comment-tag: debug-ci-test-report | ||
| exit-on-no-files: false | ||
| exit-on-fail: false | ||
| env: | ||
| GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} | ||
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.