-
Notifications
You must be signed in to change notification settings - Fork 627
[CI] Use the local test report generator for Outerloop workflow #9439
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Co-authored-by: radical <[email protected]>
Can you trigger the Outerloop tests workflow to validate the changes here? |
We need to validate the case where one of the test job has a test failure. For that can you do the following:
|
Try that again |
@copilot We need to validate the case where one of the test job has a test failure. For that can you do the following: Modify one of the quarantined tests to add a bug so the test fails |
Co-authored-by: radical <[email protected]>
I've modified the Warning Firewall rules blocked me from connecting to one or more addressesI tried to connect to the following addresses, but was blocked by firewall rules:
If you need me to access, download, or install something from one of these locations, you can either:
|
This is working well. You can drop the artificial test failure now, and we can take this PR out of draft. |
Co-authored-by: radical <[email protected]>
I've removed the artificial test failure from YarpFunctionalTests.cs that was added for validation purposes. The test now correctly expects an OK status code again. This change is in commit 430266a. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR updates the Outerloop workflow to leverage the GenerateTestSummary tool for consistent test reporting. Key changes include adding OS-specific environment variable setup for the dotnet script, replacing a custom PowerShell processing block with a direct tool invocation, and reorganizing test result files by OS.
@joperezr @danmoseley this is ready for merging. |
This PR updates the Outerloop workflow to use the
tools/GenerateTestSummary
tool for generating test reports, aligning it with how test reporting is done in other workflows.Changes made
GenerateTestSummary
tool call to individual test jobs in the Outerloop workflow, providing consistent per-test reportingGenerateTestSummary
toolBenefits
Fixes #9438.
💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.