Conversation
There was a problem hiding this comment.
Pull request overview
This PR integrates the Azure SDK CLI benchmarks into the release CI pipeline. Instead of blocking the release process, the benchmark job runs in parallel with the release plan as a CustomReleaseJob. It adds a new reusable pipeline template (benchmark-job.yml) to eng/common and references it from the azsdk-cli CI configuration.
Changes:
- Adds
eng/common/pipelines/templates/jobs/benchmark-job.yml: A new job template that checks out the repo (sparse), installs .NET 8, and runs the benchmark CLI with configurable scenario/tag/model/parallelism options. - Modifies
tools/azsdk-cli/ci.yml: References the new benchmark template as aCustomReleaseJob, running the benchmarks for theazsdk-cliproject.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 6 comments.
| File | Description |
|---|---|
eng/common/pipelines/templates/jobs/benchmark-job.yml |
New shared job template for running benchmarks via dotnet run against a configurable project path |
tools/azsdk-cli/ci.yml |
Adds the benchmark job as a CustomReleaseJob (internal-only, parallel to release) |
|
The following pipelines have been queued for testing: |
|
The following pipelines have been queued for testing: |
tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/Azure.Sdk.Tools.Cli.Benchmarks.csproj
Outdated
Show resolved
Hide resolved
|
The following pipelines have been queued for testing: |
|
The following pipelines have been queued for testing: |
|
The following pipelines have been queued for testing: |
|
The following pipelines have been queued for testing: |
|
The following pipelines have been queued for testing: |
Running the Benchmark parallel to the release plan so it does not block release for now.
AzSDK_Eval_Variable_groupUsing this pipeline to test the devops templateRemoving pipeline since it is directly being used in CI