Skip to content

Benchmark CI#14420

Merged
jeo02 merged 18 commits intoAzure:mainfrom
jeo02:azsdk-benchmark-pipeline
Mar 18, 2026
Merged

Benchmark CI#14420
jeo02 merged 18 commits intoAzure:mainfrom
jeo02:azsdk-benchmark-pipeline

Conversation

@jeo02
Copy link
Member

@jeo02 jeo02 commented Mar 9, 2026

Running the Benchmark parallel to the release plan so it does not block release for now.

  • Based of discussion from PR.
  • Added in the copilot token to AzSDK_Eval_Variable_group
  • Using this pipeline to test the devops template Removing pipeline since it is directly being used in CI

Copilot AI review requested due to automatic review settings March 9, 2026 20:44
@jeo02 jeo02 requested review from a team as code owners March 9, 2026 20:44
@github-actions github-actions bot added the azsdk-cli Issues related to Azure/azure-sdk-tools::tools/azsdk-cli label Mar 9, 2026
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR integrates the Azure SDK CLI benchmarks into the release CI pipeline. Instead of blocking the release process, the benchmark job runs in parallel with the release plan as a CustomReleaseJob. It adds a new reusable pipeline template (benchmark-job.yml) to eng/common and references it from the azsdk-cli CI configuration.

Changes:

  • Adds eng/common/pipelines/templates/jobs/benchmark-job.yml: A new job template that checks out the repo (sparse), installs .NET 8, and runs the benchmark CLI with configurable scenario/tag/model/parallelism options.
  • Modifies tools/azsdk-cli/ci.yml: References the new benchmark template as a CustomReleaseJob, running the benchmarks for the azsdk-cli project.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 6 comments.

File Description
eng/common/pipelines/templates/jobs/benchmark-job.yml New shared job template for running benchmarks via dotnet run against a configurable project path
tools/azsdk-cli/ci.yml Adds the benchmark job as a CustomReleaseJob (internal-only, parallel to release)

@azure-sdk
Copy link
Collaborator

The following pipelines have been queued for testing:
java - template
java - template - tests
js - template
net - template
net - template - tests
python - template
python - template - tests
You can sign off on the approval gate to test the release stage of each pipeline.
See eng/common workflow

@azure-sdk
Copy link
Collaborator

The following pipelines have been queued for testing:
java - template
java - template - tests
js - template
net - template
net - template - tests
python - template
python - template - tests
You can sign off on the approval gate to test the release stage of each pipeline.
See eng/common workflow

@azure-sdk
Copy link
Collaborator

The following pipelines have been queued for testing:
java - template
java - template - tests
js - template
net - template
net - template - tests
python - template
python - template - tests
You can sign off on the approval gate to test the release stage of each pipeline.
See eng/common workflow

@azure-sdk
Copy link
Collaborator

The following pipelines have been queued for testing:
java - template
java - template - tests
js - template
net - template
net - template - tests
python - template
python - template - tests
You can sign off on the approval gate to test the release stage of each pipeline.
See eng/common workflow

@azure-sdk
Copy link
Collaborator

The following pipelines have been queued for testing:
java - template
java - template - tests
js - template
net - template
net - template - tests
python - template
python - template - tests
You can sign off on the approval gate to test the release stage of each pipeline.
See eng/common workflow

@azure-sdk
Copy link
Collaborator

The following pipelines have been queued for testing:
java - template
java - template - tests
js - template
net - template
net - template - tests
python - template
python - template - tests
You can sign off on the approval gate to test the release stage of each pipeline.
See eng/common workflow

@azure-sdk
Copy link
Collaborator

The following pipelines have been queued for testing:
java - template
java - template - tests
js - template
net - template
net - template - tests
python - template
python - template - tests
You can sign off on the approval gate to test the release stage of each pipeline.
See eng/common workflow

@jeo02 jeo02 enabled auto-merge (squash) March 17, 2026 20:52
@jeo02 jeo02 merged commit 123cdd4 into Azure:main Mar 18, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

azsdk-cli Issues related to Azure/azure-sdk-tools::tools/azsdk-cli

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants