forked from jax-ml/jax
-
Notifications
You must be signed in to change notification settings - Fork 3
Create a workflow to run benchmarks #33
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
juliagmt-google
wants to merge
235
commits into
google-ml-infra:main
Choose a base branch
from
juliagmt-google:patch-1
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 1 commit
Commits
Show all changes
235 commits
Select commit
Hold shift + click to select a range
7d1b97f
Create benchmarks.yml
juliagmt-google 86af462
Update benchmarks.yml
juliagmt-google 97e4a38
Update benchmarks.yml
juliagmt-google d4f930b
Update benchmarks.yml
juliagmt-google e5ae47d
Update benchmarks.yml
juliagmt-google 9042275
Update benchmarks.yml
juliagmt-google 6c3bf18
Update benchmarks.yml
juliagmt-google f7eba41
Update benchmarks.yml
juliagmt-google 310cfaa
Update benchmarks.yml
juliagmt-google 8653ab9
Update benchmarks.yml
juliagmt-google 7ce554f
Update benchmarks.yml
juliagmt-google 7003c4e
Update benchmarks.yml
juliagmt-google 44655f4
Update benchmarks.yml
juliagmt-google dcfcf4e
Update benchmarks.yml
juliagmt-google 63fd777
Update benchmarks.yml
juliagmt-google 5058ec2
Update benchmarks.yml
juliagmt-google 0f102e1
Update benchmarks.yml
juliagmt-google b49282e
Update benchmarks.yml
juliagmt-google e891686
Update benchmarks.yml
juliagmt-google 352234f
Update benchmarks.yml
juliagmt-google 1cfa6ce
Update benchmarks.yml
juliagmt-google d528a9c
Update benchmarks.yml
juliagmt-google 55a366e
Update benchmarks.yml
juliagmt-google 0c1adc0
Update benchmarks.yml
juliagmt-google f581538
Update benchmarks.yml
juliagmt-google 2c9fe6c
Update benchmarks.yml
juliagmt-google 01cda16
Update benchmarks.yml
juliagmt-google 4b8fbdb
Update benchmarks.yml
juliagmt-google 57c1673
Update benchmarks.yml
juliagmt-google 43bf80b
Update benchmarks.yml
juliagmt-google cdb1a30
Update benchmarks.yml
juliagmt-google 620a9e1
Update benchmarks.yml
juliagmt-google 863f263
Update benchmarks.yml
juliagmt-google af183a4
Update benchmarks.yml
juliagmt-google a0b2dd3
Update benchmarks.yml
juliagmt-google 5a363a9
Update benchmarks.yml
juliagmt-google 9fef073
Update benchmarks.yml
juliagmt-google d057d0f
Update benchmarks.yml
juliagmt-google 176da98
Update benchmarks.yml
juliagmt-google 724b7d7
Update benchmarks.yml
juliagmt-google 392d152
Update benchmarks.yml
juliagmt-google f6bb4d4
Update benchmarks.yml
juliagmt-google 33ce83c
Update benchmarks.yml
juliagmt-google 341e2a1
Update benchmarks.yml
juliagmt-google 89deed1
Update benchmarks.yml
juliagmt-google d56c1db
Update benchmarks.yml
juliagmt-google 5afa062
Update benchmarks.yml
juliagmt-google a057dbe
Update benchmarks.yml
juliagmt-google 6e208c5
Update benchmarks.yml
juliagmt-google af424ac
Update benchmarks.yml
juliagmt-google a05d32a
Update benchmarks.yml
juliagmt-google 1e3cd5f
Update benchmarks.yml
juliagmt-google 8472ccd
Update benchmarks.yml
juliagmt-google 6fdae96
Update benchmarks.yml
juliagmt-google 1919b0e
Update benchmarks.yml
juliagmt-google a76b14e
Update benchmarks.yml
juliagmt-google f772be5
Update benchmarks.yml
juliagmt-google d22041e
Update benchmarks.yml
juliagmt-google 5051abd
Update benchmarks.yml
juliagmt-google 81301c8
Update benchmarks.yml
juliagmt-google eefc513
Update benchmarks.yml
juliagmt-google 9067033
Update benchmarks.yml
juliagmt-google 5ccac5e
Update benchmarks.yml
juliagmt-google a69190b
Update benchmarks.yml
juliagmt-google 2222254
Update benchmarks.yml
juliagmt-google a1550fc
Update benchmarks.yml
juliagmt-google d3b58db
Update benchmarks.yml
juliagmt-google dee2556
Update benchmarks.yml
juliagmt-google b2206e1
Update benchmarks.yml
juliagmt-google ad59911
Update benchmarks.yml
juliagmt-google 036fce8
Update benchmarks.yml
juliagmt-google 12362de
Create parse_xla_logs.py
juliagmt-google 0ea713f
Update benchmarks.yml
juliagmt-google 0161250
Update benchmarks.yml
juliagmt-google 85d332a
Update benchmarks.yml
juliagmt-google d67626c
Update benchmarks.yml
juliagmt-google 39567e4
Update benchmarks.yml
juliagmt-google a94f159
Update benchmarks.yml
juliagmt-google ff8dd3e
Update benchmarks.yml
juliagmt-google 7e89850
Update benchmarks.yml
juliagmt-google 97e85cf
Update benchmarks.yml
juliagmt-google 370eb4a
Update benchmarks.yml
juliagmt-google 8bcac86
Update benchmarks.yml
juliagmt-google 36b2d89
Update benchmarks.yml
juliagmt-google 536e4c7
Update benchmarks.yml
juliagmt-google 069011e
Update benchmarks.yml
juliagmt-google e278006
Update benchmarks.yml
juliagmt-google 43b24ae
Update benchmarks.yml
juliagmt-google 87ba364
Update benchmarks.yml
juliagmt-google 4b6ce3e
Update benchmarks.yml
juliagmt-google 808d88e
Update benchmarks.yml
juliagmt-google 5533e6e
Update benchmarks.yml
juliagmt-google dccf656
Update benchmarks.yml
juliagmt-google 69d154e
Update benchmarks.yml
juliagmt-google 0855903
Update benchmarks.yml
juliagmt-google 3419350
Update benchmarks.yml
juliagmt-google 2c1776a
Update benchmarks.yml
juliagmt-google 84d9f47
Update benchmarks.yml
juliagmt-google 53c5b6e
Update benchmarks.yml
juliagmt-google 3e2f050
Update benchmarks.yml
juliagmt-google f9c5740
Update benchmarks.yml
juliagmt-google 9345fd6
Update benchmarks.yml
juliagmt-google 731ef68
Update benchmarks.yml
juliagmt-google 783bc57
Update benchmarks.yml
juliagmt-google 2bdbf77
Update benchmarks.yml
juliagmt-google 3bafca0
Update benchmarks.yml
juliagmt-google a527c94
Update benchmarks.yml
juliagmt-google df63d67
Update benchmarks.yml
juliagmt-google 54be71c
Update benchmarks.yml
juliagmt-google 788cc88
Update benchmarks.yml
juliagmt-google b5c3ab7
Update benchmarks.yml
juliagmt-google 343cfc6
Update benchmarks.yml
juliagmt-google fe26440
Update benchmarks.yml
juliagmt-google e45ccf8
Update benchmarks.yml
juliagmt-google f075237
Update benchmarks.yml
juliagmt-google f216d1c
Update benchmarks.yml
juliagmt-google 634148e
Update benchmarks.yml
juliagmt-google e6223d0
Update benchmarks.yml
juliagmt-google e1123df
Update benchmarks.yml
juliagmt-google e11186e
Update benchmarks.yml
juliagmt-google 16ab09d
Update benchmarks.yml
juliagmt-google 57829a9
Update benchmarks.yml
juliagmt-google a7721cd
Update benchmarks.yml
juliagmt-google d15c675
Update benchmarks.yml
juliagmt-google 278a117
Update benchmarks.yml
juliagmt-google a457e16
Update benchmarks.yml
juliagmt-google de9a7d3
Update benchmarks.yml
juliagmt-google eab3435
Update benchmarks.yml
juliagmt-google caccc3c
Update benchmarks.yml
juliagmt-google 16b0591
Update benchmarks.yml
juliagmt-google 1682c63
Update benchmarks.yml
juliagmt-google 0119316
Update benchmarks.yml
juliagmt-google b46e56c
Update benchmarks.yml
juliagmt-google 1541dc3
Update benchmarks.yml
juliagmt-google f0d2332
Update benchmarks.yml
juliagmt-google bca6b94
Update benchmarks.yml
juliagmt-google 4970a53
Update benchmarks.yml
juliagmt-google 2b0ad2a
Update benchmarks.yml
juliagmt-google 0365726
Update benchmarks.yml
juliagmt-google 3f7ca39
Update benchmarks.yml
juliagmt-google e9249ad
Update benchmarks.yml
juliagmt-google 08076d2
Update benchmarks.yml
juliagmt-google fd61b43
Update benchmarks.yml
juliagmt-google 78e75f4
Update benchmarks.yml
juliagmt-google 8240dcc
Update benchmarks.yml
juliagmt-google 684ec54
Update benchmarks.yml
juliagmt-google 84faa6e
Update benchmarks.yml
juliagmt-google c26d947
Update benchmarks.yml
juliagmt-google 74a717e
Update benchmarks.yml
juliagmt-google 5fb3d04
Update benchmarks.yml
juliagmt-google 5f03557
Update benchmarks.yml
juliagmt-google 6b1e703
Update benchmarks.yml
juliagmt-google b59fa62
Update benchmarks.yml
juliagmt-google f5a873b
Update benchmarks.yml
juliagmt-google e30f672
Update benchmarks.yml
juliagmt-google 690b880
Update benchmarks.yml
juliagmt-google 896a9bf
Update benchmarks.yml
juliagmt-google e518ec3
Update benchmarks.yml
juliagmt-google e0f6662
Update benchmarks.yml
juliagmt-google 6d0394e
Update benchmarks.yml
juliagmt-google 15efd20
Update benchmarks.yml
juliagmt-google e1a1c2e
Update benchmarks.yml
juliagmt-google 0e04c79
Update benchmarks.yml
juliagmt-google 4e352fc
Update benchmarks.yml
juliagmt-google 4f8c1e7
Update benchmarks.yml
juliagmt-google bf63119
Update benchmarks.yml
juliagmt-google 5667c46
Update benchmarks.yml
juliagmt-google 7f0a09f
Update benchmarks.yml
juliagmt-google 3bc65f8
Update benchmarks.yml
juliagmt-google e6b9ec7
Update benchmarks.yml
juliagmt-google 78cddef
Update benchmarks.yml
juliagmt-google f9527cf
Update benchmarks.yml
juliagmt-google 560c96e
Update benchmarks.yml
juliagmt-google c673278
Update benchmarks.yml
juliagmt-google 1f94828
Update benchmarks.yml
juliagmt-google 3f95da7
Update benchmarks.yml
juliagmt-google ec601af
Update benchmarks.yml
juliagmt-google 20fc17d
Update benchmarks.yml
juliagmt-google a095ac7
Update benchmarks.yml
juliagmt-google 0c675e2
Update benchmarks.yml
juliagmt-google 3f8fdbd
Update benchmarks.yml
juliagmt-google 3136300
Update benchmarks.yml
juliagmt-google 9b9830f
Update benchmarks.yml
juliagmt-google 5805ee6
Update benchmarks.yml
juliagmt-google f5094ce
Update benchmarks.yml
juliagmt-google a4dea4b
Update benchmarks.yml
juliagmt-google 08a8951
Update benchmarks.yml
juliagmt-google abda341
Update benchmarks.yml
juliagmt-google e5ba4b2
Update benchmarks.yml
juliagmt-google 77c2e0a
Update benchmarks.yml
juliagmt-google a8c8c16
Update benchmarks.yml
juliagmt-google 3d7c2d7
Update benchmarks.yml
juliagmt-google a4e9a8f
Update benchmarks.yml
juliagmt-google a1c684d
Update benchmarks.yml
juliagmt-google 5ba454c
Update benchmarks.yml
juliagmt-google c42a41a
Update benchmarks.yml
juliagmt-google 0ee8f54
Update benchmarks.yml
juliagmt-google acc23fd
Update benchmarks.yml
juliagmt-google f02ccef
Update benchmarks.yml
juliagmt-google 1d4db34
Update benchmarks.yml
juliagmt-google 46d97f9
Update benchmarks.yml
juliagmt-google 92f23a8
Update benchmarks.yml
juliagmt-google 8893183
Update benchmarks.yml
juliagmt-google 1e86090
Update benchmarks.yml
juliagmt-google 99ea45b
Update benchmarks.yml
juliagmt-google 3e44ec7
Update benchmarks.yml
juliagmt-google b5d1db2
Update benchmarks.yml
juliagmt-google af9f592
Update benchmarks.yml
juliagmt-google 0593aed
Update benchmarks.yml
juliagmt-google e44d997
Update benchmarks.yml
juliagmt-google ae05cde
Update benchmarks.yml
juliagmt-google d233727
Update benchmarks.yml
juliagmt-google f03cd88
Update benchmarks.yml
juliagmt-google 8a1a755
Update benchmarks.yml
juliagmt-google 23631ca
Update benchmarks.yml
juliagmt-google 2e5d6fc
Update benchmarks.yml
juliagmt-google 5a89600
Update benchmarks.yml
juliagmt-google 5e91697
Update benchmarks.yml
juliagmt-google 28b615a
Update benchmarks.yml
juliagmt-google 44eca76
Update benchmarks.yml
juliagmt-google 5805f0d
Update benchmarks.yml
juliagmt-google 7d25041
Update benchmarks.yml
juliagmt-google 23e21c2
Update benchmarks.yml
juliagmt-google f3d5432
Update benchmarks.yml
juliagmt-google fd3175e
Update benchmarks.yml
juliagmt-google 0b0d0ec
Update benchmarks.yml
juliagmt-google 9352da5
Update benchmarks.yml
juliagmt-google c9f2d12
Update benchmarks.yml
juliagmt-google 9350bb1
Update benchmarks.yml
juliagmt-google 7bc7b08
Update benchmarks.yml
juliagmt-google 62a2ddd
Update benchmarks.yml
juliagmt-google fd4f423
Update benchmarks.yml
juliagmt-google 2f1e208
Update benchmarks.yml
juliagmt-google eb5c971
Update benchmarks.yml
juliagmt-google 409d207
Update benchmarks.yml
juliagmt-google File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,63 @@ | ||
| name: Benchmarks | ||
|
|
||
| on: | ||
| # pull_request: | ||
| # branches: | ||
| # - main | ||
| workflow_dispatch: | ||
| inputs: | ||
| halt-for-connection: | ||
| description: 'Should this workflow run wait for a remote connection?' | ||
| type: choice | ||
| required: true | ||
| default: 'no' | ||
| options: | ||
| - 'yes' | ||
| - 'no' | ||
|
|
||
| jobs: | ||
| build: | ||
| strategy: | ||
| matrix: | ||
| runner: ["linux-x86-g2-48-l4-4gpu"] | ||
|
|
||
| runs-on: ${{ matrix.runner }} | ||
| container: | ||
| image: "gcr.io/tensorflow-testing/nosla-cuda12.3-cudnn9.1-ubuntu20.04-manylinux2014-multipython:latest" | ||
|
|
||
| env: | ||
| JAXCI_HERMETIC_PYTHON_VERSION: 3.11 | ||
|
|
||
| steps: | ||
| - uses: actions/checkout@v3 | ||
| # Halt for testing | ||
| - name: Wait For Connection | ||
| uses: google-ml-infra/actions/ci_connection@main | ||
| with: | ||
| halt-dispatch-input: ${{ inputs.halt-for-connection }} | ||
| - name: Build jaxlib | ||
| env: | ||
| JAXCI_CLONE_MAIN_XLA: 1 | ||
| run: ./ci/build_artifacts.sh "jaxlib" | ||
| - name: Build jax-cuda-plugin | ||
| env: | ||
| JAXCI_CLONE_MAIN_XLA: 1 | ||
| run: ./ci/build_artifacts.sh "jax-cuda-plugin" | ||
| - name: Build jax-cuda-pjrt | ||
| env: | ||
| JAXCI_CLONE_MAIN_XLA: 1 | ||
| run: ./ci/build_artifacts.sh "jax-cuda-pjrt" | ||
| - name: Run Bazel GPU tests locally | ||
| run: ./ci/run_bazel_test_gpu_non_rbe.sh | ||
| - name: Install dependencies | ||
| run: | | ||
| python -m pip install --upgrade pip | ||
| pip install pytest | ||
| pip install absl-py | ||
| # pip install -U jax | ||
| # pip install -U "jax[cuda12]" | ||
| pip install google-benchmark | ||
| - name: Run Multiprocess GPU Test | ||
| run: | | ||
| python -m pytest tests/multiprocess_gpu_test.py | ||
|
|
||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.