-
Notifications
You must be signed in to change notification settings - Fork 196
Support for TPUv5 and v6e #4109
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: develop
Are you sure you want to change the base?
Conversation
dcfcf4d
to
fb65009
Compare
community/modules/internal/slurm-gcp/instance_template/files/startup_sh_unlinted
Outdated
Show resolved
Hide resolved
community/modules/scheduler/schedmd-slurm-gcp-v6-controller/modules/slurm_files/main.tf
Outdated
Show resolved
Hide resolved
community/modules/scheduler/schedmd-slurm-gcp-v6-controller/modules/slurm_files/scripts/tpu.py
Outdated
Show resolved
Hide resolved
@@ -7,7 +7,7 @@ google-cloud-bigquery==3.11.3 | |||
google-cloud-core==2.3.3 | |||
google-cloud-secret-manager~=2.22 | |||
google-cloud-storage==2.10.0 | |||
google-cloud-tpu==1.10.0 | |||
google-cloud-tpu==1.21.0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sadly, that will not be enough, we need to change requirements.txt in slurm-gcp repo and roll an image first.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This was bumped already - though I need to sync versions and have 1.23.0
here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a note, slurm-gcp repo uses lower versions for following packages:
requests==2.31.0
PyYAML==6.0.1
Bumped versions to the versions defined in slurm-gcp repository. Did not downgrade: requests==2.31.0 PyYAML==6.0.1
* use separate startup script for TPU nodes * fix container references in README * document list_nodes and fix caching of multi-page responses
Add support for TPU v5e and V6e.
tf_version
toruntime_version
slurm-gcp-devel.zip
- otherwise only version from image is usedTODO:
Linked PR: GoogleCloudPlatform/slurm-gcp#265
Obsoletes: #3927