Skip to content

add 3 new alliance clusters (config files) #291

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 6 commits into
base: master
Choose a base branch
from
Draft

add 3 new alliance clusters (config files) #291

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
549229c
add 3 new alliance clusters (config files)
nurbal Oct 15, 2024
2ed4b63
Merge remote-tracking branch 'origin/master' into new_alliance_clusters
nurbal Oct 7, 2025
596dbbb
Add gpu_per_nodes for new clusters
notoraptor Oct 8, 2025
cb54650
replace old clusters by their replacements in scraping script
nurbal Oct 7, 2025
70df91c
Merge branch 'master' into new_alliance_clusters
nurbal Oct 14, 2025
53fb78d
Merge branch 'master' into new_alliance_clusters
nurbal Oct 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
63 changes: 63 additions & 0 deletions config/sarc-dev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -196,3 +196,66 @@ sarc:
h100: H100-SXM5-80GB
tg[10601-10606,10701-10707,10801-10807,10901-10908,11101-11107,11201-11207]:
h100: H100-SXM5-80GB
fir:
host: fir.alliancecan.ca
timezone: America/Vancouver
accounts:
- rrg-bengioy-ad_gpu
- rrg-bengioy-ad_cpu
- def-bengioy_gpu
- def-bengioy_cpu
sacct_bin: "/opt/software/slurm/bin/sacct"
duc_inodes_command:
duc_storage_command:
diskusage_report_command: diskusage_report --project --all_users
prometheus_url:
prometheus_headers_file:
start_date: '2025-08-11'
gpus_per_nodes:
__DEFAULTS__:
h100: H100-SXM5-80GB
nvidia_h100_80gb_hbm3_1g.10gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_2g.20gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_3g.40gb: __MIG_FLAG__h100
nibi:
host: nibi.alliancecan.ca
timezone: America/Toronto
accounts:
- rrg-bengioy-ad_gpu
- rrg-bengioy-ad_cpu
- def-bengioy_gpu
- def-bengioy_cpu
sacct_bin: "/opt/software/slurm/bin/sacct"
duc_inodes_command:
duc_storage_command:
diskusage_report_command: diskusage_report --project --all_users
prometheus_url:
prometheus_headers_file:
start_date: '2025-07-31'
gpus_per_nodes:
__DEFAULTS__:
h100: H100-SXM5-80GB
nvidia_h100_80gb_hbm3_1g.10gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_2g.20gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_3g.40gb: __MIG_FLAG__h100
rorqual:
host: rorqual.alliancecan.ca
timezone: America/Montreal
accounts:
- rrg-bengioy-ad_gpu
- rrg-bengioy-ad_cpu
- def-bengioy_gpu
- def-bengioy_cpu
sacct_bin: "/opt/software/slurm/bin/sacct"
duc_inodes_command:
duc_storage_command:
diskusage_report_command: diskusage_report --project --all_users
prometheus_url:
prometheus_headers_file:
start_date: '2025-06-19'
gpus_per_nodes:
__DEFAULTS__:
h100: H100-SXM5-80GB
nvidia_h100_80gb_hbm3_1g.10gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_2g.20gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_3g.40gb: __MIG_FLAG__h100
65 changes: 63 additions & 2 deletions config/sarc-prod.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -184,5 +184,66 @@ sarc:
h100: H100-SXM5-80GB
tg[10601-10606,10701-10707,10801-10807,10901-10908,11101-11107,11201-11207]:
h100: H100-SXM5-80GB


fir:
host: fir.alliancecan.ca
timezone: America/Vancouver
accounts:
- rrg-bengioy-ad_gpu
- rrg-bengioy-ad_cpu
- def-bengioy_gpu
- def-bengioy_cpu
sacct_bin: "/opt/software/slurm/bin/sacct"
duc_inodes_command:
duc_storage_command:
diskusage_report_command: diskusage_report --project --all_users
prometheus_url:
prometheus_headers_file:
start_date: '2025-08-11'
gpus_per_nodes:
__DEFAULTS__:
h100: H100-SXM5-80GB
nvidia_h100_80gb_hbm3_1g.10gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_2g.20gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_3g.40gb: __MIG_FLAG__h100
nibi:
host: nibi.alliancecan.ca
timezone: America/Toronto
accounts:
- rrg-bengioy-ad_gpu
- rrg-bengioy-ad_cpu
- def-bengioy_gpu
- def-bengioy_cpu
sacct_bin: "/opt/software/slurm/bin/sacct"
duc_inodes_command:
duc_storage_command:
diskusage_report_command: diskusage_report --project --all_users
prometheus_url:
prometheus_headers_file:
start_date: '2025-07-31'
gpus_per_nodes:
__DEFAULTS__:
h100: H100-SXM5-80GB
nvidia_h100_80gb_hbm3_1g.10gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_2g.20gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_3g.40gb: __MIG_FLAG__h100
rorqual:
host: rorqual.alliancecan.ca
timezone: America/Montreal
accounts:
- rrg-bengioy-ad_gpu
- rrg-bengioy-ad_cpu
- def-bengioy_gpu
- def-bengioy_cpu
sacct_bin: "/opt/software/slurm/bin/sacct"
duc_inodes_command:
duc_storage_command:
diskusage_report_command: diskusage_report --project --all_users
prometheus_url:
prometheus_headers_file:
start_date: '2025-06-19'
gpus_per_nodes:
__DEFAULTS__:
h100: H100-SXM5-80GB
nvidia_h100_80gb_hbm3_1g.10gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_2g.20gb: __MIG_FLAG__h100
nvidia_h100_80gb_hbm3_3g.40gb: __MIG_FLAG__h100
2 changes: 1 addition & 1 deletion scripts/systemd/scrapers.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,6 @@ SCRIPT=$(readlink -f "$0")
SCRIPTPATH=$(dirname "$SCRIPT")
cd $SCRIPTPATH/../../
# scraping jobs
sudo -u sarc SARC_MODE=scraping SARC_CONFIG=$SCRIPTPATH/../../config/sarc-prod.yaml ../.local/bin/uv run sarc acquire jobs -c narval mila -d auto
sudo -u sarc SARC_MODE=scraping SARC_CONFIG=$SCRIPTPATH/../../config/sarc-prod.yaml ../.local/bin/uv run sarc acquire jobs -c narval fir rorqual nibi mila -d auto
# scraping users
sudo -u sarc SARC_MODE=scraping SARC_CONFIG=$SCRIPTPATH/../../config/sarc-prod.yaml ../.local/bin/uv run sarc acquire users