v1.6.0: DDN-EXAScaler update and improved functionality, Source modules from generic git repos

[heyealex]

Key New Features

• DDN-EXAScaler module version update and further support added for DDN-EXAScaler with other modules.
• Import modules from gitlab and other generic git repositories.

Resource Improvements

• DDN-EXAScaler: DDN EXAScaler Lustre will now work with vm-instance, cloud-batch-job, htcondor. More information can be found in the README.
• schedmd-slurm-gcp-v5-controller: Expose enable_reconfigure from Slurm on GCP underlying module.
• SchedMD-slurm-on-gcp-controller: Allow static nodes in partitions.
• vm-instance: Add auto_delete_disk variable.
• spack-install: Improved performance and bug fixes.

Version updates

• DDN-EXAScaler: Version 6.1.0

Improvements

• git commit and branch information included when running ghpc --version.
• Shell runners are run as an executable rather than sourced.
• Documentation Slurm on GCP hybrid demo using a cloud based Slurm controller.
• hpc-cluster-amd-slurmv5.yaml example uses a builder VM for spack installation.
• Ability to import modules from generic git repositories with the git:: prefix in source.

Deprecations

• In the variable image of DDN-EXAScaler, name is no longer supported in favor of project and family.

Bugfixes

• Fixed startup script failure in HTCondor autoscaler configuration

What's Changed

• Add customized version output for debugging improvement by @thiagosgobe in Add customized version output for debugging improvement #532
• Address permadiff in vm-instance module by @tpdownes in Address permadiff in vm-instance module #542
• Exposing enable_reconfigure in Slurm-onGCP V5 by @cboneti in Exposing enable_reconfigure in Slurm-onGCP V5 #537
• Adding Slurm on GCP V4 static nodes functionality by @cboneti in Adding Slurm on GCP V4 static nodes functionality #544
• Set enable_smt default to false for slurm v5 modules by @heyealex in Set enable_smt default to false for slurm v5 modules #545
• Run shell runners as executable by @nick-stroud in Run shell runners as executable #543
• Add auto-delete boot disk as an option on vm-instance by @nick-stroud in Add auto-delete boot disk as an option on vm-instance #548
• Default slurm_cluster_name to deploy name in hybrid by @heyealex in Default slurm_cluster_name to deploy name in hybrid #550
• Default scope now allows reading AND writing. by @sandwichmaker in Default scope now allows reading AND writing. #546
• Upgrade DDN-EXAScaler to v6.1.0 by @nick-stroud in Upgrade DDN-EXAScaler to v6.1.0 #551
• Add troubleshooting for Slurm: network is unreachable by @nick-stroud in Add troubleshooting for Slurm: network is unreachable #549
• Add Epilog/Prolog scripts to install path in hybrid by @heyealex in Add Epilog/Prolog scripts to install path in hybrid #552
• Integrate DDN Lustre install script with startup-script by @nick-stroud in Integrate DDN Lustre install script with startup-script #553
• Warn users about deprecated 'name' argument for EXAScaler image by @nick-stroud in Warn users about deprecated 'name' argument for EXAScaler image #555
• remove "kind:" from examples and docs where optional by @kkr16 in remove "kind:" from examples and docs where optional #547
• Bump cloud.google.com/go/compute from 1.9.0 to 1.10.0 by @dependabot in Bump cloud.google.com/go/compute from 1.9.0 to 1.10.0 #554
• Address an idempotency in Spack install script by @tpdownes in Address an idempotency in Spack install script #557
• Replace Spack installation in AMD example with a builder VM by @tpdownes in Replace Spack installation in AMD example with a builder VM #558
• Eliminate 1 git checkout during Spack install by @tpdownes in Eliminate 1 git checkout during Spack install #559
• Address dependency checker timeout failure by @tpdownes in Address dependency checker timeout failure #561
• Merge v1.5.0 release into develop by @tpdownes in Merge v1.5.0 release into develop #565
• Enable DDN Lustre client install with pre-existing-network-storage by @nick-stroud in Enable DDN Lustre client install with pre-existing-network-storage #560
• Allow generic git sources by @heyealex in Allow generic git sources #564
• Add hybrid slurm demo example using 2 GCP projects. by @heyealex in Add hybrid slurm demo example using 2 GCP projects. #556
• Use fully-qualified Ansible module names where not used by @tpdownes in Use fully-qualified Ansible module names where not used #567
• Perform regular cleanup of Filestore VPC network peerings by @tpdownes in Perform regular cleanup of Filestore VPC network peerings #568
• Avoid spurious errors in Spack log by @tpdownes in Avoid spurious errors in Spack log #571
• Fix remove default urls by @tpdownes in Fix remove default urls #570
• Fix filestore peering network cleanup script by @tpdownes in Fix filestore peering network cleanup script #569
• Fix Ansible module for upgrading setuptools in HTCondor autoscaler by @tpdownes in Fix Ansible module for upgrading setuptools in HTCondor autoscaler #581
• Update version to 1.6.0 by @heyealex in Update version to 1.6.0 #599
• Release v1.6.0 by @heyealex in Release v1.6.0 #600

New Contributors

• @sandwichmaker made their first contribution in Default scope now allows reading AND writing. #546

Full Changelog: v1.5.0...v1.6.0

---

This discussion was created from the release v1.6.0: DDN-EXAScaler update and improved functionality, Source modules from generic git repos.