v1.7.0: Improved blueprint validation, official support for Ubuntu, and bug fixes for Slurm v5

[tpdownes]

Key New Features

• A new test_apis_enabled validator will check whether Google Cloud services required by the blueprint are enabled
• The Cloud HPC Toolkit has added official support for Ubuntu 20.04 images

Improvements

• Batch modules now support Shared VPC networks
• VPC module enables jumbo frames by default
• AMD-optimized blueprint includes the OpenFOAM application compiled for the Zen 3 microarchitecture
• A new example blueprint demonstrates using local SSD disks with VM instances
• A new example blueprint demonstrates installation of StarCCM+ CFD simulation application

Bug Fixes

• Resolve Slurm v5 startup-script timeout errors
  by demonstrating the use of a build VM to install Spack and optimized applications
• Fix incompatibility between DDN Exascaler (Lustre) and Slurm v5 modules

What's Changed

• Add shared task for recover from terraform failure by @nick-stroud in Add shared task for recover from terraform failure #578
• Automatically pull serial port 1 logs on startup script failure by @nick-stroud in Automatically pull serial port 1 logs on startup script failure #580
• Bump github.com/hashicorp/hcl/v2 from 2.14.0 to 2.14.1 by @dependabot in Bump github.com/hashicorp/hcl/v2 from 2.14.0 to 2.14.1 #572
• Enable shared VPC to be used with Batch modules by @nick-stroud in Enable shared VPC to be used with Batch modules #573
• Update default MTU for new VPCs by @tpdownes in Update default MTU for new VPCs #577
• Replace HTCondor integration test by @tpdownes in Replace HTCondor integration test #583
• Remove blueprint_dir update in integration tests by @heyealex in Remove blueprint_dir update in integration tests #582
• Add documentation that cloud-batch-job supports shared vpc by @nick-stroud in Add documentation that cloud-batch-job supports shared vpc #584
• Add Spack setup runner by @nick-stroud in Add Spack setup runner #586
• Implement API validation by @tpdownes in Implement API validation #576
• Add documentation for API validation by @tpdownes in Add documentation for API validation #585
• Document troubleshooting for Slurm startup script timeouts by @tpdownes in Document troubleshooting for Slurm startup script timeouts #590
• Bump github.com/zclconf/go-cty from 1.10.0 to 1.11.0 by @dependabot in Bump github.com/zclconf/go-cty from 1.10.0 to 1.11.0 #491
• Update wait for startup for qsim example to 2400s by @heyealex in Update wait for startup for qsim example to 2400s #591
• Bump google.golang.org/api from 0.96.0 to 0.98.0 by @dependabot in Bump google.golang.org/api from 0.96.0 to 0.98.0 #589
• Bump github.com/googleapis/gax-go/v2 from 2.4.0 to 2.5.1 by @dependabot in Bump github.com/googleapis/gax-go/v2 from 2.4.0 to 2.5.1 #588
• Fix test_apis_enabled to handle empty API list by @tpdownes in Fix test_apis_enabled to handle empty API list #592
• Add default Spack log file by @nick-stroud in Add default Spack log file #595
• Fix: passing non-existent cache was causing failures in some projects by @nick-stroud in Fix: passing non-existent cache was causing failures in some projects #593
• Batch modules should require Batch API by @tpdownes in Batch modules should require Batch API #597
• Support local module required APIs by @tpdownes in Support local module required APIs #596
• hybrid-slurm documentation for on-premise by @heyealex in hybrid-slurm documentation for on-premise #579
• Add ability to pass non-text variables through the cli --vars flag by @kkr16 in Add ability to pass non-text variables through the cli --vars flag #574
• Additional Batch parameters by @nick-stroud in Additional Batch parameters #594
• Add slurm v5 HPC Centos example to integration tests by @heyealex in Add slurm v5 HPC Centos example to integration tests #587
• Clarify and compact validator failure message by @tpdownes in Clarify and compact validator failure message #598
• Add slurm-gcp-v5-ubuntu2004 example to integration tests by @heyealex in Add slurm-gcp-v5-ubuntu2004 example to integration tests #601
• Remove deployment_name var from vpc example as it is passed implicitly by @nick-stroud in Remove deployment_name var from vpc example as it is passed implicitly #605
• Add variable to turn off public ips on Batch jobs by @nick-stroud in Add variable to turn off public ips on Batch jobs #609
• Update AMD blueprint with OpenFOAM application and test suite by @tpdownes in Update AMD blueprint with OpenFOAM application and test suite #606
• Filestore cleanup fails on existing instances by @heyealex in Filestore cleanup fails on existing instances #610
• Develop by @omartin2010 in Develop #608
• Add image support documentation by @heyealex in Add image support documentation #611
• Push test deployment directory to GCS by @heyealex in Push test deployment directory to GCS #602
• release-candidate - Handle case that cloud-batch-job does not have startup script in metadata by @nick-stroud in release-candidate - Handle case that cloud-batch-job does not have startup script in metadata #612
• Add a boilerplate blueprint to README by @nick-stroud in Add a boilerplate blueprint to README #617
• Back-porting EXAScaler fix for V5 on release candidate by @cboneti in Back-porting EXAScaler fix for V5 on release candidate #624
• Release Candidate: Simcenter StarCCM+ Tutorial Blueprint by @heyealex in Release Candidate: Simcenter StarCCM+ Tutorial Blueprint #637
• Resolve conflicts on release-candidate by @nick-stroud in Resolve conflicts on release-candidate #646
• Release v1.7.0 by @tpdownes in Release v1.7.0 #649

New Contributors

• @omartin2010 made their first contribution in Develop #608

Full Changelog: v1.6.0...v1.7.0