Magic Castle 9.0

Changed

• Upgrade to Terraform 0.13, with a new minimum requirement of 0.13.4

Magic Castle 8.5

Added

• [puppet] Added Duo MFA classes and on/off switches for management, login and compute nodes (Contributed by Darren Boss puppet-mc PR 72)

Changed

• [puppet] Refactored logic identifying the presence of an NVIDIA GPU to consider memory instead of instance name.
• [puppet] Updated the version of most modules installed with Puppetfile
• [puppet] Fixed permissions of nvidia-modprobe when installing Arbutus' nvidia-vgpu-tools rpm.

Magic Castle 8.4

Changed

• [puppet] Updated puppet-jupyterhub version to v3.5.1

Magic Castle 8.3

Changed

• Fixed puppetenv_rev default value when creating Magic Castle release (Commit bf30e13)
• [puppet] Bump puppet-jupyterhub version to v3.4.2
• [puppet] Fixed freeipa issue when an ip was already recorded in the DNS and a new instance was joining the realm with the same ip (puppet-magic_castle issue #69)

Magic Castle 8.2

Added

• [puppet] Added Cloudflare load balancer cvmfs_acl_regex (issue #64)
• [puppet] Added SELinux policy to allow fail2ban to ban using route (issue #65)

Changed

• Fixed AWS, Azure, GCP and OVH examples that were incorrectly refering to openstack module
• [cloud-init] Bumped puppetserver to 6.13.0 and puppetagent to 6.18.0
• [puppet] Replaced homemade template of squid.conf by usage of puppet-squid module
• [puppet] Bumped puppet-jupyterhub to v3.4.1
• [puppet] Fixed slurmctld dependency to cluster registeration in slurmdbd
• [puppet] Fixed ipa_create_user password configuration

Magic Castle 8.1

Added

• Added ability to generate an ssh keypair to upload files with Terraform file provisioner.
• [puppet] Added options in hieradata to configure CVMFS repos

Changed

• Activated VPC DNS support in AWS (issue #108)
• Fixed documentation in multiple sections (PR #92, #93, #97, #98, #101, #106)
• Fixed DNS section of AWS example (PR #108)
• [puppet] Replaced homemade template of squid.conf by usage of puppet-squid module

Magic Castle 8.0

Following release of CentOS 8 2004, AWS now provides an official CentOS 8 image that has been tested and is functional with Magic Castle 8.0.

Added

• Added the login node ids as output of the main Magic Castle Terraform module.
• Added a trigger to DNS module deploy_certs based on login node ids. If there is a modification to one of the login node state, the certificates will be uploaded to the corresponding login node, without having to taint the deploy_certs resource manually (PR #88).
• Added try function around access to index 0 of resource array to limit errors when destroying resources.
• [puppet] Added a resource in profile::base to remove terraform local-exec leftover empty scripts in /tmp.

Changed

• [puppet] Id of the accounts created in FreeIPA now start at UID_MAX defined /etc/login.defs. (commonly 60000 instead of 50000)
• [puppet] fail2ban configuration is now done with puppet-fail2ban module. The sshd jail is now named ssh-route.
• [cloud-init] Bumped puppetserver to 6.12.0 and puppetagent to 6.16.0.
• Puppet hieradata yaml files are now uploaded with Terraform file provisioner instead of being embedded in mgmt1 userdata. This means a change to the number of users, the guest password, or the hieradata variable no longer trigger a rebuild of mgmt1
  but only a reupload of YAML files (PR #89)
• [docs] Various fixes (Issues #87, #92, #93)

Removed

• Hieradata has been removed from puppetmaster.yaml template.

Magic Castle 7.3

This release introduces three main features:

• Add support for Slurm 20
• Add support for CentOS 8. Tested functional on GCP and OpenStack. AWS and Azure do not provide
  an official CentOS 8 image with cloud-init support at the moment of this release.
• Add support for Compute Canada Arbutus Cloud NVIDIA VGPUs (flavor vgpu-...).

Changed

• Improved main documentation.
• [AWS] Most resources if not all now have the name of the cluster as a prefix in their name
• [OpenStack] Simplified volume attachment count computation
• [puppet] Slurm plugin spank-cc-tmpfs_mounts is now installed from copr yumrepo
• [puppet] Fixed order of slurm packages install
• [puppet] Exec resource in charge of creating the slurm cluster in slurmdbd now returns 0 if the cluster already exists
• [puppet] consul-template class initialization is now entirely in hieradata file common.yaml.
• [puppet] CentOS 8 support: replaced notification of nfs-idmap.service by notification of nfs-server.service.
• [puppet] CentOS 8 support: replaced pdsh by clustershell
• [puppet] CentOS 8 support: rpc_nfs_args is now only defined if os is CentOS 7.
• [puppet] CentOS 8 support: ipa_create_user.py now use /usr/libexec/platform-python instead of /usr/bin/env python.
• [puppet] CentOS 8 support: Replaced Python 2 unicode calls in ipa_create_user.py by six's text_type
• [puppet] CentOS 8 support: Moved list of nvidia package names from class profile::gpu to hieradata. List now depends on CentOS version.
• [puppet] CentOS 8 support: Moved FreeIPA regen_cert_cmd value to hieradata. Command now depends on CentOS version.
• [puppet] Bumped puppet-jupyterhub version to 3.3.2
• [puppet] Update nvidia driver fact to make sure at most one version is in the output
• [puppet] Changed logic of nvidia_grid_vgpu fact to just check if the instance flavor includes vgpu in its name
• [puppet] CentOS 8 support: Moved default loaded CVMFS modules to hieradata. Module list now depends on CentOS version
• [puppet] CentOS 8 support: Fixed nfs clean rbind execstop warning
• [puppet] Replaced tcp_con_validator to check if slurmdbd is running by a wait_for ressource on slurmdbd.log regex
• [puppet] CentOS 8 support: Fixed package name in nvidia-driver-version fact.
• [cloud-init] Replaced reboot -n in runcmd by power_state with reboot now. This makes sure final stage of cloud-init is applied before reboot.
• [gcp] CentOS 8 support: rewrote install_cloudinit.sh to avoid network issue at boot and install cloud-init only for the time needed. (issue #85)

Added

• [puppet] Added support for CentOS 8 when selecting Slurm yumrepo
• [puppet] Slurm 20 support: Added slurm_version variable to hieradata. It can be either 19 or 20.
• [puppet] Slurm 20 support: Added PlugStackConfig parameter to slurm.conf
• [puppet] Added slurm-perlapi package to profile::base::slurm
• [puppet] Added exec to initialize cvmfs default.local with consul-template.
• [puppet] Added a default node1 in slurm.conf when no slurmd has been registered yet in consul
• [puppet] Added a require on Epel yumrepo for package fail2ban-server
• [puppet] Added class profile::fail2ban::install
• [puppet] CentOS 8 support: Added dependency on puppet-epel to install epel yumrepo
• [puppet] CentOS 8 support: Enabled powertools repo
• [puppet] CentOS 8 support: Enabled idm:DL1 stream
• [puppet] CentOS 8 support: Added network-scripts package when os is CentOS 8
• [puppet] CentOS 8 support: Added munge_socket selinux policy to allow confined user to submit jobs
• [puppet] Added class profile::gpu::install
• [puppet] Added a requirement on epel yumrepo for singularity package.
• [puppet] Added a requirement for slurm exec create_account on slurm exec add_cluster
• [puppet] CentOS 8 support: added class profile::mail::server
• [puppet] Added a requirement on yumrepo epel to class jupyterhub in profile::jupyterhub::hub
• [puppet] Added support for Compute Canada Arbutus Cloud VGPUs

Magic Castle 7.2

Changed

• Reverted type of image variable from string to any because Azure image input is a map.

Magic Castle 7.1

Changed

• Bumped minimum requirements to 0.12.21 in all versions.tf files.
• [GCP] Fixed a typo in disk paths that prevented creation of project and scratch volume
• [GCP] Increased the root disk size in the example to 20GB. This is the new minimum for centos7 image.
• [puppet] Bumped most module versions to latest in Puppetfile
• [puppet] Bumped consul and consul-template version to latest available

Added

• Documentation on variables specific to the commercial cloud providers
• Documentation on hieradata
• Documentation on firewall_rules
• Description and types to all terraform variables