Magic Castle 11.3

Added

• Added documentation on how to use Terraform Cloud
• Added a trigger when uploading SSL certificates
• Added documentation on how to regenerate SSL certificates
• Added support for Rocky Linux and AlmaLinux
• [puppet] Added X11 forwarding enabling in Slurm config

Changed

• Improved various sections of the documentation
• Updated puppet-agent to 6.16.0
• Updated puppet-server to 6.23.0
• [puppet] Updated puppet-jupyterhub to v3.8.8
• [cloud-init] Replaced deprecated ssh config algorithm selection parameter
• [puppet] Replaced network-scripts by NetworkManager
• [puppet] Fixed fail2ban config when not using CentOS
• [puppet] Fixed powertools enabling when not using CentOS

Removed

• [puppet] Removed dhclient package when os major release is 8

Magic Castle 11.2

This release introduces the ability for Puppet to be event-driven instead of being apply every 30 minutes. The event is handled by Consul which triggers a reload of the puppet agent service. This event is currently triggered by Terraform remote-exec ressource when terraform_data.yaml or hieradata.yaml are modified.

Added

• Added a Consul event that can trigger the reload of Puppet agent configuration
• Added the triggering of the consul puppet event when hieradata or terraform_data.yaml
  is changed after a terraform apply.
• [puppet] Added the user sudoer_username and its authorized_keys to profile::base.

Changed

• SSH public keys can now be added to public_keys after the cluster is built,
  without rebuilding all instances.
• [cloud-init] Changes to cloud-init file are ignored once the instances are created
• [cloud-init] Moved installation of puppet-agent rpm before puppet-server
• [cloud-init] Moved bootstrapping of consul server in puppet-magic_castle's bootstrap.sh
• [puppet] Bumped puppet-jupyterhub to v3.8.6
• [puppet] Fixed workshop class for guest accounts

Removed

• [puppet] Globus Connect Server V5 class

Magic Castle 11.1

Added

• Support for spot instances in AWS, Azure and Google Cloud
• GitHub actions to lint documentation
• Advanced example demonstrating how to create an ELK cluster
• Advanced example demonstrating how to create a kubernetes cluster
• Advanced example demonstrating how to create an Apache Spark cluster
• [cloud-init] Check for the presence of bootstrap.sh in the puppet environment

Changed

• Fixed issue with Google Cloud DNS refering to CloudFlare (PR #167 @consideRatio)
• Fixed documentation (PR #169 @consideRatio)
• Fixed var.volumes validation - allowing the variable to be an empty map
• Fixed terraform_facts.yaml format for cloud provider and region
• Reintroduced nouveau driver blacklisting in cloud-init
• Improved provider specific READMEs
• Reverted flavors and image in openstack example to Arbutus instead of Beluga Cloud
• [AWS] Updated AMI value in the example
• [puppet] Fixed init of /etc/cvmfs/default.local with consul-template

Magic Castle 11.0

Refer to the migration guide to know how to deal with
the changes introduced in this release.

Added

• Add volumes variable structure to define volumes that will be attached to instances with matching tags.
• Reference design documentation
• Added straightforward password replacement procedur (PR #152 @plstonge)
• Added advice on user management when not creating users (PR #153 @ocaisa)
• Added freeipa admin username and password to the output (PR #154 @ocaisa)
• Added a basic puppet cluster example
• Added a basic lustre cluster setup example

Changed

• Changed instances variable structure to add tags
• Updated developper documentation
• Updated main documentation
• Merged puppet agent and puppet server cloud-init YAML file in a single file
• Combined some of the DNS module inputs to in a single variable
• Defined a default value for nb_users (0)
• Changed format of terraform_data.yaml to no longer depends on puppet-magic_castle
• Moved resources related to networking in network.tf for each cloud provider
• Normalized most resource names across providers
• Changed os_floating_ips input type from list to map
• [puppet] Updated EESSI CVMFS config version
• [puppet] Changed how devices for NFS server are identified using facts instead of glob
• [puppet] Bumped puppet-jupyterhub version to v3.8.2
• [puppet] Fixed gpu profile for pci passthrough providers
• [puppet] Replaced site.pp roles based on hostnames by roles based on tags

Removed

• Removed fetching of terraform_data.yaml.tmpl from config_git_url repo
• Removed storage variable, replaced by volumes.
• Removed Azure variable managed_disk_type
• Removed common variable root_disk_size

Magic Castle 10.2

Added

• Added GitHub actions workflows for validation and release
• [puppet] Added GitHub actions workflows for validation

Changed

• [puppet] Fixed the logic in mkproject.sh to avoid empty GID

Removed

• Removed Travis CI yaml
• [puppet] Removed Travis CI yaml

Magic Castle 10.1

Added

• [puppet] Added log rotation rules for Slurm daemons
• [puppet] Added configuration of Prometheus retention time and storage

Changed

• Updated documentation
• [puppet] Changed /localscratch SELinux label from default_t to tmp_t
• [puppet] Bumped puppet-jupyterhub version to 3.7.3
• [puppet] Refactored mkproject daemon to allow removal of users from Slurm account when
  removing them from the associated POSIX group in FreeIPA.

Removed

• Removed possibility of having underscores in cluster_name

Magic Castle 10.0

Added

• Added config_git_url and config_version to all examples
• Added a DNS module that produce a text file that can be imported in DNS zone
  for providers that are currently not supported by MC.
• [puppet] Added cloud provider and region to puppet facts
• [puppet] Added failmode option to Duo
• [puppet] Added fallback to nvidia-smi for GPU driver version

Changed

• Bumped Terraform minimum version to 0.14.5
• Fixed Acme provider name (issue #)
• Renamed puppetenv_git to config_git_url
• Renamed puppetenv_rev to config_version
• Made config_git_url and config_version mandatory.
• Improved documenation
• [puppet] Reverted "Remove export of security labels in nfs"
• [puppet] Fixed label issues with home, project and scratch root folder (puppet-magic_castle issue #96)
• [puppet] Generalized VGPU driver installation to support other clouds
• [puppet] Changed default Slurm version from 19.05 to 20.11
• [puppet] Fix guest account username zero-padding when nb_accounts < 10

Magic Castle 9.3

Added

• Added configuration of NFS server running versions with nfs.conf

Changed

• Excluded slurm from EPEL yum repo

Magic Castle 9.2

Added

• Added support for multiple software stacks including Compute Canada and EESSI (PR #124)
• [azure] Added support for configuration of image using image_id
• [puppet] Added automatic Slurm node weight computation through consul2slurm
• [puppet] Added a wrapper for ipa-client-install to make nsupdate failure fatal (puppet-magic_castle issue #79)
• [puppet] Added definition of bind_addr parameter in consul config (puppet-magic_castle issue #83)

Changed

• Fixed cluster_name validation and documentation
• Simplified version locking in release.sh
• [puppet] Changed 'ensure' of package globus-repo to 'latest'
• [puppet] Changed z-00-rsnt_arch consul-template to produce a single value
• [puppet] Stopped installation of CUDA when there is no nvidia device
• [puppet] Fixed PowerTools repo filename for CentOS Linux 8
• [puppet] Bumped puppet-jupyterhub version to 3.7.2

Removed

• Removed version from the provider config block
• [azure] Remove version set from azure provider

Magic Castle 9.1

Added

• Added Terraform variable verification for cluster_name and guest_passwd
• Added mokey subdomain to the DNS record generator list
• Added documentation on creating account with Mokey
• [puppet] Integrated UBCCR's project Mokey to allow users to create and manage their account on the cluster using a web portal
• [puppet] Added two daemons mkhome and mkproject that watch slapd log output for new users and groups and create
  home, scratch and project directory plus Slurm account automatically
• [puppet] Added Magic Castle custom login template to JupyterHub, which include a new Create account link when user signup is allowed
• [puppet] Added classes profile::accounts and profile::accounts::guests to handle account creation

Changed

• [puppet] Updated puppet-jupyterhub version to 3.7.1
• [puppet] Updated kinit_wrapper logic to avoid issue with multiple process using the same Kerberos cached credentials

Removed

• [puppet] Remove class profile::freeipa::guest_accounts replaced by profile::accounts::guests