v1.14.0

[gardener-extension-provider-openstack]

🏃 Others

• [USER] The following images are updated: (gardener/gardener-extension-provider-openstack#189, @ialidzhikov)
  • docker.io/k8scloudprovider/cinder-csi-plugin: v1.18.0 -> v1.19.0
  • k8s.gcr.io/sig-storage/csi-provisioner: v2.0.0 -> v2.0.4
  • k8s.gcr.io/sig-storage/csi-attacher: v3.0.0 -> v3.0.2
  • k8s.gcr.io/sig-storage/csi-node-driver-registrar: v2.0.0 -> v2.0.1
• [USER] New dashboards which expose logs for cloud-controller-manager and csi-driver-controller. (#187, @vlvasilev)
• [OPERATOR] A bug that was preventing the deletion of machines with outdated credentials is now fixed. (#186, @vpnachev)
• [OPERATOR] Adds an additional option for the worker pools to specify a server group policy. If this option is set, a new server group with the defined policy will be created and nodes managed by the worker pool will become members. Allowed policy values can be defined in the provider's CloudProfile. (#170, @kon-angelo)

📰 Noteworthy

• [OPERATOR] The terraformer version has been upgraded to version v2.0.0. (#190, @dkistner)
• [OPERATOR] Logging in the infrastructure actuator has been improved to make it consistent in the logging format and more readable/helpful. (#186, @vpnachev)

[machine-controller-manager]

✨ New Features

• [OPERATOR] All machine classes do now support an optional .{spec.}credentialsSecretRef field in addition to today's .{spec.}secretRef field. If .{spec.}credentialsSecretRef is non-nil then the provider credentials will be read out of this secret. The user-data for the machine bring-up is still required to be part of the secret referenced by .{spec.}secretRef. (gardener/machine-controller-manager#578, @rfranzke)
• [OPERATOR] Some machine class secrets are now supporting alternative data keys: (gardener/machine-controller-manager#578, @rfranzke)
  • The machine class secret for Alicloud machines does now also accept the data keys accessKeyID and accessKeySecret as alternatives for today's keys.
  • The machine class secret for AWS machines does now also accept the data keys accessKeyID and secretAccessKey as alternatives for today's keys.
  • The machine class secret for Azure machines does now also accept the data keys clientID, clientSecret, subscriptionID and tenantID as alternatives for today's keys.
  • The machine class secret for GCP machines does now also accept the data key serviceaccount.json as alternatives for today's key.

🏃 Others

• [OPERATOR] Bumped AWS SDK version to v1.23.13 (gardener/machine-controller-manager#580, @zjj2wry)
• [OPERATOR] An issue causing panic when the encoded machine template hash length is less than expect limit is now fixed. (gardener/machine-controller-manager#575, @ialidzhikov)
• [OPERATOR] MCM will delete Azure machines even if the underlying resource group is already deleted. (gardener/machine-controller-manager#566, @dkistner)
• [OPERATOR] Set Machine Phase to Terminating before draining. (gardener/machine-controller-manager#564, @prashanth26)
• [OPERATOR] Update docker images to use gcr copy (gardener/machine-controller-manager#574, @prashanth26)
• [OPERATOR] Update docker image versions to golang:1.15.5 & alpine:3.12.1 (gardener/machine-controller-manager#574, @prashanth26)

📰 Noteworthy

• [OPERATOR] Machine force deletion computation is based on deletionTimestamp instead of LastUpdatedTimestamp. (gardener/machine-controller-manager#564, @prashanth26)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.14.0
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.14.0

v1.13.0

[gardener-extension-provider-openstack]

🏃 Others

• [OPERATOR] Golang version is updated to 1.15 and alpine image version is updated to 3.12.1. (#171, @kon-angelo)
• [OPERATOR] Adds priority class for extension pods to prevent preemption. (#166, @danielfoehrKn)
• [OPERATOR] The OpenStack extension now created OpenStack routers with enable_snat if the corresponding option .useSNAT is set to true in the provider's CloudProfileConfig. (#165, @timuthy)
• [OPERATOR] Added possibility to set nodeVolumeAttachLimit within the cloud profile. (#160, @mganter)
• [DEVELOPER] An issue causing make test to fail on macOS is now fixed. (#173, @ialidzhikov)
• [DEVELOPER] A new integration test for infrastructure creation and deletion has been added. (#154, @prashanth26)

📰 Noteworthy

• [OPERATOR] The infrastructure actuator is now injecting infrastructure credentials into the terraformer PodSpec via secret references instead of plain env var values. (#179, @timebertt)

[machine-controller-manager]

🏃 Others

• [USER] The default drainTimeout value has been updated from 12hours to 2hours. (gardener/machine-controller-manager#554, @prashanth26)
• [USER] OOT: Fixed regression with maxEvictRetries (gardener/machine-controller-manager#554, @prashanth26)
• [USER] Adds the ability to specify an already existing OpenStack Neutron network in the subnetID of an OpenStackMachineClass. MCM will deploy new machines into the given subnet by pre-allocating Neutron ports and pass them to the Nova server object. (gardener/machine-controller-manager#545, @MrBatschner)
• [USER] The machine-controller-manager supports now machines attached to Azure VirtualMachineScaleSet Orchestration Mode VM (VMO). (gardener/machine-controller-manager#519, @dkistner)
• [USER] Restored tag verification in the Azure driver to filter VMs/disks/NICs based on tags (gardener/machine-controller-manager#507, @zuzzas)
• [OPERATOR] An issue causing panic when the encoded machine template hash length is less than expect limit is now fixed. (gardener/machine-controller-manager#577, @AxiomSamarth)
• [OPERATOR] Set Machine Phase to Terminating before draining. (gardener/machine-controller-manager#564, @prashanth26)
• [OPERATOR] Allow migration to continue when ProviderMachineClass is missing but MachineClass with the same name as ProviderMachineClass is found. Updates Machine object references to the MachineClass. (gardener/machine-controller-manager#559, @prashanth26)
• [OPERATOR] Use cache-based listers to GET the machine-object while reconciling. (gardener/machine-controller-manager#558, @hardikdr)
• [OPERATOR] OOT: Enqueue machine only when node conditions have changed. (gardener/machine-controller-manager#557, @prashanth26)
• [OPERATOR] Adapted integration tests to handle possibly orphaned resources. (gardener/machine-controller-manager#550, @hardikdr)
• [OPERATOR] OOT: Fixes drain timeout issues on retires (gardener/machine-controller-manager#548, @prashanth26)
• [OPERATOR] NetworkUnavailable nodeCondition added to the example, some CNI will update this condition depending on the state of the CNI or the network availability. (gardener/machine-controller-manager#543, @rewiko)
• [OPERATOR] Added a more comprehensive set of events to trigger machine class reconciliations. (gardener/machine-controller-manager#531, @prashanth26)
• [OPERATOR] Finalizers are added by default for all machine class objects. (gardener/machine-controller-manager#531, @prashanth26)
• [OPERATOR] Bootstrap token injection now works in the new OOT Machine controller (gardener/machine-controller-manager#521, @zuzzas)
• [OPERATOR] Add support for ServerGroups in the Openstack driver. VMs can now be created in the ServerGroup specified in the respective MachineClass. (gardener/machine-controller-manager#511, @kon-angelo)
• [OPERATOR] Bugfix: Consider CSI PersistentVolumes during the eviction of Pods with PersistentVolumes. (gardener/machine-controller-manager#509, @ialidzhikov)
• [DEVELOPER] Adds a new phase CrashLoopBackOff that is set due to machine creation failures. (gardener/machine-controller-manager#525, @hardikdr)
• [DEVELOPER] The field availabilitySets in the AzureMachineClass is now deprecated in favour of the field machineSet, which allow to configure AvailabilitySets and VirtualMachineScaleSet Orchestration Mode VM (VMO). The field will be removed in the future. (gardener/machine-controller-manager#519, @dkistner)

📰 Noteworthy

• [USER] NetworkUnavailable node condition is also considered by default while considering the machine's to be unhealthy. (gardener/machine-controller-manager#543, @rewiko)
• [USER] AWS: Allows deletion of machines even on modify instance call failure (gardener/machine-controller-manager#515, @prashanth26)
• [OPERATOR] Machine force deletion computation is based on deletionTimestamp instead of LastUpdatedTimestamp. (gardener/machine-controller-manager#564, @prashanth26)
• [OPERATOR] OOT: Introduced a backoff in re-enqueuing machines on creation/deletion failures. Avoids throttling APIServer & provider calls. (gardener/machine-controller-manager#557, @prashanth26)
• [OPERATOR] Introduced a backoff in re-enqueuing machines on creation/deletion failures. Avoids throttling APIServer & provider calls. (gardener/machine-controller-manager#525, @hardikdr)

[terraformer]

🏃 Others

• [OPERATOR] Terraformer uses now the azurerm provider in version v2.36.0 (gardener/terraformer#54, @dkistner)
• [OPERATOR] Alicloud Terraform Provider version is updated to 1.103.0. (gardener/terraformer#50, @minchaow)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.13.0
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.13.0

v1.12.0

[gardener-extension-provider-openstack]

Action Required

• [OPERATOR] The openstack provider extension is incompatible with Gardener version > v1.10.0 (if feature flag MountHostCADirectories is enabled on the Gardenlet) for Openstack Shoots with certain Kubernetes versions (>= 1.17.x, 1.18.x, 1.19.x without CSI migration complete). Please consult the compatibility notes under /docs/compatibility.md (#147, @danielfoehrKn)

Improvements

• [USER] An issue causing kube-controller-manager to panic when upgrading an OpenStack cluster from v1.18 to v1.19 is now fixed. (#145, @ialidzhikov)
• [USER] An issue preventing csi-driver-node Pods to be created when Shoot specifies .spec.kubernetes.allowPrivilegedContainers=false is now fixed. (#143, @ialidzhikov)
• [USER] The CSI StorageClasses (with provisioner cinder.csi.openstack.org) do now also specify WaitForFirstConsumer for volumeBindingMode. (#140, @ialidzhikov)
• [OPERATOR] The following options can now be configured through the extension's Helm chart values charts/gardener-extension-provider-openstack/values.yaml: (#159, @timuthy)
  • Health check worker count
  • minAllowed values for VPA
• [OPERATOR] CSI sidecar containers timeout is now increased to 3m. (#158, @kayrus)
• [OPERATOR] An issue causing CSI PV to do not have set spec.csi.fsType is now fixed. The csi-provisioner is now started with --default-fstype=ext4 which is the default fstype to be used when there is no fstype specified in the StorageClass. (#142, @ialidzhikov)
• [OPERATOR] The Webhook ensurer does not remove or add the /etc/ssl directory for kube apiserver deployments any more. This is done by the Gardenlet for version >= 1.10.0. (#141, @danielfoehrKn)

[machine-controller-manager]

Most notable changes

• [USER] Support for Spot Instances is available in AWS driver. If the spotPrice is empty, price is automatically set to the on-demand price so that Spot instance can launch immediately. (gardener/machine-controller-manager#481, @zuzzas)
• [OPERATOR] Introduced a backoff in re-enqueuing machines on creation/deletion failures. Avoids throttling APIServer & provider calls. (gardener/machine-controller-manager#523, @hardikdr)
• [OPERATOR] RBAC policies have to be updated to allow updating of node/status resources. (gardener/machine-controller-manager#492, @guydaichs)
• [OPERATOR] New flag delete-migrated-machine-class is introduced. When set to true (defaulted to false), deletes any provider-specific machine class (e.g. AWSMachineClass) that has the machine.sapcloud.io/migrated annotation set on it. (gardener/machine-controller-manager#484, @prashanth26)
• [DEVELOPER] Added migration logic for moving from provider-specific machine class to generic machine classes in out of tree code path. On migration, the machine.sapcloud.io/migrated annotation set on the old machine class. (gardener/machine-controller-manager#484, @prashanth26)
• [DEVELOPER] The machine controller adds finalizer only when machine reference is present, deletes it otherwise. (gardener/machine-controller-manager#484, @prashanth26)

Improvements

• [USER] Retry when secret is referred by machineClass is missing (gardener/machine-controller-manager#495, @AxiomSamarth)
• [USER] Node condition is added to the status of terminating nodes indicating the termination start time and reason (Unhealthy|ScaleDown) (gardener/machine-controller-manager#492, @guydaichs)
• [OPERATOR] Added a more comprehensive set of events to trigger machine class reconciliations. (gardener/machine-controller-manager#532, @prashanth26)
• [OPERATOR] Finalizers are added by default for all machine class objects. (gardener/machine-controller-manager#532, @prashanth26)
• [OPERATOR] AWS: Allow deletion of VMs even on list image or modify instance failure (gardener/machine-controller-manager#516, @prashanth26)
• [OPERATOR] All nodes under machine deployments being rolled-out are annotated with cluster-autoscaler.kubernetes.io/scale-down-disabled: "True" during the period of rolling-update. (gardener/machine-controller-manager#496, @hardikdr)
• [OPERATOR] A new command line flag autoscaler-scaldown-annotation-during-rollout is introduced to disable annotating the nodes with cluster-autoscaler annotation cluster-autoscaler.kubernetes.io/scale-down-disabled during rollout. (gardener/machine-controller-manager#496, @hardikdr)
• [DEVELOPER] Adds a new phase CrashLoopBackOff that is set due to machine creation failures. (gardener/machine-controller-manager#523, @hardikdr)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.12.0
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.12.0

v1.11.4

[gardener-extension-provider-openstack]

Improvements

• [OPERATOR] CSI sidecar containers timeout is now increased to 3m. (f2b780d)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.11.4
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.11.4

v1.11.3

[gardener-extension-provider-openstack]

Improvements

• [USER] An issue causing kube-controller-manager to panic when upgrading an OpenStack cluster from v1.18 to v1.19 is now fixed. (2f9be52)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.11.3
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.11.3

v1.11.2

[gardener-extension-provider-openstack]

Improvements

• [USER] An issue preventing csi-driver-node Pods to be created when Shoot specifies .spec.kubernetes.allowPrivilegedContainers=false is now fixed. (88b2f69)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.11.2
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.11.2

v1.11.1

[gardener-extension-provider-openstack]

Improvements

• [OPERATOR] An issue causing CSI PV to do not have set spec.csi.fsType is now fixed. The csi-provisioner is now started with --default-fstype=ext4 which is the default fstype to be used when there is no fstype specified in the StorageClass. (c56fd7f)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.11.1
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.11.1

v1.11.0

[gardener-extension-provider-openstack]

Most notable changes

• [USER] The OpenStack extension does now support shoot clusters with Kubernetes version 1.19. You should consider the Kubernetes release notes before upgrading to 1.19. Please note that the OpenStack Cinder CSI driver will be used for 1.19 shoots. It is compatible with the legacy volume provisioners, however, you might want to update your storage classes and volume handling accordingly. Please find more information about CSI in the official Kubernetes documentation. (#135, @rfranzke)

Improvements

• [OPERATOR] The volumeBindingMode of the StorageClasses managed by Gardener is now switched to WaitForFirstConsumer. (#137, @ialidzhikov)

[terraformer]

Improvements

• [OPERATOR] terraform-provider-alicloud is now updated to 1.94.0. (gardener/terraformer#45, @minchaow)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.11.0
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.11.0

v1.10.0

[gardener-extension-provider-openstack]

Improvements

• [OPERATOR] The StorageClasses in the shoot cluster managed by Gardener are now re-created in case the update request failed due to changed immutable fields. (#130, @vpnachev)
• [OPERATOR] A PodDisruptionBudget for the validation server is now automatically deployed as part of its Helm chart if the replica count is larger than 1. (#127, @rfranzke)

[gardener]

Improvements

• [OPERATOR] The generic worker actuator now also reports failed machines from the corresponding machine deployment in case the shoot cluster is being hibernated. Earlier scale down issues during hibernation were not reported to users, e.g. if something was wrong with the configured cloud provider account and thus the machine deletion was denied. (gardener/gardener#2759, @timuthy)
• [OPERATOR] Kubernetes dependencies are now updated to v0.17.11. (gardener/gardener#2728, @ialidzhikov)
• [OPERATOR] The error code mapping has been extended to categorize certain common issues upfront and furnish them with error codes. (gardener/gardener#2702, @rfranzke)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.10.0
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.10.0

v1.9.0

[gardener-extension-provider-openstack]

Most notable changes

• [OPERATOR] The logging configuration has been adapted to cater with Loki which was introduced as part of gardener/gardener#2515. If an older version of this extension is used with a Gardener version >= v1.8 and the Logging feature gate is enabled then the fluent-bit matcher won't catch the log anymore (resulting in the logs being collected, but not nicely parsed and instead displayed in nested JSON). It is recommended update to at least this extension version when Gardener >= v1.8 is used and the Logging feature gate is enabled. (#115, @Kristian-ZH)
• [OPERATOR] Until now provider-openstack was maintaining a Terraform configuration which is both v0.12 and v0.11 compatible. The Terraform configuration is now adapted to the new Terraform language which makes it Terraform v0.11 incompatible. (#112, @ialidzhikov)

Improvements

• [USER] StorageClasses now allow for expansion of PVCs. (#119, @mvladev)
• [USER] An issue has been fixed that prevented the Worker reconciliation from succeeding for hibernated shoots. (#117, @rfranzke)
• [USER] The csi-node-driver is now auto-scaled by the VPA in case the Shoot sets .spec.kubernetes.verticalPodAutoscaler.enabled=true. (#109, @rfranzke)
• [USER] The floating pool subnet which a router should be attached to can now be specified. (#92, @dkistner)
• [OPERATOR] The default webhook server port is now changed to 10250. (#125, @stoyanr)
• [OPERATOR] Worker extension allows configuring following parameters on machine-deployment: drainTimeout, creationTimeout, healthTimeout, maxEvictRetries, nodeConditions. (#124, @hardikdr)
• [OPERATOR] A bug has been fixed, that caused the Infrastructure deletion to be blocked forever in case there are already running terraformer Pods. (#113, @timebertt)

[machine-controller-manager]

Improvements

• [OPERATOR] Avoids race between secret finalizer creation/deletion between in-tree & OOT controllers (gardener/machine-controller-manager#487, @prashanth26)
• [OPERATOR] Enable finer machine configurations per MachineDeployment/MachineSet/Machines basis. Exposed configurations: MachineDrainTimeout, MachinHealthTimeout, MachineCreationTimeout, MaxEvictRetries, NodeConditions. (gardener/machine-controller-manager#478, @hardikdr)
• [OPERATOR] Added an option to use configDrive in the OpenStackMachineClass (gardener/machine-controller-manager#457, @zuzzas)
• [DEVELOPER] Increased default concurrent worker syncs from 5 --> 10 (gardener/machine-controller-manager#491, @prashanth26)
• [DEVELOPER] Bugfix: Drain machines with only a valid node (name) (gardener/machine-controller-manager#480, @prashanth26)

[terraformer]

Improvements

• [OPERATOR] terraform-provider-aws is now updated to 2.68.0. (gardener/terraformer#42, @ialidzhikov)
• [OPERATOR] terraform-provider-google and terraform-provider-google-beta are now updated to 3.27.0. (gardener/terraformer#42, @ialidzhikov)

Docker Images

gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.9.0
gardener-extension-validator-openstack: eu.gcr.io/gardener-project/gardener/extensions/validator-openstack:v1.9.0