Release Notes v1.84
23KE release notes and upgrade guide
Since 23technologies/23ke was moved to yakecloud/yake, later 1.84.x releases are no longer made available as buckets or oci images, but only as git tags. If you're not already using a GitRepository source, you'll need to switch to one.
-
Create new GitRepository source named
23ke.cat <<EOF | kubectl apply -f -apiVersion: source.toolkit.fluxcd.io/v1kind: GitRepositorymetadata:name: yakenamespace: flux-systemspec:interval: 1mref:tag: v1.84.x-y # add latest version heretimeout: 60surl: https://github.com/yakecloud/yakeEOF -
Update the main
23keKustomization's sourceRef tospec:sourceRef:kind: GitRepositoryname: 23ke
Related upstream release notes / changelogs
Update external-dns-management to 0.15.10
[gardener/external-dns-management]
✨ New Features
[USER]Therfc2136provider for authorive DNS servers supporting DNS Update RFC2136 has been added. by @MartinWeindel [#331]
🐛 Bug Fixes
[OPERATOR]Fix reading IPv6 records for azure-dns and azure-private-dns providers. by @MartinWeindel [#330]
🏃 Others
[USER]3072 bit RSA keys are now used in order to generate TLS certificates. by @dimityrmirchev [#326][OPERATOR]Bumps golang from 1.21.2 to 1.21.3. by @dependabot[bot] [#324]
Docker Images
dns-controller-manager: eu.gcr.io/gardener-project/dns-controller-manager:v0.15.10
Update shoot-dns-service to 1.40.0
[gardener/gardener-extension-shoot-dns-service]
✨ New Features
[USER]shoot-dns-serviceextension now supports Shoot Force Deletion. by @dependabot[bot] [#255]
🏃 Others
[OPERATOR]Bumps github.com/gardener/gardener from 1.80.1 to 1.82.1. by @dependabot[bot] [#255][OPERATOR]Bump github.com/gardener/gardener from 1.82.1 to 1.83.0. by @dependabot[bot] [#257]
[gardener/external-dns-management]
✨ New Features
[USER]Therfc2136provider for authorive DNS servers supporting DNS Update RFC2136 has been added. by @MartinWeindel [gardener/external-dns-management#331]
🐛 Bug Fixes
[OPERATOR]Fix reading IPv6 records for azure-dns and azure-private-dns providers. by @MartinWeindel [gardener/external-dns-management#330]
🏃 Others
[USER]3072 bit RSA keys are now used in order to generate TLS certificates. by @dimityrmirchev [gardener/external-dns-management#326][OPERATOR]Bumps golang from 1.21.2 to 1.21.3. by @dependabot[bot] [gardener/external-dns-management#324]
Docker Images
gardener-extension-admission-shoot-dns-service: eu.gcr.io/gardener-project/gardener/extensions/admission-shoot-dns-service:v1.40.0
gardener-extension-shoot-dns-service: eu.gcr.io/gardener-project/gardener/extensions/shoot-dns-service:v1.40.0
Update provider-aws to 1.49.0
[gardener/gardener-extension-provider-aws]
⚠️ Breaking Changes
[OPERATOR]provider-awsno longer supports Shoots or Seeds with Кubernetes version < 1.24. by @shafeeqes [#802]
📰 Noteworthy
[DEVELOPER]Remove dependency to specific calico and cilium versions. by @axel7born [#807]
✨ New Features
[USER]provider-awsextension now supports Shoot Force Deletion. by @shafeeqes [#812][USER]The provider-aws extension does now support shoot clusters with Kubernetes version 1.28. You should consider the Kubernetes release notes before upgrading to 1.28. by @oliver-goetz [#813]
🏃 Others
[OPERATOR]updated image aws-load-balancer-controller ->v2.6.1by @kon-angelo [#810][OPERATOR]Add readiness check for snapshot validation webhook. by @kon-angelo [#819][OPERATOR]updated image aws-ebs-csi-driver ->v1.23.0by @kon-angelo [#810][OPERATOR]Update external-snapshotter to v6.3.1 by @bd3lage [#817][OPERATOR]updated image csi-attacher ->v4.4.0by @kon-angelo [#810][OPERATOR]updated image csi-provisioner ->v3.6.0by @kon-angelo [#810][OPERATOR]The following dependency is updated:- github.com/gardener/gardener: v1.77.5 -> v1.80.3
- k8s.io/* : v0.26.4 -> v0.28.2
- sigs.k8s.io/controller-runtime: v0.14.6-> v0.16.2 by @shafeeqes [#814]
[OPERATOR]The registry of the aws-ebs-csi-driver image is switched from ECR (public.ecr.aws) toregistry.k8s.iobecause the ECR does not support image pulls over IPv6. by @DockToFuture [#820][OPERATOR]updated image csi-resizer ->v1.9.0by @kon-angelo [#810][OPERATOR]updated image livenessprobe ->v2.11.0by @kon-angelo [#810][OPERATOR]Theaws-load-balancer-controllerdeployment now uses an AWS credentials file for authentication. by @AleksandarSavchev [#804][DEVELOPER]All chart deployments are now usingembed.FSinstead of the filesystem. by @kon-angelo [#809]
[gardener/machine-controller-manager]
🐛 Bug Fixes
[OPERATOR]An issue causing nil pointer panic on scaleup of the machinedeployment along with trigger of rolling update, is fixed by @acumino [gardener/machine-controller-manager#814][OPERATOR]Force drain and delete volume attachments for nodes un-healthy due toReadOnlyFileSystemandNotReadyfor too long by @elankath [gardener/machine-controller-manager#839][OPERATOR]IncludedUnavailableReplicasin determining if a machine deployment status update is needed by @rishabh-11 [gardener/machine-controller-manager#833][USER]An edge case where outdated DesiredReplicas annotation blocked a rolling update is fixed. by @rishabh-11 [gardener/machine-controller-manager#821]
🏃 Others
[OPERATOR]Makefile targets have changed: Introduced gardener-setup, gardener-restore, gardener-local-mcm-up, non-gardener-setup, non-gardener-restore, non-gardener-local-mcm-up. Users can also directly use the scripts which are used by these makefile targets. by @unmarshall [gardener/machine-controller-manager#852][OPERATOR]Updated to go v1.20.5 by @rishabh-11 [gardener/machine-controller-manager#827][OPERATOR]New metrics introduced:- api_request_duration_seconds -> tracks time taken for successful invocation of provider APIs. This metric can be filtered by provider and service.
- driver_request_duration_seconds -> tracks total time taken to successfully complete driver method invocation. This metric can be filtered by provider and operation.
- driver_requests_failed_total -> records total number of failed driver API requests. This metric can be filtered by provider, operations and error_code. by @unmarshall [gardener/machine-controller-manager#842]
[OPERATOR]AddederrorCodefield in theLastOperationstruct. This should be implemented only for theCreateMachinecall in thetriggerCreationFlow. This field will be utilized by Cluster autoscaler to do early backoff by @rishabh-11 [gardener/machine-controller-manager#851][OPERATOR]Added a new metric that will allow to get the number of stale (due to unhealthiness) machines that are getting terminated by @jguipi [gardener/machine-controller-manager#808][DEVELOPER]status.Status now captures underline cause, allowing consumers to introspect the error returned by the provider. WrapError() function could be used to wrap the provider error by @unmarshall [gardener/machine-controller-manager#842][DEVELOPER]Bumpk8s.io/*deps to v0.27.2 by @afritzler [gardener/machine-controller-manager#820][DEVELOPER]A new make target is introduced to add license headers. by @unmarshall [gardener/machine-controller-manager#845][DEVELOPER]Removed dead metrics code and refactored the remaining metrics code by @himanshu-kun [gardener/machine-controller-manager#823]
[gardener/machine-controller-manager-provider-aws]
🐛 Bug Fixes
[OPERATOR]Logs for confirming eventual consistency are exposed. This helps to know if such check was successful or not. by @himanshu-kun [gardener/machine-controller-manager-provider-aws#134]
🏃 Others
[OPERATOR]MCM status codeResourceExhaustedis now utilized in mcm-provider-aws. by @rishabh-11 [gardener/machine-controller-manager-provider-aws#129]
Docker Images
gardener-extension-admission-aws: eu.gcr.io/gardener-project/gardener/extensions/admission-aws:v1.49.0
gardener-extension-provider-aws: eu.gcr.io/gardener-project/gardener/extensions/provider-aws:v1.49.0
Update provider-gcp to 1.33.0
[gardener/machine-controller-manager]
🐛 Bug Fixes
[OPERATOR]Force drain and delete volume attachments for nodes un-healthy due toReadOnlyFileSystemandNotReadyfor too long by @elankath [gardener/machine-controller-manager#839][OPERATOR]IncludedUnavailableReplicasin determining if a machine deployment status update is needed by @rishabh-11 [gardener/machine-controller-manager#833][OPERATOR]An issue causing nil pointer panic on scaleup of the machinedeployment along with trigger of rolling update, is fixed by @acumino [gardener/machine-controller-manager#814][USER]An edge case where outdated DesiredReplicas annotation blocked a rolling update is fixed. by @rishabh-11 [gardener/machine-controller-manager#821]
🏃 Others
[OPERATOR]New metrics introduced:- api_request_duration_seconds -> tracks time taken for successful invocation of provider APIs. This metric can be filtered by provider and service.
- driver_request_duration_seconds -> tracks total time taken to successfully complete driver method invocation. This metric can be filtered by provider and operation.
- driver_requests_failed_total -> records total number of failed driver API requests. This metric can be filtered by provider, operations and error_code. by @unmarshall [gardener/machine-controller-manager#842]
[OPERATOR]Makefile targets have changed: Introduced gardener-setup, gardener-restore, gardener-local-mcm-up, non-gardener-setup, non-gardener-restore, non-gardener-local-mcm-up. Users can also directly use the scripts which are used by these makefile targets. by @unmarshall [gardener/machine-controller-manager#852][OPERATOR]AddederrorCodefield in theLastOperationstruct. This should be implemented only for theCreateMachinecall in thetriggerCreationFlow. This field will be utilized by Cluster autoscaler to do early backoff by @rishabh-11 [gardener/machine-controller-manager#851][OPERATOR]Updated to go v1.20.5 by @rishabh-11 [gardener/machine-controller-manager#827][OPERATOR]Added a new metric that will allow to get the number of stale (due to unhealthiness) machines that are getting terminated by @jguipi [gardener/machine-controller-manager#808][DEVELOPER]Bumpk8s.io/*deps to v0.27.2 by @afritzler [gardener/machine-controller-manager#820][DEVELOPER]status.Status now captures underline cause, allowing consumers to introspect the error returned by the provider. WrapError() function could be used to wrap the provider error by @unmarshall [gardener/machine-controller-manager#842][DEVELOPER]Removed dead metrics code and refactored the remaining metrics code by @himanshu-kun [gardener/machine-controller-manager#823][DEVELOPER]A new make target is introduced to add license headers. by @unmarshall [gardener/machine-controller-manager#845]
[gardener/machine-controller-manager-provider-gcp]
🏃 Others
[USER]MCM status codeResourceExhaustedis now utilized in mcm-provider-gcp. Currently thecompute APIerrors covered are:- quota exceeded in zone
- insufficient resource in zone
- unavailable machinetype in zone by @himanshu-kun [gardener/machine-controller-manager-provider-gcp#92]
[gardener/gardener-extension-provider-gcp]
⚠️ Breaking Changes
[OPERATOR]provider-gcpno longer supports Shoots or Seeds with Кubernetes version < 1.24. by @shafeeqes [#648]
📰 Noteworthy
[DEVELOPER]Remove dependency to specific calico and cilium versions. by @axel7born [#651]
✨ New Features
[USER]The provider-gcp extension does now support shoot clusters with Kubernetes version 1.28. You should consider the Kubernetes release notes before upgrading to 1.28. by @oliver-goetz [#652][USER]provider-gcpextension now supports Shoot Force Deletion for more details.). by @shafeeqes [#650]
🏃 Others
[OPERATOR]updated image csi-resizer ->v1.9.1by @kon-angelo [#656][OPERATOR]Add readiness check for snapshot-validation-webhook by @kon-angelo [#657][OPERATOR]The following golang dependencies have been upgraded :gardener/gardener:v1.81.0->v1.81.6k8s.io/*:v0.28.2->v0.28.3sigs.k8s.io/controller-runtime:v0.16.2->v0.16.3by @shafeeqes [#659]
[OPERATOR]updated image csi-provisioner ->v3.6.1by @kon-angelo [#656][OPERATOR]updated image snapshot-controller ->v6.3.1by @kon-angelo [#656][OPERATOR]updated image livenessprobe ->v2.11.0by @kon-angelo [#656][OPERATOR]updated image registrar ->v2.9.0by @kon-angelo [#656][OPERATOR]The following image is updated:- registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver: v1.9.7 -> v1.9.9 by @ialidzhikov [#640]
[OPERATOR]updated image gcp-compute-persistent-disk-csi-driver ->v1.11.1by @MartinWeindel [#658][OPERATOR]The following golang dependencies have been upgraded :gardener/gardenertov1.80.3k8s.io/*tov0.27.5sigs.k8s.io/controller-runtimetov0.16.2by @ary1992 [#646]
[OPERATOR]updated image gcp-compute-persistent-disk-csi-driver ->v1.12.2by @kon-angelo [#656][OPERATOR]updated image csi-attacher ->v4.4.1by @kon-angelo [#656]
Docker Images
gardener-extension-admission-gcp: eu.gcr.io/gardener-project/gardener/extensions/admission-gcp:v1.33.0
gardener-extension-provider-gcp: eu.gcr.io/gardener-project/gardener/extensions/provider-gcp:v1.33.0
Update provider-aws to 1.50.0
[gardener/gardener-extension-provider-aws]
🏃 Others
[OPERATOR]The following golang dependencies have been upgraded :gardener/gardener:v1.81.0->v1.81.6k8s.io/*:v0.28.2->v0.28.3sigs.k8s.io/controller-runtime:v0.16.2->v0.16.3by @shafeeqes [#823]
Docker Images
gardener-extension-admission-aws: eu.gcr.io/gardener-project/gardener/extensions/admission-aws:v1.50.0
gardener-extension-provider-aws: eu.gcr.io/gardener-project/gardener/extensions/provider-aws:v1.50.0
Update provider-azure to 1.39.1
[gardener/machine-controller-manager]
🐛 Bug Fixes
[OPERATOR]Force drain and delete volume attachments for nodes un-healthy due toReadOnlyFileSystemandNotReadyfor too long by @elankath [gardener/machine-controller-manager#839][OPERATOR]IncludedUnavailableReplicasin determining if a machine deployment status update is needed by @rishabh-11 [gardener/machine-controller-manager#833][OPERATOR]Removesnode.machine.sapcloud.io/not-managed-by-mcmannotation from nodes managed by the MCM. by @gardener-robot-ci-2 [gardener/machine-controller-manager#866][OPERATOR]An issue causing nil pointer panic on scaleup of the machinedeployment along with trigger of rolling update, is fixed by @acumino [gardener/machine-controller-manager#814][USER]An edge case where outdated DesiredReplicas annotation blocked a rolling update is fixed. by @rishabh-11 [gardener/machine-controller-manager#821]
🏃 Others
[DEVELOPER]Bumpk8s.io/*deps to v0.27.2 by @afritzler [gardener/machine-controller-manager#820][DEVELOPER]A new make target is introduced to add license headers. by @unmarshall [gardener/machine-controller-manager#845][DEVELOPER]status.Status now captures underline cause, allowing consumers to introspect the error returned by the provider. WrapError() function could be used to wrap the provider error by @unmarshall [gardener/machine-controller-manager#842][DEVELOPER]Removed dead metrics code and refactored the remaining metrics code by @himanshu-kun [gardener/machine-controller-manager#823][OPERATOR]AddederrorCodefield in theLastOperationstruct. This should be implemented only for theCreateMachinecall in thetriggerCreationFlow. This field will be utilized by Cluster autoscaler to do early backoff by @rishabh-11 [gardener/machine-controller-manager#851][OPERATOR]Makefile targets have changed: Introduced gardener-setup, gardener-restore, gardener-local-mcm-up, non-gardener-setup, non-gardener-restore, non-gardener-local-mcm-up. Users can also directly use the scripts which are used by these makefile targets. by @unmarshall [gardener/machine-controller-manager#852][OPERATOR]Added a new metric that will allow to get the number of stale (due to unhealthiness) machines that are getting terminated by @jguipi [gardener/machine-controller-manager#808][OPERATOR]New metrics introduced:- api_request_duration_seconds -> tracks time taken for successful invocation of provider APIs. This metric can be filtered by provider and service.
- driver_request_duration_seconds -> tracks total time taken to successfully complete driver method invocation. This metric can be filtered by provider and operation.
- driver_requests_failed_total -> records total number of failed driver API requests. This metric can be filtered by provider, operations and error_code. by @unmarshall [gardener/machine-controller-manager#842]
[OPERATOR]The defaultmachine-safety-orphan-vms-periodhas been reduced from 30m to 15m. by @gardener-robot-ci-2 [gardener/machine-controller-manager#866][OPERATOR]Updated to go v1.20.5 by @rishabh-11 [gardener/machine-controller-manager#827]
Docker Images
gardener-extension-admission-azure: eu.gcr.io/gardener-project/gardener/extensions/admission-azure:v1.39.1
gardener-extension-provider-azure: eu.gcr.io/gardener-project/gardener/extensions/provider-azure:v1.39.1
Update provider-alicloud to 1.49.1
[gardener/gardener-extension-provider-alicloud]
🏃 Others
[OPERATOR]Removesnode.machine.sapcloud.io/not-managed-by-mcmannotation from nodes managed by the MCM. by @kevin-lacoo [#663][OPERATOR]The defaultmachine-safety-orphan-vms-periodhas been reduced from 30m to 15m. by @kevin-lacoo [#663]
Docker Images
gardener-extension-admission-alicloud: eu.gcr.io/gardener-project/gardener/extensions/admission-alicloud:v1.49.1
gardener-extension-provider-alicloud: eu.gcr.io/gardener-project/gardener/extensions/provider-alicloud:v1.49.1
Update provider-aws to 1.50.1
[gardener/machine-controller-manager]
🐛 Bug Fixes
[OPERATOR]Removesnode.machine.sapcloud.io/not-managed-by-mcmannotation from nodes managed by the MCM. by @gardener-robot-ci-2 [gardener/machine-controller-manager#866]
🏃 Others
[OPERATOR]The defaultmachine-safety-orphan-vms-periodhas been reduced from 30m to 15m. by @gardener-robot-ci-2 [gardener/machine-controller-manager#866]
Docker Images
gardener-extension-admission-aws: eu.gcr.io/gardener-project/gardener/extensions/admission-aws:v1.50.1
gardener-extension-provider-aws: eu.gcr.io/gardener-project/gardener/extensions/provider-aws:v1.50.1
Update provider-azure to 1.39.2
[gardener/gardener-extension-provider-azure]
🐛 Bug Fixes
[USER]Fix failing validation when overlay config is empty. by @axel7born [#753]
Docker Images
gardener-extension-admission-azure: eu.gcr.io/gardener-project/gardener/extensions/admission-azure:v1.39.2
gardener-extension-provider-azure: eu.gcr.io/gardener-project/gardener/extensions/provider-azure:v1.39.2
Update provider-gcp to 1.33.1
[gardener/machine-controller-manager]
🐛 Bug Fixes
[OPERATOR]Removesnode.machine.sapcloud.io/not-managed-by-mcmannotation from nodes managed by the MCM. by @gardener-robot-ci-3 [gardener/machine-controller-manager#866]
🏃 Others
[OPERATOR]The defaultmachine-safety-orphan-vms-periodhas been reduced from 30m to 15m. by @gardener-robot-ci-3 [gardener/machine-controller-manager#866]
Docker Images
gardener-extension-admission-gcp: eu.gcr.io/gardener-project/gardener/extensions/admission-gcp:v1.33.1
gardener-extension-provider-gcp: eu.gcr.io/gardener-project/gardener/extensions/provider-gcp:v1.33.1
Update gardener-controlplane to 1.83.1
[gardener/gardener]
🐛 Bug Fixes
[OPERATOR]machine-controller-manager RBAC in the Shoot cluster does now allow MCM to delete volumeattachments. MCM provider extensions vendoring machine-controller-manager >= v0.50.0 (ref https://github.com/gardener/machine-controller-manager/pull/839) need to delete volumeattachments. by @ialidzhikov [#8774]
Docker Images
admission-controller: eu.gcr.io/gardener-project/gardener/admission-controller:v1.83.1
apiserver: eu.gcr.io/gardener-project/gardener/apiserver:v1.83.1
controller-manager: eu.gcr.io/gardener-project/gardener/controller-manager:v1.83.1
gardenlet: eu.gcr.io/gardener-project/gardener/gardenlet:v1.83.1
node-agent: eu.gcr.io/gardener-project/gardener/node-agent:v1.83.1
operator: eu.gcr.io/gardener-project/gardener/operator:v1.83.1
resource-manager: eu.gcr.io/gardener-project/gardener/resource-manager:v1.83.1
scheduler: eu.gcr.io/gardener-project/gardener/scheduler:v1.83.1
Update gardener-controlplane to 1.83.1
[gardener/gardener]
🐛 Bug Fixes
[OPERATOR]machine-controller-manager RBAC in the Shoot cluster does now allow MCM to delete volumeattachments. MCM provider extensions vendoring machine-controller-manager >= v0.50.0 (ref https://github.com/gardener/machine-controller-manager/pull/839) need to delete volumeattachments. by @ialidzhikov [#8774]
Docker Images
admission-controller: eu.gcr.io/gardener-project/gardener/admission-controller:v1.83.1
apiserver: eu.gcr.io/gardener-project/gardener/apiserver:v1.83.1
controller-manager: eu.gcr.io/gardener-project/gardener/controller-manager:v1.83.1
gardenlet: eu.gcr.io/gardener-project/gardener/gardenlet:v1.83.1
node-agent: eu.gcr.io/gardener-project/gardener/node-agent:v1.83.1
operator: eu.gcr.io/gardener-project/gardener/operator:v1.83.1
resource-manager: eu.gcr.io/gardener-project/gardener/resource-manager:v1.83.1
scheduler: eu.gcr.io/gardener-project/gardener/scheduler:v1.83.1
Update gardenlet to 1.83.1
[gardener/gardener]
🐛 Bug Fixes
[OPERATOR]machine-controller-manager RBAC in the Shoot cluster does now allow MCM to delete volumeattachments. MCM provider extensions vendoring machine-controller-manager >= v0.50.0 (ref https://github.com/gardener/machine-controller-manager/pull/839) need to delete volumeattachments. by @ialidzhikov [#8774]
Docker Images
admission-controller: eu.gcr.io/gardener-project/gardener/admission-controller:v1.83.1
apiserver: eu.gcr.io/gardener-project/gardener/apiserver:v1.83.1
controller-manager: eu.gcr.io/gardener-project/gardener/controller-manager:v1.83.1
gardenlet: eu.gcr.io/gardener-project/gardener/gardenlet:v1.83.1
node-agent: eu.gcr.io/gardener-project/gardener/node-agent:v1.83.1
operator: eu.gcr.io/gardener-project/gardener/operator:v1.83.1
resource-manager: eu.gcr.io/gardener-project/gardener/resource-manager:v1.83.1
scheduler: eu.gcr.io/gardener-project/gardener/scheduler:v1.83.1
Update provider-openstack to 1.38.2
[gardener/gardener-extension-provider-openstack]
🐛 Bug Fixes
[OPERATOR]Fix a crash, when a shoot that is updated has an empty overlay config. by @axel7born [#695]
Docker Images
gardener-extension-admission-openstack: eu.gcr.io/gardener-project/gardener/extensions/admission-openstack:v1.38.2
gardener-extension-provider-openstack: eu.gcr.io/gardener-project/gardener/extensions/provider-openstack:v1.38.2
Update cloudprofiles to 0.6.8
Update cloudprofiles to 0.6.9
Update gardener-controlplane to 1.84.0
[gardener/machine-controller-manager]
🐛 Bug Fixes
[OPERATOR]Removesnode.machine.sapcloud.io/not-managed-by-mcmannotation from nodes managed by the MCM. by @elankath [gardener/machine-controller-manager#866]
🏃 Others
[OPERATOR]The defaultmachine-safety-orphan-vms-periodhas been reduced from 30m to 15m. by @elankath [gardener/machine-controller-manager#866]
[gardener/gardener]
⚠️ Breaking Changes
[DEVELOPER]NewSecrets referenced inManagedResources will no longer be patched with the labelresources.gardener.cloud/garbage-collectable-referencewhen theManagedResourceis reconciled.Secrets which already exist in theManagedResourcespecification will still be patched if necessary. by @dimityrmirchev [#8788][OPERATOR]⚠️ The deprecated fieldsspec.settings.dependencyWatchdog.endpointandspec.settings.dependencyWatchdog.probehave been removed from the Seed API. Please check yourSeeds and remove any usage before upgrading to this Gardener version. by @himanshu-kun [#8747][USER]A validation rule was added that forbids changing the primary DNS provider in.spec.dns.providersas soon as the shoot was scheduled. by @timuthy [#8761]
📰 Noteworthy
[DEVELOPER]TheSecretreconciler ingardener-resource-managerwill now always remove its finalizer (if present). by @Kostov6 [#8745][DEVELOPER]Vendoring has been removed from the project, i.e., there is novendorfolder anymore. by @afritzler [#8775]
✨ New Features
[OPERATOR]ThedeltaSnapshotRetentionPeriodparameter has been introduced in theetcdConfigsection of theGardenletConfiguration. This new feature allows users to configure the retention period for delta snapshots in the ETCD component. By making the delta snapshot retention period configurable, we provide a more flexible debugging experience. Delta snapshots can now be retained for a user-defined duration, offering a valuable window for reviewing changes in case of any issues. by @seshachalam-yv [#8659][OPERATOR]Enabled thenode-exporter's textfile collector. It will parse files matching the*.promglob in the/var/lib/node-exporter/textfile-collectordirectory and load metrics from them so that they can be scraped by prometheus. by @plkokanov [#8721][OPERATOR]Condition handling was improved forShoots ofManagedSeeds. Earlier, when unknown conditions were removed from seeds (e.g. maintained by third-party components), the affected condition was still present in the shoot's conditions. by @timuthy [#8736][USER]Thekube-controller-managercontrollers are now disabled based on disabled APIs, which can be configured withspec.kubernetes.kubeAPIServer.runtimeConfigfield in the Shoot API. All controllers are enabled by default for Shoot with workers. For workerless Shoots, some non-required APIs are disabled by default, which can be overridden by the above configuration. by @shafeeqes [#8763][DEVELOPER]Useginkgolinterinstead of self bakedgomegacheckby @afritzler [#8769]
🐛 Bug Fixes
[DEVELOPER]A bug causing the crd generation fordruid.gardener.cloudgroup to fail in extensions is now fixed. by @shafeeqes [#8789][OPERATOR]During therestorephase of control plane migration, themachine-controller-manageris deployed with 0 replicas if it did not exist before or if it existed and was not scaled up yet. This fixes an issue that could cause theShoot's nodes to get recreated during control plane migration. by @plkokanov [#8742]
🏃 Others
[OPERATOR]Control plane componentskube-apiserver,kube-controller-managerandkube-schedulernow run asnonrootuser and group65532. by @AleksandarSavchev [#8690][OPERATOR]The credentials (CA) rotation has been made more robust. In some cases, theShootreconciliation stuck atDeploying main and events etcdwhen the rotation was inPreparingphase. by @timuthy [#8795][OPERATOR]Control plane componentskube-apiserver,kube-controller-managerandkube-schedulernow mountkeyfiles withDefaultModeset to416(0640permissions). by @AleksandarSavchev [#8790][OPERATOR]Plutono is updated to v7.5.26. Vali is updated to v2.2.11. Kube-rbac-proxy is updated to v0.15.0. by @nickytd [#8799][OPERATOR]The registry of the prometheus-operator image is switched from ghcr (ghcr.io/prometheus-operator/prometheus-config-reloader) toquay.io(quay.io/prometheus-operator/prometheus-config-reloader) because the ghcr does not support image pulls over IPv6. by @ialidzhikov [#8751][OPERATOR]gardener-apiserverandgardener-admission-controllernow mountkeyfiles withDefaultModeset to416(0640permissions). by @AleksandarSavchev [#8790][OPERATOR]NewClientForShootcreates a client with a rest mapper usingLazyDiscovery. by @acumino [#8781][OPERATOR]Shoot control plane prometheus is now scraping kubelet volume metrics (kubelet_volume_stats_available_bytes,kubelet_volume_stats_capacity_bytesandkubelet_volume_stats_used_bytes) from the kube-system namespace. This allows Gardener extensions deploying PVCs to the Shoot's kube-system namespace (such as the registry-cache extension) to build alerting and plutono dashboard panels using these kubelet volume metrics. by @ialidzhikov [#8798][OPERATOR]Prepare sharedcomponent_descriptorscript for migration from GCR to Artifact Registry. by @ccwienk [#8755][OPERATOR]metrics exposed bycluster autoscalernow scraped byprometheusby @aaronfern [#8750][DEVELOPER]The component checklist is enhanced with 2 new rules for container images:- Do not use container images from registries that don't support IPv6 - registries such as GHCR, ECR, MCR don't support image pulls over IPv6
- Do not use Shoot container images that are not multi-arch by @ialidzhikov [#8770]
Docker Images
- admission-controller:
eu.gcr.io/gardener-project/gardener/admission-controller:v1.84.0 - apiserver:
eu.gcr.io/gardener-project/gardener/apiserver:v1.84.0 - controller-manager:
eu.gcr.io/gardener-project/gardener/controller-manager:v1.84.0 - gardenlet:
eu.gcr.io/gardener-project/gardener/gardenlet:v1.84.0 - node-agent:
eu.gcr.io/gardener-project/gardener/node-agent:v1.84.0 - operator:
eu.gcr.io/gardener-project/gardener/operator:v1.84.0 - resource-manager:
eu.gcr.io/gardener-project/gardener/resource-manager:v1.84.0 - scheduler:
eu.gcr.io/gardener-project/gardener/scheduler:v1.84.0
Update gardener-controlplane to 1.84.0
[gardener/machine-controller-manager]
🐛 Bug Fixes
[OPERATOR]Removesnode.machine.sapcloud.io/not-managed-by-mcmannotation from nodes managed by the MCM. by @elankath [gardener/machine-controller-manager#866]
🏃 Others
[OPERATOR]The defaultmachine-safety-orphan-vms-periodhas been reduced from 30m to 15m. by @elankath [gardener/machine-controller-manager#866]
[gardener/gardener]
⚠️ Breaking Changes
[DEVELOPER]NewSecrets referenced inManagedResources will no longer be patched with the labelresources.gardener.cloud/garbage-collectable-referencewhen theManagedResourceis reconciled.Secrets which already exist in theManagedResourcespecification will still be patched if necessary. by @dimityrmirchev [#8788][OPERATOR]⚠️ The deprecated fieldsspec.settings.dependencyWatchdog.endpointandspec.settings.dependencyWatchdog.probehave been removed from the Seed API. Please check yourSeeds and remove any usage before upgrading to this Gardener version. by @himanshu-kun [#8747][USER]A validation rule was added that forbids changing the primary DNS provider in.spec.dns.providersas soon as the shoot was scheduled. by @timuthy [#8761]
📰 Noteworthy
[DEVELOPER]TheSecretreconciler ingardener-resource-managerwill now always remove its finalizer (if present). by @Kostov6 [#8745][DEVELOPER]Vendoring has been removed from the project, i.e., there is novendorfolder anymore. by @afritzler [#8775]
✨ New Features
[OPERATOR]ThedeltaSnapshotRetentionPeriodparameter has been introduced in theetcdConfigsection of theGardenletConfiguration. This new feature allows users to configure the retention period for delta snapshots in the ETCD component. By making the delta snapshot retention period configurable, we provide a more flexible debugging experience. Delta snapshots can now be retained for a user-defined duration, offering a valuable window for reviewing changes in case of any issues. by @seshachalam-yv [#8659][OPERATOR]Enabled thenode-exporter's textfile collector. It will parse files matching the*.promglob in the/var/lib/node-exporter/textfile-collectordirectory and load metrics from them so that they can be scraped by prometheus. by @plkokanov [#8721][OPERATOR]Condition handling was improved forShoots ofManagedSeeds. Earlier, when unknown conditions were removed from seeds (e.g. maintained by third-party components), the affected condition was still present in the shoot's conditions. by @timuthy [#8736][USER]Thekube-controller-managercontrollers are now disabled based on disabled APIs, which can be configured withspec.kubernetes.kubeAPIServer.runtimeConfigfield in the Shoot API. All controllers are enabled by default for Shoot with workers. For workerless Shoots, some non-required APIs are disabled by default, which can be overridden by the above configuration. by @shafeeqes [#8763][DEVELOPER]Useginkgolinterinstead of self bakedgomegacheckby @afritzler [#8769]
🐛 Bug Fixes
[DEVELOPER]A bug causing the crd generation fordruid.gardener.cloudgroup to fail in extensions is now fixed. by @shafeeqes [#8789][OPERATOR]During therestorephase of control plane migration, themachine-controller-manageris deployed with 0 replicas if it did not exist before or if it existed and was not scaled up yet. This fixes an issue that could cause theShoot's nodes to get recreated during control plane migration. by @plkokanov [#8742]
🏃 Others
[OPERATOR]Control plane componentskube-apiserver,kube-controller-managerandkube-schedulernow run asnonrootuser and group65532. by @AleksandarSavchev [#8690][OPERATOR]The credentials (CA) rotation has been made more robust. In some cases, theShootreconciliation stuck atDeploying main and events etcdwhen the rotation was inPreparingphase. by @timuthy [#8795][OPERATOR]Control plane componentskube-apiserver,kube-controller-managerandkube-schedulernow mountkeyfiles withDefaultModeset to416(0640permissions). by @AleksandarSavchev [#8790][OPERATOR]Plutono is updated to v7.5.26. Vali is updated to v2.2.11. Kube-rbac-proxy is updated to v0.15.0. by @nickytd [#8799][OPERATOR]The registry of the prometheus-operator image is switched from ghcr (ghcr.io/prometheus-operator/prometheus-config-reloader) toquay.io(quay.io/prometheus-operator/prometheus-config-reloader) because the ghcr does not support image pulls over IPv6. by @ialidzhikov [#8751][OPERATOR]gardener-apiserverandgardener-admission-controllernow mountkeyfiles withDefaultModeset to416(0640permissions). by @AleksandarSavchev [#8790][OPERATOR]NewClientForShootcreates a client with a rest mapper usingLazyDiscovery. by @acumino [#8781][OPERATOR]Shoot control plane prometheus is now scraping kubelet volume metrics (kubelet_volume_stats_available_bytes,kubelet_volume_stats_capacity_bytesandkubelet_volume_stats_used_bytes) from the kube-system namespace. This allows Gardener extensions deploying PVCs to the Shoot's kube-system namespace (such as the registry-cache extension) to build alerting and plutono dashboard panels using these kubelet volume metrics. by @ialidzhikov [#8798][OPERATOR]Prepare sharedcomponent_descriptorscript for migration from GCR to Artifact Registry. by @ccwienk [#8755][OPERATOR]metrics exposed bycluster autoscalernow scraped byprometheusby @aaronfern [#8750][DEVELOPER]The component checklist is enhanced with 2 new rules for container images:- Do not use container images from registries that don't support IPv6 - registries such as GHCR, ECR, MCR don't support image pulls over IPv6
- Do not use Shoot container images that are not multi-arch by @ialidzhikov [#8770]
Docker Images
- admission-controller:
eu.gcr.io/gardener-project/gardener/admission-controller:v1.84.0 - apiserver:
eu.gcr.io/gardener-project/gardener/apiserver:v1.84.0 - controller-manager:
eu.gcr.io/gardener-project/gardener/controller-manager:v1.84.0 - gardenlet:
eu.gcr.io/gardener-project/gardener/gardenlet:v1.84.0 - node-agent:
eu.gcr.io/gardener-project/gardener/node-agent:v1.84.0 - operator:
eu.gcr.io/gardener-project/gardener/operator:v1.84.0 - resource-manager:
eu.gcr.io/gardener-project/gardener/resource-manager:v1.84.0 - scheduler:
eu.gcr.io/gardener-project/gardener/scheduler:v1.84.0
Update gardenlet to 1.84.0
[gardener/machine-controller-manager]
🐛 Bug Fixes
[OPERATOR]Removesnode.machine.sapcloud.io/not-managed-by-mcmannotation from nodes managed by the MCM. by @elankath [gardener/machine-controller-manager#866]
🏃 Others
[OPERATOR]The defaultmachine-safety-orphan-vms-periodhas been reduced from 30m to 15m. by @elankath [gardener/machine-controller-manager#866]
[gardener/gardener]
⚠️ Breaking Changes
[DEVELOPER]NewSecrets referenced inManagedResources will no longer be patched with the labelresources.gardener.cloud/garbage-collectable-referencewhen theManagedResourceis reconciled.Secrets which already exist in theManagedResourcespecification will still be patched if necessary. by @dimityrmirchev [#8788][OPERATOR]⚠️ The deprecated fieldsspec.settings.dependencyWatchdog.endpointandspec.settings.dependencyWatchdog.probehave been removed from the Seed API. Please check yourSeeds and remove any usage before upgrading to this Gardener version. by @himanshu-kun [#8747][USER]A validation rule was added that forbids changing the primary DNS provider in.spec.dns.providersas soon as the shoot was scheduled. by @timuthy [#8761]
📰 Noteworthy
[DEVELOPER]TheSecretreconciler ingardener-resource-managerwill now always remove its finalizer (if present). by @Kostov6 [#8745][DEVELOPER]Vendoring has been removed from the project, i.e., there is novendorfolder anymore. by @afritzler [#8775]
✨ New Features
[OPERATOR]ThedeltaSnapshotRetentionPeriodparameter has been introduced in theetcdConfigsection of theGardenletConfiguration. This new feature allows users to configure the retention period for delta snapshots in the ETCD component. By making the delta snapshot retention period configurable, we provide a more flexible debugging experience. Delta snapshots can now be retained for a user-defined duration, offering a valuable window for reviewing changes in case of any issues. by @seshachalam-yv [#8659][OPERATOR]Enabled thenode-exporter's textfile collector. It will parse files matching the*.promglob in the/var/lib/node-exporter/textfile-collectordirectory and load metrics from them so that they can be scraped by prometheus. by @plkokanov [#8721][OPERATOR]Condition handling was improved forShoots ofManagedSeeds. Earlier, when unknown conditions were removed from seeds (e.g. maintained by third-party components), the affected condition was still present in the shoot's conditions. by @timuthy [#8736][USER]Thekube-controller-managercontrollers are now disabled based on disabled APIs, which can be configured withspec.kubernetes.kubeAPIServer.runtimeConfigfield in the Shoot API. All controllers are enabled by default for Shoot with workers. For workerless Shoots, some non-required APIs are disabled by default, which can be overridden by the above configuration. by @shafeeqes [#8763][DEVELOPER]Useginkgolinterinstead of self bakedgomegacheckby @afritzler [#8769]
🐛 Bug Fixes
[DEVELOPER]A bug causing the crd generation fordruid.gardener.cloudgroup to fail in extensions is now fixed. by @shafeeqes [#8789][OPERATOR]During therestorephase of control plane migration, themachine-controller-manageris deployed with 0 replicas if it did not exist before or if it existed and was not scaled up yet. This fixes an issue that could cause theShoot's nodes to get recreated during control plane migration. by @plkokanov [#8742]
🏃 Others
[OPERATOR]Control plane componentskube-apiserver,kube-controller-managerandkube-schedulernow run asnonrootuser and group65532. by @AleksandarSavchev [#8690][OPERATOR]The credentials (CA) rotation has been made more robust. In some cases, theShootreconciliation stuck atDeploying main and events etcdwhen the rotation was inPreparingphase. by @timuthy [#8795][OPERATOR]Control plane componentskube-apiserver,kube-controller-managerandkube-schedulernow mountkeyfiles withDefaultModeset to416(0640permissions). by @AleksandarSavchev [#8790][OPERATOR]Plutono is updated to v7.5.26. Vali is updated to v2.2.11. Kube-rbac-proxy is updated to v0.15.0. by @nickytd [#8799][OPERATOR]The registry of the prometheus-operator image is switched from ghcr (ghcr.io/prometheus-operator/prometheus-config-reloader) toquay.io(quay.io/prometheus-operator/prometheus-config-reloader) because the ghcr does not support image pulls over IPv6. by @ialidzhikov [#8751][OPERATOR]gardener-apiserverandgardener-admission-controllernow mountkeyfiles withDefaultModeset to416(0640permissions). by @AleksandarSavchev [#8790][OPERATOR]NewClientForShootcreates a client with a rest mapper usingLazyDiscovery. by @acumino [#8781][OPERATOR]Shoot control plane prometheus is now scraping kubelet volume metrics (kubelet_volume_stats_available_bytes,kubelet_volume_stats_capacity_bytesandkubelet_volume_stats_used_bytes) from the kube-system namespace. This allows Gardener extensions deploying PVCs to the Shoot's kube-system namespace (such as the registry-cache extension) to build alerting and plutono dashboard panels using these kubelet volume metrics. by @ialidzhikov [#8798][OPERATOR]Prepare sharedcomponent_descriptorscript for migration from GCR to Artifact Registry. by @ccwienk [#8755][OPERATOR]metrics exposed bycluster autoscalernow scraped byprometheusby @aaronfern [#8750][DEVELOPER]The component checklist is enhanced with 2 new rules for container images:- Do not use container images from registries that don't support IPv6 - registries such as GHCR, ECR, MCR don't support image pulls over IPv6
- Do not use Shoot container images that are not multi-arch by @ialidzhikov [#8770]
Docker Images
- admission-controller:
eu.gcr.io/gardener-project/gardener/admission-controller:v1.84.0 - apiserver:
eu.gcr.io/gardener-project/gardener/apiserver:v1.84.0 - controller-manager:
eu.gcr.io/gardener-project/gardener/controller-manager:v1.84.0 - gardenlet:
eu.gcr.io/gardener-project/gardener/gardenlet:v1.84.0 - node-agent:
eu.gcr.io/gardener-project/gardener/node-agent:v1.84.0 - operator:
eu.gcr.io/gardener-project/gardener/operator:v1.84.0 - resource-manager:
eu.gcr.io/gardener-project/gardener/resource-manager:v1.84.0 - scheduler:
eu.gcr.io/gardener-project/gardener/scheduler:v1.84.0