-
Notifications
You must be signed in to change notification settings - Fork 1.4k
📖 Update autoscaling from zero enhancement proposal with support for platform-aware autoscale from zero #11962
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Welcome @aleskandro! |
Hi @aleskandro. Thanks for your PR. I'm waiting for a kubernetes-sigs member to verify that this patch is reasonable to test. If it is, they should reply with Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
4fbe927
to
666c952
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Seems very straightforward, no objection from me
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this generally makes sense to me, and i don't have any objections.
i would like to get some attention on the API field change though, just to make sure folks agree about the name and placement.
Thanks @elmiko. To give more context about the choice of naming and structure for everyone to discuss alternatives. I couldn't consider the architecture as part of the capacity field because the values of keys in that stanza are expected to be a Quantity. I tried to trace back the reasoning the community did about the capacity field and I noticed that the Node objects' status field has the same field - capacity - with the same content we set in the Infrastructure Machine Template objects. The Node objects' status field also has a nodeInfo field with the same name and type that I'm now proposing for the Infrastructure Machine Template objects. Among the alternatives I was evaluating, this seemed the most reasonable to me. |
makes sense to me @aleskandro , no objection from me. |
666c952
to
106bcbd
Compare
/hold Especially for getting consensus on and resolve #11962 (comment) |
106bcbd
to
20f9c76
Compare
d6e69f8
to
85da18e
Compare
@JoelSpeed If you find some time, PTAL :) |
8349163
to
6d2fb96
Compare
/label tide/merge-method-squash |
i am happy with the state this is in. /lgtm |
LGTM label has been added. Git tree hash: 1e88b9ce31402b9352a67b7a6637e488da7436ac
|
/unhold |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a few nits from my side.
Considering the type of changes we are introducing, I think we should consider addressing #12033 as integral part of the implementation.
Last nit, could you kindly also add a new line in the Implementation History down below
New changes are detected. LGTM label has been removed. |
6758a68
to
31e4d30
Compare
Hi @fabriziopandini , thanks for your review. I could take #12033 and resolve it in a separate PR, if this sounds good to you.
Done |
31e4d30
to
d0cb4af
Compare
71d3658
to
eef83de
Compare
eef83de
to
34874f5
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i think the updates are nice, and this is looking good to me in general.
i have one minor question about if we should put an example in here. i don't think it's needed, but might help to illustrate the override mechanism. wdyt?
34874f5
to
786323b
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Last comment from my side, otherwise lgtm
// Its underlying type is a string and its value can be any of amd64, arm64, s390x, ppc64le. | ||
// +kubebuilder:validation:Enum=amd64;arm64;s390x;ppc64le | ||
// +enum | ||
type Architecture string |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I assume we will define constants to match the available values?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @JoelSpeed , we have them set in https://github.com/kubernetes-sigs/cluster-api/pull/11962/files#diff-4c8f17be01a9d7dac2f991e0d8a273e19345291dea411d5f773f49297ed64facR210-R214. Should I copy them here too?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(added too)
…atform-aware autoscale from zero This commit updates the contract between the cluster-autoscaler Cluster API provider and the infrastructure provider's controllers that reconcile the Infrastructure Machine Template to support platform-aware autoscale from 0 in clusters consisting of nodes heterogeneous in CPU architecture and OS. With this commit, the infrastructure providers implementing controllers to reconcile the status of their Infrastructure Machine Templates for supporting autoscale from 0 will be able to fill the status.nodeInfo stanza with additional information about the nodes. The status.nodeInfo stanza has type corev1.NodeSystemInfo to reflect the same content, the rendered nodes' objects would store in their status field. The cluster-autoscaler can use that information to build the node template labels `kubernetes.io/arch` and `kubernetes.io/os` if that information is present. Suppose the pending pods that trigger the cluster autoscaler have a node selector or a requiredDuringSchedulingIgnoredDuringExecution node affinity concerning the architecture or operating system of the node where they can execute. In that case, the autoscaler will be able to filter the nodes groups options according to the architecture or operating system requested by the pod. The users could already provide this information to the cluster autoscaler through the labels capacity annotation. However, there is no similar capability to support future labels/taints through information set by the reconcilers of the status of Infrastructure Machine Templates. Signed-off-by: aleskandro <[email protected]>
786323b
to
1db0294
Compare
What this PR does / why we need it:
This PR updates the contract between the cluster-autoscaler Cluster API provider and the infrastructure provider's controllers that reconcile the Infrastructure Machine Template to support platform-aware autoscale from 0 in clusters consisting of nodes heterogeneous in CPU architecture and OS.
With this commit, the infrastructure providers implementing controllers to reconcile the status of their Infrastructure Machine Templates for supporting autoscale from 0 will be able to fill the status.nodeInfo stanza with additional information about the nodes.
The status.nodeInfo stanza has type corev1.NodeSystemInfo to reflect the same content, the rendered nodes' objects would store in their status field.
The cluster-autoscaler can use that information to build the node template labels
kubernetes.io/arch
andkubernetes.io/os
if that information is present.Suppose the pending pods that trigger the cluster autoscaler have a node selector or a requiredDuringSchedulingIgnoredDuringExecution node affinity concerning the architecture or operating system of the node where they can execute. In that case, the autoscaler will be able to filter the nodes groups options according to the architecture or operating system requested by the pod.
The users could already provide this information to the cluster autoscaler through the labels capacity annotation. However, there is no similar capability to support future labels/taints through information set by the reconcilers of the status of Infrastructure Machine Templates.
Which issue(s) this PR fixes
Related to #11961
/area provider/core