[FLINK-34574] Add CPU and memory size autoscaler quota #789
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What is the purpose of the change
Flink can report slot sharing group information in the vertex information. This can be used to fine tune the autoscaler algorithm to define quotas. In this PR I've added 2 type of quotas:
kubernetes.operator.job.autoscaler.quota.cpu
: Task manager CPU quota can be definedkubernetes.operator.job.autoscaler.quota.memory
: Task manager memory size quota can be definedIn bot cases scaling is not happening when the total amount of CPU or memory would be greater than the quota.
Brief change log
Added CPU and memory size autoscaler quota.
Verifying this change
Added automated tests + manually on cluster.
Does this pull request potentially affect one of the following parts:
CustomResourceDescriptors
: noDocumentation