[feature request] How about implementing an application load balancer for OpenYurt?

[LindaYu17]

What would you like to be added:

An application load balancer that handles requests taking consideration of the current loads (CPU/MEM/GPU/...) of cluster.

Why is this needed:

To get good performance and optimal utilization of nodes.

others
/kind feature

[rambohe-ch]

@LindaYu17 Thank you for filing issue.

An application load balancer that handles requests taking consideration of the current loads (CPU/MEM/GPU/...) of cluster.

application load balancer is used for pods on edge node or used for kube-apiserver on master nodes? would you describe load balancer requirements in more detail?

[LindaYu17]

It is used for pods on edge node.

Existing load balancer in K8S are mainly distributing requests from user by traffic randomly, the application load balancer I mentioned here should be able to distribute requests according to current system conditions and user defined rules. When the workloads the client requests for are sustaining resource/time consuming, such as video analytics, cloud gaming... if we dispatch such kind of workloads randomly, we don't guarantee to gain optimal performance. When dispatching this kind of request, we need to consider more, such as CPU/GPU/MEM usage. The application load balancer is designed to bridge this gap.

[rambohe-ch]

It is used for pods on edge node.

Existing load balancer in K8S are mainly distributing requests from user by traffic randomly, the application load balancer I mentioned here should be able to distribute requests according to current system conditions and user defined rules. When the workloads the client requests for are sustaining resource/time consuming, such as video analytics, cloud gaming... if we dispatch such kind of workloads randomly, we don't guarantee to gain optimal performance. When dispatching this kind of request, we need to consider more, such as CPU/GPU/MEM usage. The application load balancer is designed to bridge this gap.

@LindaYu17 Thank you for feedback.
In K8s ecosystem, Service is used as load balancer for pods on nodes. Do you have ideas that how to integrate k8s service with application load balancer?

[gnunu]

Sounds App LB is a kind of enhancement to K8s Service? The two components have some overlap in terms of doing reverse proxy for incoming requests. However, for ALB, user can add rules through API (CR) to explicitly specify how to do load balancing, such as what devices to prioritize, what algorithm to use, etc. For scenarios like numrous channels of video analytics, dispaching requests to right nodes/pods needs a sophisticated LB.

[rambohe-ch]

Sounds App LB is a kind of enhancement to K8s Service? The two components have some overlap in terms of doing reverse proxy for incoming requests. However, for ALB, user can add rules through API (CR) to explicitly specify how to do load balancing, such as what devices to prioritize, what algorithm to use, etc. For scenarios like numrous channels of video analytics, dispaching requests to right nodes/pods needs a sophisticated LB.

@LindaYu17 Based on the above the comments from you and @gnunu , application load balancer sounds like a valuable feature in the edge scenario.
Would you like to make a proposal of application Load Balancer? so we can make a detailed discussion about it based on the proposal.

[LindaYu17]

Sounds App LB is a kind of enhancement to K8s Service? The two components have some overlap in terms of doing reverse proxy for incoming requests. However, for ALB, user can add rules through API (CR) to explicitly specify how to do load balancing, such as what devices to prioritize, what algorithm to use, etc. For scenarios like numrous channels of video analytics, dispaching requests to right nodes/pods needs a sophisticated LB.

@LindaYu17 Based on the above the comments from you and @gnunu , application load balancer sounds like a valuable feature in the edge scenario.
Would you like to make a proposal of application Load Balancer? so we can make a detailed discussion about it based on the proposal.

sure, we are preparing ALB proposal right now, and will submit once it is done.