Skip to content

Fair sharing mechanism without preemptions #4136

@mwielgus

Description

@mwielgus

What would you like to be added:

An admission-time mechanism to fair share unused resources without preemptions.

Why is this needed:

The current fair sharing approach enforces fair sharing via preemptions. Workloads from CQ that is consuming more shared resources are preempted in favor of workloads that is consuming less. This however has couple of drawbacks:

  • Doesn't work in a situation when preemptions are not recommended.
  • Doesn't allow stable admission of large (like consuming more than 1/Nth) amount of shared resources.

A new, complementary mechanism is needed to address these needs.

Completion requirements:

This enhancement requires the following artifacts:

  • Design doc
    API change
    Docs update

The artifacts should be linked in subsequent comments.

Activity

added
kind/featureCategorizes issue or PR as related to a new feature.
on Feb 3, 2025
tenzen-y

tenzen-y commented on Feb 5, 2025

@tenzen-y
Member

@mwielgus What is this expectation instead of preemption? Do we want to scale out cluster to have fair sharing instead of preemption? Or do we want to restrict Job admission based on the fair share policy even if the cluster has unused resources?

linked a pull request that will close this issue on Feb 12, 2025
linked a pull request that will close this issue on Mar 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/featureCategorizes issue or PR as related to a new feature.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Participants

    @mwielgus@tenzen-y

    Issue actions

      Fair sharing mechanism without preemptions · Issue #4136 · kubernetes-sigs/kueue