[WIP] KEP-976: Support Groups of Pods Where Driver Generates Workers in Pod Integration

[everpeace]

• implementation and unit tests
• integration tests if needed
• E2E tests if needed
• User Doc

---

What type of PR is this?

/kind feature

What this PR does / why we need it:

• Add Driver Generated Pods Support in Pod Integration
• KEP
  • https://github.com/kubernetes-sigs/kueue/tree/main/keps/976-plain-pods#groups-of-pods-where-driver-generates-workers
  • https://github.com/kubernetes-sigs/kueue/tree/main/keps/976-plain-pods#story-3

Which issue(s) this PR fixes:

Fixes #1656

Special notes for your reviewer:

• I'm not regular contributor of Kueue. Thus, I'm not so confident my PR is the relevant impelmentation for the KEP. Please feel free to correct me 🙇
• I will support Kubeflow Spark Operator integration for the next step (SparkApplication integration)

Does this PR introduce a user-facing change?

KEP-976: Support Groups of Pods Where Driver Generates Workers in Pod Integration

[k8s-ci-robot]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: everpeace
Once this PR has been reviewed and has the lgtm label, please assign mimowo for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[netlify]

✅ Deploy Preview for kubernetes-sigs-kueue canceled.

Name	Link
🔨 Latest commit	c2e5d9c
🔍 Latest deploy log	https://app.netlify.com/sites/kubernetes-sigs-kueue/deploys/679b53d4c040520008a4a67e

[everpeace]

/test all