Add Kubeflow Trainer v2.2 release blog post by xikronz · Pull Request #194 · kubeflow/blog

xikronz · 2026-03-20T04:28:05Z

This blog post (collaborative) covers the Kubeflow Trainer v2.2 release. For the full release tracking issue, see #3116

andreyvelich

Thank you for this @xikronz !

andreyvelich · 2026-03-20T08:51:30Z

@xikronz Please sign your commit too for DCO

andreyvelich · 2026-03-20T10:36:04Z

/assign @astefanutti @jaiakash @varodrig @yashpal2104 @Fiona-Waters @robert-bell @kaisoz @Krishna-kg732 @vsoch @XploY04 @kramaranya

google-oss-prow · 2026-03-20T10:36:10Z

@andreyvelich: GitHub didn't allow me to assign the following users: robert-bell, Krishna-kg732, vsoch, XploY04, yashpal2104.

Note that only kubeflow members with read permissions, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

Details

In response to this:

/assign @astefanutti @jaiakash @varodrig @yashpal2104 @Fiona-Waters @robert-bell @kaisoz @Krishna-kg732 @vsoch @XploY04 @kramaranya

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Signed-off-by: xikron <cc2864@cornell.edu>

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com> Signed-off-by: Carrie Chen <139071206+xikronz@users.noreply.github.com>

andreyvelich · 2026-03-20T15:05:49Z

/ok-to-test

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com> Signed-off-by: Carrie Chen <139071206+xikronz@users.noreply.github.com>

andreyvelich

@xikronz Can you also sign your commits for DCO.
Ref: https://www.kubeflow.org/docs/about/contributing/#sign-off-your-commits

yashpal2104 · 2026-03-20T17:27:59Z

I am not a kubeflow member, can someone make me a member not able to get assigned issues
@andreyvelich can u add me as a kubeflow member

andreyvelich · 2026-03-20T17:33:52Z

I am not a kubeflow member, can someone make me a member not able to get assigned issues @andreyvelich can u add me as a kubeflow member

Sure, can you create PR similar to this one: kubeflow/internal-acls#895

Signed-off-by: xikron <cc2864@cornell.edu>

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com> Signed-off-by: Carrie Chen <139071206+xikronz@users.noreply.github.com>

Signed-off-by: xikron <cc2864@cornell.edu>

andreyvelich

Thanks for this work @xikronz!
/lgtm
/assign @astefanutti @VassilisVassiliadis @kramaranya @Fiona-Waters @robert-bell @tenzen-y @vsoch

google-oss-prow · 2026-03-20T19:59:17Z

@andreyvelich: GitHub didn't allow me to assign the following users: robert-bell, VassilisVassiliadis.

Note that only kubeflow members with read permissions, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

Details

In response to this:

Thanks for this work @xikronz!
/lgtm
/assign @astefanutti @VassilisVassiliadis @kramaranya @Fiona-Waters @robert-bell @tenzen-y

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

andreyvelich · 2026-03-21T00:05:16Z

+enabling them to treat GPUs across multiple machines as a single unified memory domain. For 
+large-scale training, this means significantly faster node-to-node communication compared to 
+standard network-based primitives and brings forth a new era of configurations that simply 
+weren't practical before on Kubernetes.


Let's also say this

Suggested change

weren't practical before on Kubernetes.

weren't practical before on Kubernetes. We are working closely with Kubernetes community to introduce first class support for Dynamic Resource Allocation (DRA) in TrainJobs.

cc @Ronkahn21

andreyvelich · 2026-03-21T00:06:07Z

+process, Trainer will choose appropriate resources automatically based on the TrainJob configuration.
+This gives teams the power to plan experiments with confidence and trust that jobs use just the right
+amount of compute.
+


Can we also say something about Workload Aware Scheduling please?
kubeflow/trainer#3219

Co-authored-by: Vanessa Sochat <814322+vsoch@users.noreply.github.com> Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com> Signed-off-by: Carrie Chen <139071206+xikronz@users.noreply.github.com>

google-oss-prow · 2026-03-21T17:28:17Z

@vsoch: changing LGTM is restricted to collaborators

Details

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Signed-off-by: xikron <cc2864@cornell.edu>

andreyvelich

Awesome work @xikronz!
I am going to announce the Trainer v2.2 release tomorrow.
/lgtm
/approve
/hold in case others want to give more comments.

google-oss-prow · 2026-03-23T11:21:31Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andreyvelich

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

~~OWNERS~~ [andreyvelich]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

jaiakash

Thanks for this 🚀

andreyvelich · 2026-03-24T11:39:56Z

/hold cancel

google-oss-prow Bot requested review from andreyvelich and zijianjoy March 20, 2026 04:28

google-oss-prow Bot added the size/L label Mar 20, 2026

andreyvelich reviewed Mar 20, 2026

View reviewed changes

google-oss-prow Bot assigned astefanutti, Fiona-Waters, jaiakash, kaisoz, kramaranya and varodrig Mar 20, 2026

VassilisVassiliadis reviewed Mar 20, 2026

View reviewed changes

Comment thread _posts/2026-3-20-introducing-kubeflow-trainer-v2.2.md Outdated

VassilisVassiliadis reviewed Mar 20, 2026

View reviewed changes

Comment thread _posts/2026-3-20-introducing-kubeflow-trainer-v2.2.md Outdated

xikronz added 2 commits March 20, 2026 11:02

Add Kubeflow Trainer v2.2 release blog post

72d9722

Signed-off-by: xikron <cc2864@cornell.edu>

header, formating and light changes

a99e675

Signed-off-by: xikron <cc2864@cornell.edu>

xikronz force-pushed the add-trainer-v2.2-release-post branch from 58c2a2f to a99e675 Compare March 20, 2026 15:03

Apply suggestion from @andreyvelich

bfb8c9b

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com> Signed-off-by: Carrie Chen <139071206+xikronz@users.noreply.github.com>

google-oss-prow Bot added the ok-to-test label Mar 20, 2026

Applying suggestions from code review

d250f88

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com> Signed-off-by: Carrie Chen <139071206+xikronz@users.noreply.github.com>

andreyvelich reviewed Mar 20, 2026

View reviewed changes

Comment thread _posts/2026-3-20-introducing-kubeflow-trainer-v2.2.md

xikronz added 2 commits March 20, 2026 13:34

fixing the runtimepatches YAML

6ad6cac

Signed-off-by: xikron <cc2864@cornell.edu>

elastic api and minor changes

94c1974

Signed-off-by: xikron <cc2864@cornell.edu>

xikronz force-pushed the add-trainer-v2.2-release-post branch from e28c5a0 to 94c1974 Compare March 20, 2026 17:35

andreyvelich reviewed Mar 20, 2026

View reviewed changes

Comment thread _posts/2026-3-20-introducing-kubeflow-trainer-v2.2.md Outdated

xikronz and others added 5 commits March 20, 2026 14:21

code review comments

1f9233a

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com> Signed-off-by: Carrie Chen <139071206+xikronz@users.noreply.github.com>

title changes and removing Getting Started sections

8ad7c60

Signed-off-by: xikron <cc2864@cornell.edu>

formatting cleanup

f1baee6

Signed-off-by: xikron <cc2864@cornell.edu>

bringing back example header info

8b82252

Signed-off-by: xikron <cc2864@cornell.edu>

ok last commit

1c1a80e

Signed-off-by: xikron <cc2864@cornell.edu>

andreyvelich reviewed Mar 20, 2026

View reviewed changes

google-oss-prow Bot assigned tenzen-y and andreyvelich Mar 20, 2026

google-oss-prow Bot added the lgtm label Mar 20, 2026

vsoch reviewed Mar 20, 2026

View reviewed changes

Comment thread _posts/2026-3-20-introducing-kubeflow-trainer-v2.2.md Outdated

vsoch reviewed Mar 20, 2026

View reviewed changes

Comment thread _posts/2026-3-20-introducing-kubeflow-trainer-v2.2.md Outdated

vsoch reviewed Mar 20, 2026

View reviewed changes

Comment thread _posts/2026-3-20-introducing-kubeflow-trainer-v2.2.md Outdated

andreyvelich reviewed Mar 21, 2026

View reviewed changes

resolving comments

5b874e2

Co-authored-by: Vanessa Sochat <814322+vsoch@users.noreply.github.com> Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com> Signed-off-by: Carrie Chen <139071206+xikronz@users.noreply.github.com>

google-oss-prow Bot removed the lgtm label Mar 21, 2026

vsoch approved these changes Mar 21, 2026

View reviewed changes

xikronz added 2 commits March 21, 2026 13:49

linking user guide and WAS into future work

e0d6335

Signed-off-by: xikron <cc2864@cornell.edu>

resolving comment

3c2b11f

Signed-off-by: xikron <cc2864@cornell.edu>

andreyvelich reviewed Mar 23, 2026

View reviewed changes

google-oss-prow Bot added do-not-merge/hold lgtm labels Mar 23, 2026

google-oss-prow Bot added the approved label Mar 23, 2026

jaiakash approved these changes Mar 23, 2026

View reviewed changes

google-oss-prow Bot removed the do-not-merge/hold label Mar 24, 2026

google-oss-prow Bot merged commit 83305b1 into kubeflow:master Mar 24, 2026
7 checks passed

	weren't practical before on Kubernetes.
	weren't practical before on Kubernetes. We are working closely with Kubernetes community to introduce first class support for Dynamic Resource Allocation (DRA) in TrainJobs.

Conversation

xikronz commented Mar 20, 2026

Uh oh!

andreyvelich left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

andreyvelich commented Mar 20, 2026

Uh oh!

andreyvelich commented Mar 20, 2026

Uh oh!

google-oss-prow Bot commented Mar 20, 2026

Uh oh!

Uh oh!

Uh oh!

andreyvelich commented Mar 20, 2026

Uh oh!

andreyvelich left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

yashpal2104 commented Mar 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

andreyvelich commented Mar 20, 2026

Uh oh!

Uh oh!

andreyvelich left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

google-oss-prow Bot commented Mar 20, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

andreyvelich Mar 21, 2026

Choose a reason for hiding this comment

Uh oh!

andreyvelich Mar 21, 2026

Choose a reason for hiding this comment

Uh oh!

xikronz Mar 21, 2026

Choose a reason for hiding this comment

Uh oh!

google-oss-prow Bot commented Mar 21, 2026

Uh oh!

andreyvelich left a comment

Choose a reason for hiding this comment

Uh oh!

google-oss-prow Bot commented Mar 23, 2026

Uh oh!

jaiakash left a comment

Choose a reason for hiding this comment

Uh oh!

andreyvelich commented Mar 24, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

13 participants

yashpal2104 commented Mar 20, 2026 •

edited

Loading

andreyvelich left a comment •

edited

Loading