Open
Conversation
Member
Author
GleasonK
reviewed
Feb 17, 2026
felixwqp
reviewed
Feb 18, 2026
Member
felixwqp
left a comment
felixwqp
left a comment
There was a problem hiding this comment.
Can I assume implicitly this will only work for shard_map-based sharding? like how ragged_all_to_all is used?
Member
Author
I'm not sure. I haven't thought that far ahead. When I support these async collectives in JAX, though, I do plan on only supporting shard_map at first. |
GleasonK
approved these changes
Feb 26, 2026
GleasonK
approved these changes
Feb 26, 2026
joelberkeley
reviewed
Mar 2, 2026
joelberkeley
reviewed
Mar 2, 2026
joelberkeley
reviewed
Mar 3, 2026
joelberkeley
reviewed
Mar 3, 2026
mwhittaker
force-pushed
the
async_collectives_rfc
branch
from
89da850 to
3926874
Compare
Member
|
Would this RFC extend to async dynamic-slice/dynamic-update-slice? |
Member
This should naturally extend to these ops. I'm OK to bring them in scope under the umbrella of "known ops that we want to have an async decomposition by a backend" |
GleasonK
approved these changes
Mar 20, 2026
fhoushmand
reviewed
Mar 22, 2026
fhoushmand
reviewed
Mar 22, 2026
fhoushmand
reviewed
Mar 22, 2026
fhoushmand
reviewed
Mar 22, 2026
copybara-service bot
pushed a commit
to tensorflow/tensorflow
that referenced
this pull request
Mar 23, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to openxla/xla
that referenced
this pull request
Mar 23, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
Member
Author
|
I updated the RFC to include slice ops. I also made things less variadic for now. We can change that later if needed. |
fhoushmand
approved these changes
Mar 24, 2026
copybara-service bot
pushed a commit
to openxla/xla
that referenced
this pull request
Mar 25, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to tensorflow/tensorflow
that referenced
this pull request
Mar 25, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to openxla/xla
that referenced
this pull request
Mar 25, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to tensorflow/tensorflow
that referenced
this pull request
Mar 25, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to openxla/xla
that referenced
this pull request
Mar 26, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to tensorflow/tensorflow
that referenced
this pull request
Mar 26, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to openxla/xla
that referenced
this pull request
Mar 26, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to tensorflow/tensorflow
that referenced
this pull request
Mar 26, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 874740969
copybara-service bot
pushed a commit
to openxla/xla
that referenced
this pull request
Mar 26, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 890017379
copybara-service bot
pushed a commit
to tensorflow/tensorflow
that referenced
this pull request
Mar 26, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 890017379
copybara-service bot
pushed a commit
to openxla/shardy
that referenced
this pull request
Mar 26, 2026
See openxla/stablehlo#2897 for context. This CL introduces a `stablehlo.future` type and `stablehlo.async_start` and `stablehlo.async_done`. It does not add any translation for them. That will come in a later change. I also did not make `async_start` and `async_done` variadic for now, even though some collectives are variadic. We can add support for that later if we need it. PiperOrigin-RevId: 890017379
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
7 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.