Is "Hierarchical All-to-all" feat available in current version? #6957
Open
Description
According to https://arxiv.org/pdf/2201.05596, we are very interested on "Hierarchical All-to-all" and think this is an amazing feature. But after reading source code, we could not find any part related to this. I found that team said that they did not have a ETA for this in #2039, will this be supported in the future?
Metadata
Assignees
Labels
No labels