Fallback to standard mesh on neuron backend for incompatible multi-granule meshes #1146

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

apoorvtintin wants to merge 1 commit into apple:main from apoorvtintin:neuron_mesh

Contributor

apoorvtintin commented May 1, 2025 •

edited

Loading

Allow fallback to standard mesh for multi-granule mesh as such a mesh provides better performance on TRN2

Added corresponding tests for fallback and mesh creation for TRN2.
Switch to a new mesh for neuron-(trn2|trn2n).48xlarge-64 on 70B-FujiV2 as it provides better scale-out performance.


          Build standard mesh for neuron backend

4793e44

- Switch to a new mesh for neuron-(trn2|trn2n).48xlarge-64 with better scale-out performance.

apoorvtintin requested review from ruomingp, markblee and a team as code owners

May 1, 2025 22:40

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet