Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] A test case to show how to use DeviceMesh API to create the customized PG #17

Closed
wants to merge 31 commits into from
Closed

[WIP] A test case to show how to use DeviceMesh API to create the customized PG #17

wants to merge 31 commits into from

Conversation

fegin
Copy link
Contributor

@fegin fegin commented Nov 26, 2024

This is still not working yet because get_group will fail.

@fegin
[WIP] A test case to show how to use DeviceMesh API to create the cus…
aadf67c 
…tomized PG

This is still not working yet because get_group will fail.
@fegin fegin marked this pull request as draft November 26, 2024 17:23
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Nov 26, 2024
d4l3k and others added 27 commits November 26, 2024 17:27
@d4l3k
docs: add sphinx documentation and add missing documentation (#18)
4ad6f1b
@d4l3k
manager: expand API to include errors, participant information and nu…
63ee40c 
…meric test (#19)

* manager: added participant information

* manager: error reporting APIs and numerics test
@d4l3k
docs: add legal info + fix jinja2 security warning (#20)
03f5350
@d4l3k
process_group: wrapper updates and ErrorSwallowingProcessGroup (#21)
4e86676
@d4l3k
process_group: added ManagedProcessGroup
63c82c1
@d4l3k
lintrunner: added black,isort,rustfmt (#22)
b626d17
@d4l3k
lintrunner: enable pyre (#23)
1d5464d
@d4l3k
manager: added FIXED_WITH_SPARES mode (#24)
ab66c7c
@d4l3k
manager: added E2E tests and support getting lighthouse and manager a…
ddbc3c9 
…ddresses (#25)
@d4l3k
manager_integ_tests: added Python integration test with lighthouse (#27)
7b93da7
@d4l3k
manager_integ_tests: added recovery test (#28)
9878980
@d4l3k
pyre strict (#29)
e4c8e5a
@d4l3k
Update README.md (#31)
6ceee88
@d4l3k
Update README.md (#33)
fdcfe5d
@d4l3k
Update README.md (#34)
c0acce1
@d4l3k
manager: add CPU timeouts on allreduce/future calls (#38)
a52d746 
* futures: add ability to timeout waiting for future

* manager: add timeout on grad futures

* process_group: make ManagedProcessGroup use wrap_future

* Trigger Build

* Trigger Build
@d4l3k
manager_integ_tests: added multi rank recovery and sync tests (#40)
58a436d
@H-Huang
Update README with protobuf related installation (#42)
8a22dc8
@d4l3k
manager: rename step to start_step + small shutdown fix (#44)
78c5721
@d4l3k
manager: rename start_step to start_quorum and move step changes to s…
a484e4f 
…hould_commit (#46)
@d4l3k
local_sgd: initial version of fault tolerant LocalSGD (#47)
6d6e9a4
@H-Huang
Add _test_pg helper (#45)
49d2aec 
* Add _test_pg helper

* update CONTRIBUTING.md
@d4l3k
lighthouse, manager: support multiple quorum rooms (#48)
8247faf
@Jackmin801
[Chore] Couple of small chores (#49)
2bb8873 
* use working dir instead of cd

* urls

* add docs build to contributing

* upgrade gha step versions in lint

* remoce extra empty line in unit test

* use livehtml
@d4l3k
.github: add nightly wheel builds (#50)
551fc4e
@d4l3k
add pypi badge to README (#51)
168b363
@Jackmin801
compile -> compile_protos (#53)
a32f807
@fegin fegin closed this Dec 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@fegin @facebook-github-bot @d4l3k @H-Huang @Jackmin801