What is auto-parallel training ? #2057

Unanswered

GxjGit asked this question in Community | Q&A

GxjGit
Dec 1, 2022

What is the specific function of automatic parallel connection? Is there any related detailed introduction or use demo?

Replies: 1 comment

binmakeswell
May 5, 2023
Maintainer

Hi @GxjGit You can refer to
https://arxiv.org/abs/2302.02599
https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/gpt/experiments/auto_parallel
https://github.com/hpcaitech/ColossalAI/tree/main/examples/tutorial/auto_parallel

0 replies

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment