Skip to content

Commit 41868f7

Browse files
authored
[tutorial] polish README and OPT files (#1930)
* [tutorial] polish README and OPT files * [tutorial] polish README and OPT files * [tutorial] polish README and OPT files
1 parent b0b7a78 commit 41868f7

File tree

6 files changed

+2
-264
lines changed

6 files changed

+2
-264
lines changed

examples/tutorial/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -44,15 +44,15 @@ pip install colossalai==0.1.11+torch1.12cu11.3 -f https://release.colossalai.org
4444
- Try sequence parallelism with BERT
4545
- Combination of data/pipeline/sequence parallelism
4646
- Faster training and longer sequence length
47-
- Large Batch Training Optimization
47+
- Large Batch Training Optimization
4848
- Comparison of small/large batch size with SGD/LARS optimizer
4949
- Acceleration from a larger batch size
5050
- Auto-Parallelism
5151
- Parallelism with normal non-distributed training code
5252
- Model tracing + solution solving + runtime communication inserting all in one auto-parallelism system
5353
- Try single program, multiple data (SPMD) parallel with auto-parallelism SPMD solver on ResNet50
5454
- Fine-tuning and Serving for OPT
55-
- Try OPT model imported from Hugging Face with Colossal-AI
55+
- Try pre-trained OPT model weights with Colossal-AI
5656
- Fine-tuning OPT with limited hardware using ZeRO, Gemini and parallelism
5757
- Deploy the fine-tuned model to inference service
5858
- Acceleration of Stable Diffusion

examples/tutorial/opt/README.md

Lines changed: 0 additions & 1 deletion
This file was deleted.

examples/tutorial/opt/zero/README.md

Lines changed: 0 additions & 16 deletions
This file was deleted.

examples/tutorial/opt/zero/requirements.txt

Lines changed: 0 additions & 3 deletions
This file was deleted.

examples/tutorial/opt/zero/run.sh

Lines changed: 0 additions & 1 deletion
This file was deleted.

examples/tutorial/opt/zero/train_gpt_demo.py

Lines changed: 0 additions & 241 deletions
This file was deleted.

0 commit comments

Comments
 (0)