了解不考虑模型特性的情况下，模型训练和推理的过程中到底发生了什么
- Torch的使用和理解
- 学会用profiler观察timeline以分析cpu/gpu/通信的单活动或overlap情况
- overlap是指“相互重叠“
- nv GPU的基本特性的理解
- 集合通信引入
- 3D并行和实操
- huggingface使用
-
Notifications
You must be signed in to change notification settings - Fork 3
Antinomy20001/training_inference_from_scratch
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published