Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
17df5ff
zty-king add 2024.09.09~2024.09.23 WeeklyReport
zty-king Sep 29, 2024
669e851
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Sep 29, 2024
30268c5
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Oct 24, 2024
073d458
工作记录
zty-king Oct 24, 2024
8054dd6
[WeeklyReports] 2024.10.08~2024.10.21 周报汇总
zty-king Oct 24, 2024
258ce5f
Add mentor comments
From00 Nov 1, 2024
bba3aac
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Nov 4, 2024
b27ac46
[WeeklyReports]2024.10.22~2024.11.1.md
zty-king Nov 4, 2024
fe7d54f
Merge branch 'zty_king/WeeklyReport' of https://github.com/zty-king/C…
zty-king Nov 4, 2024
3e83bc4
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Nov 22, 2024
19ba3d7
[WeeklyReports]2024.10.28~2024.11.22.md
zty-king Nov 22, 2024
cf4c526
非均衡vpp切分_11.22-11.29周报记录
zty-king Nov 28, 2024
a5941fd
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Nov 28, 2024
72170fd
Update 非均衡vpp切分_2024.11.29.md
zty-king Nov 29, 2024
81fe712
vpp去尾策略
zty-king Dec 5, 2024
98c9829
Merge branch 'zty_king/WeeklyReport' of github.com:zty-king/Camp into…
zty-king Dec 5, 2024
a78320e
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Dec 12, 2024
cf50848
weeklyreports_2024.12.5-2024.12.12
zty-king Dec 12, 2024
87afabd
[WeeklyReports]2024_12.13-2024_12.20.md
zty-king Dec 20, 2024
abac036
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Feb 17, 2025
ff90321
Hackathon_8th
zty-king Feb 17, 2025
8896607
[WeeklyReports]_zty-king_2025_01.10~2025_02.16
zty-king Feb 17, 2025
96cde0f
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Mar 4, 2025
5e51127
[WeeklyReport] zty-king 2025.02.17~2025.03.02
zty-king Mar 4, 2025
373d465
Merge branch 'main' of https://github.com/PFCCLab/Camp into zty_king/…
zty-king Mar 17, 2025
a841abe
[WeeklyReports] 2025.3.3~2025.3.23 周报汇总
zty-king Mar 17, 2025
cd36a9a
[WeeklyReports]_2025_03.24-2025_04.06
zty-king Apr 8, 2025
4536444
[WeeklyReports]_2025_04.07-2025_04.27
zty-king Apr 24, 2025
62762b1
[WeeklyReports]_2025_04.28-2025_05.16
zty-king May 14, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
### 姓名
郑天宇

### 实习项目
静态图流水并行功能增强和性能优化

### 本周工作

1. **动半下实现多卡视角下的流水并行策略(即当前的流水并行是单卡视角下的)**

* 分析动半下流水并行的实现方法,尤其是1f1b,vpp等策略
* 分析动半下p2p通信的实现方法
2. **【Auto-Parallel | Comm】fix communication hang issue on GPU-H(VPP)**
* 存在一个bug,在计算loss时,会传入空的tensor,修复该bug

### 下周工作

1. 参考local_layer,以及pytorch的local_map,开发paddle的local_map



Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
### 姓名
郑天宇

### 实习项目
静态图流水并行功能增强和性能优化

### 本周工作

1. **参考local_layer,以及pytorch的local_map,开发paddle的local_map**
* 开发好了local_map
* 构造了多种单测验证
* 替换了paddle里的locallayer并验证
* 修复了之前locallayer的一个错误单测,验证了local_map对比动手和动半的相同效果
2. **【Auto-Parallel | Comm】fix communication hang issue on GPU-H(VPP)**
* 修复了计算loss时的空tensor
* 统一所有pp的job常量
* 将1F1B中切图类转化为切图函数,统一pp结构

### 下周工作

1. 在paddlemix和paddlenlp中,使用local_map替换locallayer,并验证有效性
2. 参与动态图的流水并行功能开发



Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
### 姓名
郑天宇

### 实习项目
静态图流水并行功能增强和性能优化

### 本周工作

1. **动态图的流水并行功能开发**
* 为开发的工具补充英文文档
* 为开发的工具测试bug,修复代码
* 为开发的工具新增多种单测
2. **护航计划汇报ppt制作**
* 已经将前期做完的工作均写完


### 下周工作

1. 继续为后续开发工具测试,完善单侧。



Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
### 姓名
郑天宇

### 实习项目
静态图流水并行功能增强和性能优化

### 本周工作

1. **动态图的流水并行功能开发**
* 为Enhance processmesh相关组件添加单测并补全英文文档。
* 为send/recv_object_list相关组件添加单测并补全英文文档
* 为microbatch相关组件添加单测
* 为lazy_init相关函数添加单测
* 为PipelineStage相关组件添加单测



### 下周工作

1. 继续为后续开发工具测试,完善单测。



Loading