2024年5月20日10:35:04
author : binghong Pan,
| n-layer | 模型层数 | |
|---|---|---|
| d-model | 模型残差输出维度大小 | |
| d-ff | 前馈神经网络输出维度大小 | |
| d-attn | 注意力网络输出维度大小 | |
| n-heads | 每一层的多头注意力的数量 | |
| n-ctx | 输入的上下文长度大小 |
-
Notifications
You must be signed in to change notification settings - Fork 0
Panda-Panda-new/Computing-Large-Language-Models-Takes-Up-GPU-Memory
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
开发计算大语言模型训练/推理阶段占用GPU显存工具
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published