Search results

DeepSeek V3权重转换脚本存在bug

Status: Open.

#494 In alibaba/Pai-Megatron-Patch;

· keaidechen opened on Mar 7, 2025

使用0.10.3的代码测试DeepSeekV3，transformerengine运行报错

Status: Open.

#492 In alibaba/Pai-Megatron-Patch;

· MinhuiWan opened on Mar 7, 2025

qwen2.5-coder dense报错:AssertionError: Find unsupported keys in checkpoint

Status: Open.

#489 In alibaba/Pai-Megatron-Patch;

· elimsjxr opened on Mar 4, 2025

旧模型qwen1_5在新版本中不再支持了嘛？

Status: Open.

#488 In alibaba/Pai-Megatron-Patch;

· asr-sheep1 opened on Mar 3, 2025

什么时候可以支持多轮对话的sft啊

Status: Open.

#476 In alibaba/Pai-Megatron-Patch;

· Chunfeng1994 opened on Feb 24, 2025

H800 flashattention-3不支持deepseek

Status: Open.

#473 In alibaba/Pai-Megatron-Patch;

· leo-ztjht opened on Feb 23, 2025

deepseek-v3模型微调支持fp8训练么？

Status: Open.

#471 In alibaba/Pai-Megatron-Patch;

· renjie130 opened on Feb 21, 2025

deepseekv2转换误差

Status: Open.

#469 In alibaba/Pai-Megatron-Patch;

· liux750 opened on Feb 20, 2025

训练75模型，TP8,PP4，4张A800sft微调训练，总是报错torch.distributed.DistStoreError: Socket Timeout

Status: Open.

#468 In alibaba/Pai-Megatron-Patch;

· Chunfeng1994 opened on Feb 19, 2025

DeepSeek V3 负载均衡 bias

Status: Open.

#467 In alibaba/Pai-Megatron-Patch;

· yzlnew opened on Feb 17, 2025

对于多模态大模型的训练并行优化支撑

Status: Open.

#466 In alibaba/Pai-Megatron-Patch;

· liyang-7 opened on Feb 13, 2025

为什么llama-3.1权重转换时70B需要cpu_options="--use-cpu-initialization"，不会速度过慢吗

Status: Open.

#465 In alibaba/Pai-Megatron-Patch;

· kkkeepgoing opened on Feb 13, 2025