Search results

[QUESTION] The dataset cannot be found in multi-node multi-GPU training.

Status: Open.

#1355 In NVIDIA/Megatron-LM;

· stay88 opened on Jan 13, 2025

[QUESTION] Limit Number of Saved Checkpoints

Status: Open.

#1354 In NVIDIA/Megatron-LM;

· GuokunWang opened on Jan 13, 2025

[BUG]

Status: Open.

#1353 In NVIDIA/Megatron-LM;

· lawchingman opened on Jan 11, 2025

[BUG] can't load saved fp8 checkpoint when resume training

Status: Open.

#1350 In NVIDIA/Megatron-LM;

· switiz opened on Jan 8, 2025

[BUG] Using fp16 uses more memory than using fp32

Status: Open.

#1349 In NVIDIA/Megatron-LM;

· eliird opened on Jan 8, 2025

[BUG] When trying to convert llama2-7b model from HF format to megatron format

Status: Open.

#1348 In NVIDIA/Megatron-LM;

· Sun2018421 opened on Jan 6, 2025

[QUESTION] Typo in MoE README

Status: Open.

#1346 In NVIDIA/Megatron-LM;

· rgtjf opened on Jan 4, 2025

[QUESTION] Resume training about dataset

Status: Open.

#1343 In NVIDIA/Megatron-LM;

· JiwenJ opened on Jan 2, 2025

[QUESTION] Expert Parallelism with Non-Identical Experts

Status: Open.

#1342 In NVIDIA/Megatron-LM;

· kevin3567 opened on Jan 1, 2025

[QUESTION]"a2a+p2p" for context parallel(cp)

Status: Open.

#1341 In NVIDIA/Megatron-LM;

· heavyrain-lzy opened on Dec 27, 2024

[QUESTION]How to convert the weight file format of the MAMBA model from pt to safetensors format?

Status: Open.

#1339 In NVIDIA/Megatron-LM;

· fxnie opened on Dec 26, 2024

[QUESTION] Why mixral use Llama2Tokenizer?

Status: Open.

#1338 In NVIDIA/Megatron-LM;

· DemingCheng opened on Dec 25, 2024