Search results

DeepSpeed-FastGen support ascend npu?

Status: Open.

#960 In deepspeedai/DeepSpeedExamples;

· RyanOvO opened on Mar 4, 2025

Why Does vf_loss Take the Maximum Value, Rendering Clamp Meaningless?

Status: Open.

#956 In deepspeedai/DeepSpeedExamples;

· Morizhaoyang opened on Feb 7, 2025

Is there any example about DeepSpeed Zero with Ulysses/Ulysses-offload

Status: Open.

#951 In deepspeedai/DeepSpeedExamples;

· LSC527 opened on Jan 10, 2025

Domino + PP

Status: Open.

#950 In deepspeedai/DeepSpeedExamples;

· XZQshiyu opened on Jan 9, 2025

Assertion srcIndex < srcSelectDimSize failed

Status: Open.

#946 In deepspeedai/DeepSpeedExamples;

· boqiny opened on Dec 18, 2024

Question to attention computation

Status: Open.

#944 In deepspeedai/DeepSpeedExamples;

· yuzhenmao opened on Dec 15, 2024

KV_cache offload

Status: Open.

#943 In deepspeedai/DeepSpeedExamples;

· yuzhenmao opened on Dec 15, 2024

A bug in argument parser.

Status: Open.

#941 In deepspeedai/DeepSpeedExamples;

· ChenDaiwei-99 opened on Dec 10, 2024

How can I change the master_port when using deepspeed for multi-GPU on single node, i.e. localhost

Status: Open.

#936 In deepspeedai/DeepSpeedExamples;

· lovedoubledan opened on Nov 20, 2024

Does DeepSpeed's Pipeline-Parallelism optimizer supports skip connections?

Status: Open.

#932 In deepspeedai/DeepSpeedExamples;

· RoyMahlab opened on Oct 17, 2024

How to calculate training efficiency ,i.e tokens/sec of step 1 fine tuning of llama2 model ?

Status: Open.

#923 In deepspeedai/DeepSpeedExamples;

· sowmya04101998 opened on Aug 29, 2024

Actor loss nan and Resizing model embedding

Status: Open.

#922 In deepspeedai/DeepSpeedExamples;

· ouyanmei opened on Aug 29, 2024