Skip to content

(WIP) DeepseekV3 (and Multi-Head Latent Attention) #2012

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ysjprojects wants to merge 25 commits into from

[pre-commit.ci] auto fixes from pre-commit.com hooks

dcc89de
Select commit
Loading
Failed to load commit list.
Closed

(WIP) DeepseekV3 (and Multi-Head Latent Attention) #2012

[pre-commit.ci] auto fixes from pre-commit.com hooks
dcc89de
Select commit
Loading
Failed to load commit list.
Azure Pipelines / litGPT failed May 16, 2025 in 10m 29s

Build #GPU tests failed

3 errors / 0 warnings

Annotations

Check failure on line 67 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / litGPT

Build log #L67 

Bash exited with code '2'.

Check failure on line 118 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / litGPT

Build log #L118 

Bash exited with code '1'.

Check failure on line 69 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / litGPT

Build log #L69 

Bash exited with code '2'.
View more details on Azure Pipelines