File tree Expand file tree Collapse file tree 1 file changed +6
-6
lines changed
Expand file tree Collapse file tree 1 file changed +6
-6
lines changed Original file line number Diff line number Diff line change @@ -534,12 +534,12 @@ We are able to reproduce Deepseek's reported results on the LiveCodeBench code g
534534
535535| Model | LiveCodeBench (🤗 LightEval) | LiveCodeBench (DeepSeek Reported) |
536536| :------------------------------| :----------------------------:| :--------------------------------:|
537- | DeepSeek-R1-Distill-Qwen-1.5B | 16.3 | 16.9 |
538- | DeepSeek-R1-Distill-Qwen-7B | 36.6 | 37.6 |
539- | DeepSeek-R1-Distill-Qwen-14B | 51.5 | 53.1 |
540- | DeepSeek-R1-Distill-Qwen-32B | 56.6 | 57.2 |
541- | DeepSeek-R1-Distill-Llama-8B | 37.0 | 39.6 |
542- | DeepSeek-R1-Distill-Llama-70B | 54.5 | 57.5 |
537+ | DeepSeek-R1-Distill-Qwen-1.5B | 16.1 | 16.9 |
538+ | DeepSeek-R1-Distill-Qwen-7B | 37.4 | 37.6 |
539+ | DeepSeek-R1-Distill-Qwen-14B | 51.3 | 53.1 |
540+ | DeepSeek-R1-Distill-Qwen-32B | 56.0 | 57.2 |
541+ | DeepSeek-R1-Distill-Llama-8B | 37.4 | 39.6 |
542+ | DeepSeek-R1-Distill-Llama-70B | 55.9 | 57.5 |
543543
544544To reproduce these results use the following command:
545545
You can’t perform that action at this time.
0 commit comments