Replies: 2 comments 5 replies
-
|
Done! |
Beta Was this translation helpful? Give feedback.
-
|
Ca I know what gguf file do you use for R1:671B? ( I mean where the file you get ) |
Beta Was this translation helpful? Give feedback.
-
|
For my case，i ran Unsloth Q4KM (downlaoded from Hugging Face) |
Beta Was this translation helpful? Give feedback.
-
|
We have done it!!!! |
Beta Was this translation helpful? Give feedback.
-
|
Do you have optimize_rules for DeepSeek-R1 ? |
Beta Was this translation helpful? Give feedback.
-
|
May I ask when the Deepseek model with Q1 quantization can be supported? Please, I really need it... |
Beta Was this translation helpful? Give feedback.
-
I think it is working |
Beta Was this translation helpful? Give feedback.
-
Can this model run smoothly on my server with 2 RTX 4090s and 256GB of RAM?
Beta Was this translation helpful? Give feedback.
All reactions