We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent c143b39 commit f384b2aCopy full SHA for f384b2a
2 files changed
README.md
@@ -0,0 +1,23 @@
1
+使用下面命令下载并运行推理服务
2
+
3
+```
4
+docker pull ghcr.io/lj-hao/rk3588-deepseek-r1-distill-qwen:1.5b-w8a8-latest
5
6
+docker run -it --name deepseek-r1-1.5b --privileged --net=host --device /dev/dri --device /dev/dma_heap --device /dev/rknpu --device /dev/mali0 -v /dev:/dev ghcr.io/lj-hao/rk3588-deepseek-r1-distill-qwen:1.5b-w8a8-latest
7
8
9
10
+使用下面命令来测试:
11
12
13
+curl http://127.0.0.1:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
14
+"messages": [
15
+{"role": "user", "content": "请解释一下相对论的基本概念。"}
16
+],
17
+"n_keep": 0,
18
+"cache_prompt": false,
19
+"id_slot": 0,
20
+"n_predict": 512,
21
+"stream": true
22
+}'
23
0 commit comments