Skip to content

Commit f384b2a

Browse files
committed
update: api formate
1 parent c143b39 commit f384b2a

2 files changed

Lines changed: 195 additions & 458 deletions

File tree

README.md

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
使用下面命令下载并运行推理服务
2+
3+
```
4+
docker pull ghcr.io/lj-hao/rk3588-deepseek-r1-distill-qwen:1.5b-w8a8-latest
5+
6+
docker run -it --name deepseek-r1-1.5b --privileged --net=host --device /dev/dri --device /dev/dma_heap --device /dev/rknpu --device /dev/mali0 -v /dev:/dev ghcr.io/lj-hao/rk3588-deepseek-r1-distill-qwen:1.5b-w8a8-latest
7+
8+
```
9+
10+
使用下面命令来测试:
11+
12+
```
13+
curl http://127.0.0.1:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
14+
"messages": [
15+
{"role": "user", "content": "请解释一下相对论的基本概念。"}
16+
],
17+
"n_keep": 0,
18+
"cache_prompt": false,
19+
"id_slot": 0,
20+
"n_predict": 512,
21+
"stream": true
22+
}'
23+
```

0 commit comments

Comments
 (0)