File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed
Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -4,7 +4,7 @@ description: Learn how to chat with DeepSeek-R1-Distill ONNX models on your devi
44has_children : false
55parent : Tutorials
66grand_parent : Generate API (Preview)
7- nav_order :
7+ nav_order : 4
88---
99
1010# Reasoning in Python with DeepSeek-R1-Distill models
@@ -53,4 +53,4 @@ python model-chat.py -m deepseek-r1-distill-qwen-1.5B/model -e cpu --chat_templa
5353``` bash
5454# GPU Chat inference. If you pulled the model from huggingface, adjust the model directory (-m) accordingly
5555curl -o https://raw.githubusercontent.com/microsoft/onnxruntime-genai/refs/heads/main/examples/python/model-chat.py
56- python model-chat.py -m deepseek-r1-distill-qwen-1.5B/model -e cuda --chat_template " <|begin▁of▁sentence|><|User|>{input}<|Assistant|>"
56+ python model-chat.py -m deepseek-r1-distill-qwen-1.5B/model -e cuda --chat_template " <|begin▁of▁sentence|><|User|>{input}<|Assistant|>"
You can’t perform that action at this time.
0 commit comments