Skip to content

Commit b3718d1

Browse files
Fix String formatting
1 parent cc0a1f1 commit b3718d1

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

tests/model_serving/model_runtime/vllm/speculative_decoding/test_granite_7b_lab_draft.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@
1717
"--model=/mnt/models/granite-7b-instruct",
1818
"--uvicorn-log-level=debug",
1919
"--dtype=float16",
20-
'--speculative_config={"model": "/mnt/models/granite-7b-instruct-accelerator","num_speculative_tokens": 5}',
20+
"--speculative_config={\"model\": \"/mnt/models/granite-7b-instruct-accelerator\", \"num_speculative_tokens\": 5}",
2121
"--use-v2-block-manager",
2222
]
2323

tests/model_serving/model_runtime/vllm/speculative_decoding/test_granite_7b_lab_ngram.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@
1717
"--model=/mnt/models",
1818
"--uvicorn-log-level=debug",
1919
"--dtype=float16",
20-
'--speculative_config={"model": "ngram","num_speculative_tokens": 5, "prompt_lookup_max": 4}',
20+
"--speculative_config={\"model\": \"ngram\", \"num_speculative_tokens\": 5, \"prompt_lookup_max\": 4}",
2121
"--use-v2-block-manager",
2222
]
2323

0 commit comments

Comments
 (0)