Skip to content

Commit 67e1eab

Browse files
author
rakshaak29
committed
fix(cloud-edge-llm): fix environment setup crashes and dependency typos
Signed-off-by: rakshaak29 <rakshak29@gmail.com>
1 parent db8e08a commit 67e1eab

File tree

2 files changed

+5
-4
lines changed

2 files changed

+5
-4
lines changed
Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,8 @@
1-
vllm
21
transformers
32
openai
43
accelerate
5-
datamodel_code_generator
4+
datamodel-code-generator
65
kaggle
7-
groq
6+
groq
7+
retry
8+
torch

examples/cloud-edge-collaborative-inference-for-llm/testalgorithms/query-routing/test_queryrouting.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ algorithm:
3232
# 5> "LadeSepcDec": Lookahead Decoding framework;
3333
values:
3434
- "huggingface"
35-
- "vllm"
35+
# - "vllm" # Uncomment for Linux + CUDA environments only
3636
# - "EagleSpecDec"
3737

3838
# If you're using speculative models, uncomment the following lines:

0 commit comments

Comments
 (0)