Describe the bug
The cloud-edge-collaborative-inference-for-llm example cannot be installed or run on macOS or CPU-only Linux machines. Running pip install -r requirements.txt fails completely.
The following issues were identified in the environment configuration:
vllm is listed as a hard dependency but is strictly Linux/CUDA only.
datamodel_code_generator is misspelled (PyPI uses hyphens, not underscores).
api_llm.py relies on retry, but it is missing from requirements.txt.
test_queryrouting.yaml default config runs vllm unconditionally instead of just huggingface.
Steps to reproduce
- Clone the
ianvs repository on a macOS or CPU-only environment.
- Navigate to
examples/cloud-edge-collaborative-inference-for-llm/.
- Run
pip install -r requirements.txt.
- Observe installation failure for
vllm and dependency errors.
Expected behavior
The requirements.txt should install cross-platform dependencies so the example runs out-of-the-box using the universally compatible huggingface backend. vllm should be treated as an optional backend parameter for Linux/CUDA users.
Describe the bug
The
cloud-edge-collaborative-inference-for-llmexample cannot be installed or run on macOS or CPU-only Linux machines. Runningpip install -r requirements.txtfails completely.The following issues were identified in the environment configuration:
vllmis listed as a hard dependency but is strictly Linux/CUDA only.datamodel_code_generatoris misspelled (PyPI uses hyphens, not underscores).api_llm.pyrelies onretry, but it is missing fromrequirements.txt.test_queryrouting.yamldefault config runsvllmunconditionally instead of justhuggingface.Steps to reproduce
ianvsrepository on a macOS or CPU-only environment.examples/cloud-edge-collaborative-inference-for-llm/.pip install -r requirements.txt.vllmand dependency errors.Expected behavior
The
requirements.txtshould install cross-platform dependencies so the example runs out-of-the-box using the universally compatiblehuggingfacebackend.vllmshould be treated as an optional backend parameter for Linux/CUDA users.