A proxy for vLLM.
# Run production server
uvicorn main:app --host 0.0.0.0 --reload
# Run development server
fastapi dev main.py --host 0.0.0.0bash docker/build.shcd docker
docker compose up -dcd src
python -m unittest testsFiles
Failed to load latest commit information.
vllm-proxy
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
parent directory.. | ||||