Commit f0027d6

and

github-actions[bot]

authored

chore: move to newer version of vllm (#120)

Signed-off-by: Aaron Pham <[email protected]> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

1 parent 3713934 commit f0027d6Copy full SHA for f0027d6

3,999 files changed

+47767

-47093

lines changed

.github
- README.md
bentoml/bentos
- deepseek
  - prover-v2-671b-f7ad
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-671b-3936
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-671b-d485
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-llama3.1-8b-17ac
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-llama3.1-8b-d683
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-llama3.3-70b-2a19
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-llama3.3-70b-2dd7
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-llama3.3-70b-w4a16-a076
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-llama3.3-70b-w4a16-dd79
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-llama3.3-70b-w8a8-275a
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-llama3.3-70b-w8a8-7248
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-14b-26db
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-14b-3fde
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-14b-w4a16-5335
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-14b-w4a16-79af
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-14b-w8a8-52ec
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-14b-w8a8-6bdd
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-32b-ab4f
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-32b-b3e6
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-32b-w4a16-4532
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-32b-w4a16-764e
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-32b-w8a8-8029
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-32b-w8a8-fbd2
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-7b-math-2b54
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - r1-distill-qwen2.5-7b-math-af5d
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - v3-671b-090c
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - v3-671b-4db7
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
- gemma2
  - 27b-instruct-399d
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 27b-instruct-95fb
  - 2b-instruct-4479
  - 2b-instruct-5ebf
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 9b-instruct-7899
  - 9b-instruct-c46b
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
- gemma3
  - 12b-instruct-c598
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 12b-instruct-d4e0
  - 1b-instruct-01d6
  - 1b-instruct-53b6
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 27b-instruct-36c4
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 27b-instruct-a9ba
  - 4b-instruct-0b56
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 4b-instruct-5620
- hermes-3
  - deep-llama3-8b-248e
  - deep-llama3-8b-d39a
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - llama3.1-405b-instruct-0b3b
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - llama3.1-405b-instruct-2bb5
- jamba1.5
  - large-7350
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - large-d82e
  - mini-0357
  - mini-5076
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
- llama3.1
  - 8b-instruct-239c
  - 8b-instruct-f4ac
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
- llama3.2
  - 11b-vision-instruct-2fab
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 11b-vision-instruct-f457
  - 1b-instruct-071f
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 1b-instruct-c665
  - 3b-instruct-cbd4
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 3b-instruct-d883
  - 90b-vision-instruct-882c
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 90b-vision-instruct-9d8b
- llama3.3
  - 70b-instruct-c914
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 70b-instruct-c968
- llama4
  - 17b-128e-maverick-instruct-fp8-2960
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 17b-128e-maverick-instruct-fp8-a264
  - 17b-16e-scout-instruct-60e2
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 17b-16e-scout-instruct-73f7
- mistral-large
  - 123b-instruct-2407-4221
  - 123b-instruct-2407-b5b6
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
- mistral
  - 24b-small-instruct-2501-0b70
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 24b-small-instruct-2501-4045
  - 8b-instruct-983c
  - 8b-instruct-ce45
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
- phi4
  - 14b-110f
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-5f46
- pixtral
  - 124b-2411-4f09
  - 124b-2411-6d46
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 12b-2409-0e0a
  - 12b-2409-595c
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
- qwen2.5-coder
  - 14b-instruct-20f5
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-instruct-awq-1882
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-instruct-awq-7ef4
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-instruct-e540
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-instruct-gptq-w4a16-238e
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-instruct-gptq-w4a16-ef10
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-instruct-gptq-w8a8-1502
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-instruct-gptq-w8a8-2b56
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 32b-instruct-57b7
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 32b-instruct-8d05
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 3b-instruct-6dd3
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 3b-instruct-9135
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 7b-instruct-92ec
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 7b-instruct-awq-6bab
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 7b-instruct-awq-aa24
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 7b-instruct-e653
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 7b-instruct-gptq-w4a16-b095
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 7b-instruct-gptq-w4a16-c518
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 7b-instruct-gptq-w8a8-4007
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src
  - 7b-instruct-gptq-w8a8-8dcb
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
- qwen2.5
  - 14b-instruct-600b
    - README.md
    - apis
      - openapi.yaml
    - bento.yaml
    - env
      - docker
        Dockerfile
      - python
        requirements.in
        requirements.txt
    - src
  - 14b-instruct-6f05
    - README.md
    - apis
      - openapi.yaml
      - schema.json
    - bento.yaml
    - env
      - docker
        Dockerfile
        entrypoint.sh
      - python
        requirements.in
        requirements.txt
    - src

3,999 files changed

+47767

-47093

lines changed

`‎.github/README.md‎`

Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

`‎bentoml/bentos/deepseek/prover-v2-671b-f7ad/README.md‎`

Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

Comments

(0)