Skip to content

Add a workflow to run vLLM unit tests on H100 - #55

Merged
huydhn merged 6 commits into
mainfrom
vllm-test
Aug 5, 2025
Merged

Add a workflow to run vLLM unit tests on H100#55
huydhn merged 6 commits into
mainfrom
vllm-test

Conversation

@huydhn

@huydhn huydhn commented Jul 26, 2025

Copy link
Copy Markdown
Contributor

This is a temporary workflow to run some vLLM unit tests on H100 until we have that runner on vLLM. As this is a workflow on PyTorch side and our H100 capacity is limited, we could only run the test:

  • Manually on a vLLM PR:
  • or periodically on vLLM main commit every 4 hours
    • You can get the vLLM main commit from the Docker image name in the following format public.ecr.aws/q9t5s3a7/vllm-ci-postmerge-repo:<COMMIT>, for example, GH logs

More tests can be added into .github/scripts/run_vllm_tests.sh, I use pytest -v models/multimodal/generation/test_maverick.py as a simple example. All the features like test sharding or model caching are not available at the moment, but this is a start.

Testing

https://github.com/pytorch/pytorch-integration-testing/actions/runs/16535983273/job/46770512704?pr=55#step:8:214

Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Huy Do <huydhn@gmail.com>
@huydhn
huydhn temporarily deployed to pytorch-x-vllm July 26, 2025 04:02 — with GitHub Actions Inactive
Signed-off-by: Huy Do <huydhn@gmail.com>
@huydhn
huydhn temporarily deployed to pytorch-x-vllm July 26, 2025 04:16 — with GitHub Actions Inactive
@huydhn
huydhn marked this pull request as ready for review July 26, 2025 04:16
@huydhn
huydhn requested review from houseroad and yangw-dev July 26, 2025 04:22
huydhn added 2 commits July 25, 2025 21:52
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Huy Do <huydhn@gmail.com>
@huydhn
huydhn temporarily deployed to pytorch-x-vllm July 26, 2025 04:53 — with GitHub Actions Inactive

@yangw-dev yangw-dev left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@huydhn
huydhn merged commit c094618 into main Aug 5, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants