Skip to content

allow create Ray cluster with reduced dependency#125

Merged
dongwang218 merged 2 commits intomainfrom
add_verl
Jan 12, 2026
Merged

allow create Ray cluster with reduced dependency#125
dongwang218 merged 2 commits intomainfrom
add_verl

Conversation

@dongwang218
Copy link
Contributor

@dongwang218 dongwang218 commented Jan 6, 2026

Why ?

Start Ray cluster without the extra vllm dependency

How ?

Add ray as a optional dependency.

so now we have

  • client: pip install -e .
  • with ray: pip install -e .[ray] "ray[default,serve]==2.52.0"
  • with vllm: pip install -e .[vllm_0112]

Test plan

uv pip install -e .[ray] "ray[default,serve]==2.52.0"

matrix start_cluster --add_workers 1 --slurm '{"account": data, "qos": h100_lowest}'

matrix deploy_applications --applications '[{"name": hello, "app_type": "hello"}]'

matrix check_health --app_name hello


matrix deploy_applications --action add --applications "[{'name': 'container2', 'app_type': container, 'min_replica': 1, 'max_ongoing_requests':16, 'ray_resources': {'num_cpus': 1, 'num_gpus': 0.5}}]"

matrix check_health --app_name container2
output:     CUDA available: True Device count: 1 tensor([[0.3865, 2.2107, 0.4473],         [0.4179, 0.1789, 1.0019]], device='cuda:0')
returncode: 0

of course deploy vllm app will fail

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jan 6, 2026
@dongwang218 dongwang218 requested review from niansong1996, yangli5t and youssef-emad and removed request for swdanielli and yangli5t January 6, 2026 20:21
@dongwang218 dongwang218 changed the title allow create Ray cluster with minimal dependency allow create Ray cluster with reduced dependency Jan 6, 2026
@dongwang218 dongwang218 merged commit a2595fd into main Jan 12, 2026
8 checks passed
@dongwang218 dongwang218 deleted the add_verl branch January 12, 2026 19:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants