This repository has been archived and is no longer maintained. We have created ray.serve.llm and ray.data.llm APIs to simplify deployment of LLMs on top of Ray. These APIs are now directly integrated into Ray and managed by the Ray team. The history of this repository is moved to archived-master branch only for historical context.
This repository was archived by the owner on Mar 13, 2025. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 92
RayLLM - LLMs on Ray (Archived). Read README for more info.
ray-project/ray-llm
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
RayLLM - LLMs on Ray (Archived). Read README for more info.