Skip to content

Reorganization of ToC#2064

Draft
mtsokol wants to merge 1 commit intovllm-project:mainfrom
mtsokol:docs-reorg
Draft

Reorganization of ToC#2064
mtsokol wants to merge 1 commit intovllm-project:mainfrom
mtsokol:docs-reorg

Conversation

@mtsokol
Copy link
Copy Markdown

@mtsokol mtsokol commented Mar 27, 2026

Hi @RobMulla,

Here's a new structure of the docs for vLLM-TPU. It's divided into three main sections:

  • Getting Started - a minimal set of actions to run an inference tasks with vLLM on a TPU.
  • Basic Usage - for users with supported HF models, deploying it on a single TPU manually, or GCE cluster.
  • Advanced Usage - for power users / developers wanting to run inference on a custom JAX/Torch models on a single TPU or GCE.

It's proposed based on this tree:

image

Signed-off-by: Mateusz Sokół <mat646@gmail.com>
@mtsokol mtsokol marked this pull request as draft March 27, 2026 15:53
@RobMulla RobMulla self-requested a review April 1, 2026 14:24
@RobMulla
Copy link
Copy Markdown
Collaborator

RobMulla commented Apr 1, 2026

Thanks @mtsokol for your work on this!

@bvrockwell and @ica-chao - these are some of the docs re-organization we are working on to streaming UX. Separate than our support matrix work. When you have a chance could you review?

Rendered docs can be found here (or the link in the CI/CD of this PR) - https://vllm--2064.org.readthedocs.build/projects/tpu/en/2064/ and you can toggle the diff to see whats changed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants