Skip to content

Support running disaggregated PD on Kind#121

Merged
vMaroon merged 10 commits intomainfrom
kind-pd
May 19, 2025
Merged

Support running disaggregated PD on Kind#121
vMaroon merged 10 commits intomainfrom
kind-pd

Conversation

@shmuelk
Copy link
Collaborator

@shmuelk shmuelk commented May 19, 2025

This PR adds the ability to run disaggregated PD (albeit truly only from the perspective of the endpoint picker) under kind.

The deploy/environment/kind-istio has been refactored to enable reuse between two different "environments" one without PD and one with PD. In which ultimately, the only differences are with the deployment(s) of the vLLM simulator.

This PR also fixes a small timing issue that caused the cluster setup to fail on MacOS.

shmuelk added 8 commits May 19, 2025 16:40
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
shmuelk added 2 commits May 19, 2025 17:35
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>
@vMaroon vMaroon merged commit 14d7874 into main May 19, 2025
1 check passed
@vMaroon vMaroon deleted the kind-pd branch May 19, 2025 14:52
Jooho referenced this pull request in Jooho/llm-d-inference-scheduler Sep 17, 2025
Signed-off-by: konflux-internal-p02 <170854209+konflux-internal-p02[bot]@users.noreply.github.com>
Co-authored-by: konflux-internal-p02[bot] <170854209+konflux-internal-p02[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants