Skip to content

[Feature] Support prompt cache retention policies for tiered KV offloading#48704

Draft
chaunceyjiang wants to merge 1 commit into
vllm-project:mainfrom
chaunceyjiang:default_prompt_cache_retention
Draft

[Feature] Support prompt cache retention policies for tiered KV offloading#48704
chaunceyjiang wants to merge 1 commit into
vllm-project:mainfrom
chaunceyjiang:default_prompt_cache_retention

Conversation

@chaunceyjiang

@chaunceyjiang chaunceyjiang commented Jul 15, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Collaborator

Purpose

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.

@chaunceyjiang
[Feature] Support prompt cache retention policies for tiered KV offlo…
887f8b8 
…ading

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
@mergify

mergify Bot commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

Documentation preview: https://vllm--48704.org.readthedocs.build/en/48704/

@mergify mergify Bot added documentation Improvements or additions to documentation frontend v1 tool-calling labels Jul 15, 2026
@mergify mergify Bot added the kv-connector label Jul 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@aarnphm aarnphm Awaiting requested review from aarnphm aarnphm will be requested when the pull request is marked ready for review aarnphm is a code owner
@sfeng33 sfeng33 Awaiting requested review from sfeng33 sfeng33 will be requested when the pull request is marked ready for review sfeng33 is a code owner
@bbrowning bbrowning Awaiting requested review from bbrowning bbrowning will be requested when the pull request is marked ready for review bbrowning is a code owner
@ApostaC ApostaC Awaiting requested review from ApostaC ApostaC will be requested when the pull request is marked ready for review ApostaC is a code owner
@orozery orozery Awaiting requested review from orozery orozery will be requested when the pull request is marked ready for review orozery is a code owner
@ivanium ivanium Awaiting requested review from ivanium ivanium will be requested when the pull request is marked ready for review ivanium is a code owner
@DarkLight1337 DarkLight1337 Awaiting requested review from DarkLight1337 DarkLight1337 will be requested when the pull request is marked ready for review DarkLight1337 is a code owner
@russellb russellb Awaiting requested review from russellb russellb will be requested when the pull request is marked ready for review russellb is a code owner
@NickLucche NickLucche Awaiting requested review from NickLucche NickLucche will be requested when the pull request is marked ready for review NickLucche is a code owner
@xuechendi xuechendi Awaiting requested review from xuechendi xuechendi will be requested when the pull request is marked ready for review xuechendi is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

documentation Improvements or additions to documentation frontend kv-connector tool-calling v1

Projects

Tool Calling
Status: No status

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@chaunceyjiang