fix(deps): update module github.com/llm-d/llm-d-kv-cache-manager to v0.6.1

[red-hat-konflux]

This PR contains the following updates:

Package	Change	Age	Confidence
github.com/llm-d/llm-d-kv-cache-manager	v0.3.1 -> v0.6.1

---

Warning

Some dependencies could not be looked up. Check the warning logs for more information.

---

Release Notes

llm-d/llm-d-kv-cache-manager (github.com/llm-d/llm-d-kv-cache-manager)

v0.6.1

Compare Source

Patch release on top of v0.6.0 to fix tokenization service health probe issue, and update fs-connector to work with vLLM v0.15.1 (llm-d v0.5.1 version).

Full Changelog: llm-d/llm-d-kv-cache@v0.6.0...v0.6.1

v0.6.0

Compare Source

This release finalized the removal of Python dependency and containment of tokenization/preprocessing in the UDS tokenization service, along with initial Otel tracing support.

What's Changed

• Switch to pre-built vLLM wheels for CPU builds by @​sagearc in llm-d/llm-d-kv-cache#268
• fix: Update storage connector to support vllm v0.14.1 by @​kfirtoledo in llm-d/llm-d-kv-cache#269
• Fix vllm ci by @​hyeongyun0916 in llm-d/llm-d-kv-cache#265
• Optimize get_file_name to improve lookup performance by @​rshavitt in llm-d/llm-d-kv-cache#264
• build: Add a wheel creation for the release by @​kfirtoledo in llm-d/llm-d-kv-cache#270
• Refactor: Replace daulet/tokenizers with vLLM tokenizer by @​hyeongyun0916 in llm-d/llm-d-kv-cache#254
• build: split wheel build into a separate GitHub Actions workflow by @​kfirtoledo in llm-d/llm-d-kv-cache#272
• cleanup: remove deprecated daulet tokenizer by @​hyeongyun0916 in llm-d/llm-d-kv-cache#274
• fix: Fix block_hash to use big-endian by @​kfirtoledo in llm-d/llm-d-kv-cache#282
• fix: Truncate prompt if truncate_prompt_tokens set in request by @​albertoperdomo2 in llm-d/llm-d-kv-cache#281
• Test and document extra field type support by @​albertoperdomo2 in llm-d/llm-d-kv-cache#273
• fix: Fix CI wheels to support arm64 by @​kfirtoledo in llm-d/llm-d-kv-cache#279
• refactor: align tokenizer interface with vLLM architecture by @​hyeongyun0916 in llm-d/llm-d-kv-cache#278
• docs: Add usage example to UDS tokenization service by @​sagearc in llm-d/llm-d-kv-cache#294
• Remove deprecated prefixstore by @​sagearc in llm-d/llm-d-kv-cache#296
• misc: UDS server mock for testing and UDS tokenizer unit tests by @​sagearc in llm-d/llm-d-kv-cache#297
• feat: FS backend structured logger by @​albertoperdomo2 in llm-d/llm-d-kv-cache#300
• refactor: isolate embedded tokenizers behind build tags by @​sagearc in llm-d/llm-d-kv-cache#303
• build: enable image build for uds service by @​zdtsw in llm-d/llm-d-kv-cache#307
• 🌱 Standardize governance workflows, tooling, and Dependabot by @​clubanderson in llm-d/llm-d-kv-cache#311
• 🌱 Remove legacy typo and link checker workflows by @​clubanderson in llm-d/llm-d-kv-cache#324
• update(build): UDS dockerfile enhancement + github workflow by @​zdtsw in llm-d/llm-d-kv-cache#328
• ci: add service UDS tokenizer tests by @​sagearc in llm-d/llm-d-kv-cache#335
• test: e2e tests against uds (tcp) tokenization service by @​sagearc in llm-d/llm-d-kv-cache#334
• feat: configurable tokenizers directory by @​sagearc in llm-d/llm-d-kv-cache#340
• fix: markdown lint by @​zdtsw in llm-d/llm-d-kv-cache#338
• build: Add pre-commit checks to CI by @​kfirtoledo in llm-d/llm-d-kv-cache#342
• PVC Evictor by @​guygir in llm-d/llm-d-kv-cache#215
• Initial distributed tracing instrumentation by @​sallyom in llm-d/llm-d-kv-cache#48
• add @​liu-cong to maintainers by @​vMaroon in llm-d/llm-d-kv-cache#360
• fix: increase gRPC keepalive ping interval to match server minimum by @​pierDipi in llm-d/llm-d-kv-cache#363
• update: change make target for tests to only run UDS and add support for podman by @​zdtsw in llm-d/llm-d-kv-cache#354
• fix: github action re-run not working + bump version by @​zdtsw in llm-d/llm-d-kv-cache#355
• feat: add map for UDS for local model by @​zdtsw in llm-d/llm-d-kv-cache#352
• deps(go): bump the kubernetes group with 3 updates by @​dependabot[bot] in llm-d/llm-d-kv-cache#350
• Remove services/ exclusion from pre-commit checks by @​yankay in llm-d/llm-d-kv-cache#362
• Ignore large reformatting PRs in git blame by @​yankay in llm-d/llm-d-kv-cache#364

New Contributors

• @​rshavitt made their first contribution in llm-d/llm-d-kv-cache#264
• @​albertoperdomo2 made their first contribution in llm-d/llm-d-kv-cache#281
• @​zdtsw made their first contribution in llm-d/llm-d-kv-cache#307
• @​sallyom made their first contribution in llm-d/llm-d-kv-cache#48
• @​dependabot[bot] made their first contribution in llm-d/llm-d-kv-cache#350

Full Changelog: llm-d/llm-d-kv-cache@v0.5.0...v0.6.0

v0.5.0

Compare Source

High-Level Summary

• vLLM-native tokenization & chat-completions: Tokenization and chat-template rendering are now aligned on vLLM, taking a major step towards complete and disaggregated tokenization.
• LoRA aware KV-Cache indexing / multi-model setups: KV-block hashing and events were updated to properly isolate and reuse KV across LoRA adapters.
• KVEvents maturation: Automatic vLLM pod discovery and improved ZMQ subscription management enable more reliable event-driven KV workflows, and active-active multi-replica scheduler HA.
• Storage offloading connector landed: CPU and storage-based KV offloading support is now in-tree, forming the foundation for tiered KV-cache architectures.
• Production hardening: Redis, indexing, CI, and build reliability were significantly improved to support stable large-scale deployments.

What's Changed

• add metrics for tokenizaion and rendering chat template by @​delavet in llm-d/llm-d-kv-cache#185
• refactor: Redis memory optimization and test reliability improvements by @​natoscott in llm-d/llm-d-kv-cache#196
• feat: Simplify tokenization prefix store to single-model architecture by @​sagearc in llm-d/llm-d-kv-cache#182
• [KV-Events] Add vLLM KV cache events demo with ZMQ listener by @​sagearc in llm-d/llm-d-kv-cache#162
• build: Enable clang-format for CUDA and C++ sources by @​kfirtoledo in llm-d/llm-d-kv-cache#197
• Remove redundant documentation by @​vMaroon in llm-d/llm-d-kv-cache#198
• fix: Enable local tokenizer chat template rendering by @​pierDipi in llm-d/llm-d-kv-cache#186
• fix: The call to the tokenizer service may be canceled in advance. by @​delavet in llm-d/llm-d-kv-cache#201
• feat(kvblock): decouple key handling in index by @​hhk7734 in llm-d/llm-d-kv-cache#202
• rename package name by @​setsunakute in llm-d/llm-d-kv-cache#209
• fix: restore log output for examples and unit tests by @​yankay in llm-d/llm-d-kv-cache#214
• cleanup: remove redundant warnings from make build by @​yankay in llm-d/llm-d-kv-cache#216
• fix: Single tokenizer initialization at startup by @​sagearc in llm-d/llm-d-kv-cache#192
• remove manager from docs and readme by @​setsunakute in llm-d/llm-d-kv-cache#205
• feat: include model name in KVBlock key hash by @​sagearc in llm-d/llm-d-kv-cache#220
• [fs_connector][feat]: Add NUMA management module by @​kfirtoledo in llm-d/llm-d-kv-cache#177
• [CI] Add CI workflow to run and verify examples by @​yankay in llm-d/llm-d-kv-cache#217
• fix(kvcache): move in-memory indexer to fallback to respect external configs by @​hyeongyun0916 in llm-d/llm-d-kv-cache#227
• Limit task requeue retries on faiures by @​alpe in llm-d/llm-d-kv-cache#224
• fix(redis): atomic engine key eviction to prevent race condition by @​sagearc in llm-d/llm-d-kv-cache#233
• docs: update examples configuration by @​sagearc in llm-d/llm-d-kv-cache#231
• docs: update tokenization pool configuration by @​sagearc in llm-d/llm-d-kv-cache#230
• Async tokenize exec by @​alpe in llm-d/llm-d-kv-cache#225
• [fs_connector][feat]: Add file management module (file_io) for fs connector by @​kfirtoledo in llm-d/llm-d-kv-cache#176
• [build]: Add pre-commit config by @​kfirtoledo in llm-d/llm-d-kv-cache#239
• refactor: Update BlockStored KVEvent by @​sagearc in llm-d/llm-d-kv-cache#237
• Fix Example kv_cache_index pod listing returns empty by @​yankay in llm-d/llm-d-kv-cache#229
• fix: incorrect yaml indentation by @​kyanokashi in llm-d/llm-d-kv-cache#238
• refactor: relocate tokenProcessorConfig to enable injection into kvevents.NewPool by @​hyeongyun0916 in llm-d/llm-d-kv-cache#236
• add @​hyeongyun0916 as reviewer by @​vMaroon in llm-d/llm-d-kv-cache#241
• Fix python version incosistency in DockerFile and use Makefile for build by @​kaushik-rohit in llm-d/llm-d-kv-cache#242
• feat: salt KV block hashes with LoRA adapter name by @​sagearc in llm-d/llm-d-kv-cache#243
• fix(cgo): resolve CStrings memory leaks by @​sagearc in llm-d/llm-d-kv-cache#249
• [fs_connector][feat]: Add tensor copy module (tensor_copy) for GPU and CPU block transfers by @​kfirtoledo in llm-d/llm-d-kv-cache#179
• [fs_connector][feat]: Add multithreaded worker pool (thread_pool) by @​kfirtoledo in llm-d/llm-d-kv-cache#178
• add @​sagearc as reviewer by @​vMaroon in llm-d/llm-d-kv-cache#252
• [fs_connector][feat]: Add storage_offload CUDA kernel and setup config by @​kfirtoledo in llm-d/llm-d-kv-cache#180
• [fs_connector][feat]: Add Python backend implementation for fs backend of offloading connector (fs_connector) by @​kfirtoledo in llm-d/llm-d-kv-cache#181
• Refactor: Replace transformers with vLLM by @​hyeongyun0916 in llm-d/llm-d-kv-cache#234
• [fs_connector] [fix]: Return early finish after copy to CPU by @​kfirtoledo in llm-d/llm-d-kv-cache#253
• Optimize uds tokenizer performance using grpc & thread pool by @​delavet in llm-d/llm-d-kv-cache#222
• fix: remove model name from kvblock Key by @​sagearc in llm-d/llm-d-kv-cache#246
• docs : update llmd_fs_backend README.md by @​kfirtoledo in llm-d/llm-d-kv-cache#259
• Automatic vLLM pod discovery + ZMQ subscription mgmt for KVEvents by @​vMaroon in llm-d/llm-d-kv-cache#212
• refactor: convert profiling script to standard go benchmark by @​kaushik-rohit in llm-d/llm-d-kv-cache#251
• Align the interface of the uds tokenizer service with Tokenizer by @​delavet in llm-d/llm-d-kv-cache#257
• Improve CI workflow for faster environment setup by @​yankay in llm-d/llm-d-kv-cache#258
• fix profiling test by @​vMaroon in llm-d/llm-d-kv-cache#261
• edit install-python-deps by @​hyeongyun0916 in llm-d/llm-d-kv-cache#262
• Fix: override block_size in storage backend by @​kfirtoledo in llm-d/llm-d-kv-cache#260
• Remove elevran from owners by @​elevran in llm-d/llm-d-kv-cache#267

New Contributors

• @​natoscott made their first contribution in llm-d/llm-d-kv-cache#196
• @​hhk7734 made their first contribution in llm-d/llm-d-kv-cache#202
• @​setsunakute made their first contribution in llm-d/llm-d-kv-cache#209
• @​alpe made their first contribution in llm-d/llm-d-kv-cache#224
• @​kaushik-rohit made their first contribution in llm-d/llm-d-kv-cache#242
• @​elevran made their first contribution in llm-d/llm-d-kv-cache#267

Full Changelog: llm-d/llm-d-kv-cache@v0.4.0...v0.5.0

v0.4.0

Compare Source

Highlights

• Unified chat-template rendering interface across the different tokenizers (fixes a BOS token duplication bug), performance improvements and code improvements on templating path by @​hyeongyun0916
• Logger fix by @​hyeongyun0916
• Tiered prefix-cache scoring by @​Jay-Pd
• UDS-tokenizer service by @​delavet and @​osswangxining
• Tokenizer from local disk enablement by @​pierDipi
• Valkey kvblock backende by @​rishi-jat
• General enhancements by: @​zhengkezhou1 @​Frapschen @​my-git9 @​samzong @​samber @​kyanokashi

What's Changed

• Fix examples precalculated hashes by @​vMaroon in #​141
• feat: make kvcache.Indexer as gRPC Service by @​zhengkezhou1 in #​109
• Fix: division by zero in metrics logging by @​yankay in #​145
• feat: Add Valkey and RDMA support for KV-cache indexing by @​rishi-jat in #​139
• feat: Add UDS-based external tokenizer service by @​delavet in #​137
• Fix LookupHits metrics not work by @​Frapschen in #​146
• [feat] Add tolerations for chart by @​my-git9 in #​149
• [misc] valkey doc repositioning by @​vMaroon in #​154
• Update README.md to enhance clarity of flowchart labels and descriptions by @​samzong in #​157
• perf(prefixstore): sync.Map are much faster in read-intensive applications by @​samber in #​156
• Add support for local tokenizer files by @​pierDipi in #​142
• Add @​delavet as /services/uds_tokenizer owner by @​vMaroon in #​164
• Add @​osswangxining as /services/uds_tokenizer owner by @​vMaroon in #​168
• Implementation for Tiering in KV-Cache-Manager by @​Jay-Pd in #​150
• fix: rename LookupHits metric to MaxHitsPerPod to better reflect what's tracked by @​kyanokashi in #​160
• fix online example chart format by @​delavet in #​171
• Minor fix for KV Device Tier by @​Jay-Pd in #​172
• [Fix] Ensure Correct Logger Usage by Replacing klog.FromContext with log.FromContext by @​hyeongyun0916 in #​169
• refactor(tokenizer): Unify interface for RenderChatTemplate and eliminate object creation overhead by @​hyeongyun0916 in #​163
• Minor logger fix by @​vMaroon in #​173
• General refactoring for v0.4.0 by @​vMaroon in #​174

New Contributors

• @​rishi-jat made their first contribution in #​139
• @​delavet made their first contribution in #​137
• @​Frapschen made their first contribution in #​146
• @​samzong made their first contribution in #​157
• @​samber made their first contribution in #​156
• @​pierDipi made their first contribution in #​142
• @​Jay-Pd made their first contribution in #​150
• @​kyanokashi made their first contribution in #​160
• @​hyeongyun0916 made their first contribution in #​169

Full Changelog: llm-d/llm-d-kv-cache@v0.3.2...v0.4.0

v0.3.2

Compare Source

What's Changed

• Bump helm-chart Image by @​vMaroon in #​66
• Doc Enhancements by @​vMaroon in #​73
• Update LICENSE by @​vMaroon in #​74
• Fix README Diagram by @​vMaroon in #​75
• Enhance README Diagram Clarity by @​vMaroon in #​78
• Fix kv_events offline example by @​irar2 in #​82
• fix: Redis kvblock parsing bugs and add basic unit tests by @​yankay in #​80
• fix: correct shell command substitution syntax in Makefile by @​yankay in #​81
• Optimized chat completions library, build support and testing infrastructure by @​guygir in #​79
• Remove redundant keys return from Index.Lookup interface by @​sagiahrac in #​84
• KVEvents/others minor refactoring by @​vMaroon in #​88
• Add InMemoryIndex unit tests by @​sagiahrac in #​86
• Add instrumentedIndex basic unit tests by @​sagiahrac in #​87
• docs: fix mermaid chart arrow syntax by @​Zerohertz in #​93
• Chat-Completions Enhancements: Updated Examples + Code Improvements by @​guygir in #​92
• Tokenization unit tests by @​sagiahrac in #​90
• feat: Add Synchronous Tokenization Support to Tokenization Pool by @​sagiahrac in #​95
• [CI]: added some index-related test cases while refactoring the test code to be more concise. by @​yankay in #​102
• [docs] Update KV-Events and KV-Cache examples with correct paths and commands by @​yankay in #​106
• Add Prow GitHub Actions by @​Jooho in #​117
• fix: Modified the download url of libtokenizers.darwin-x86_64.tar.gz by @​WillardHu in #​110
• Update code-ownership files to best utilize PROW + auto assign by @​vMaroon in #​121
• CI: Expand LRUStore Unit Tests for Partial and Prefix Matches by @​yankay in #​120
• fix: remove OWNERS_ALIASES and update OWNERS by @​Jooho in #​122
• Implement auto-assign for reviewers without write permissions by @​vMaroon in #​123
• feat: Add a SliceMapE function for handle errors and add unit tests by @​WillardHu in #​119
• add benchmark data by @​vMaroon in #​129
• [feat]support specifying imagePullSecrets for chart by @​my-git9 in #​130
• Support new KVEvents format by @​vMaroon in #​132
• Fix indexer behavior when no kvblock-keys are generated by @​vMaroon in #​118
• add liu-cong as reviewer by @​vMaroon in #​135
• chore: Fix outdated golangci-lint installation URL by @​zhengkezhou1 in #​136
• Align with recent vLLM kv-block hashing changes by @​vMaroon in #​138

New Contributors

• @​irar2 made their first contribution in #​82
• @​yankay made their first contribution in #​80
• @​guygir made their first contribution in #​79
• @​sagiahrac made their first contribution in #​84
• @​Zerohertz made their first contribution in #​93
• @​Jooho made their first contribution in #​117
• @​WillardHu made their first contribution in #​110
• @​my-git9 made their first contribution in #​130

Full Changelog: llm-d/llm-d-kv-cache@v0.2.1...v0.3.2-rc1

---

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

To execute skipped test pipelines write comment /ok-to-test.

---

Documentation

Find out how to configure dependency updates in MintMaker documentation or see all available configuration options in Renovate documentation.

[coderabbitai]

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

• 🔍 Trigger a full review

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: red-hat-konflux[bot]
Once this PR has been reviewed and has the lgtm label, please assign spolti for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[github-actions]

Cannot approve the pull request: Error: openshift-ci[bot] is not included in the approvers role in the OWNERS file

[openshift-ci]

Hi @red-hat-konflux[bot]. Thanks for your PR.

I'm waiting for a github.com member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[red-hat-konflux]

⚠️ Artifact update problem

Renovate failed to update an artifact related to this branch. You probably do not want to merge this PR as-is.

♻ Renovate will retry this branch, including artifacts, only when one of the following happens:

• any of the package files in this branch needs updating, or
• the branch becomes conflicted, or
• you click the rebase/retry checkbox if found above, or
• you rename this PR's title to start with "rebase!" to trigger it manually

The artifact failure details are included below:

File name: go.sum

Command failed: go get -t ./...
go: github.com/llm-d/llm-d-kv-cache-manager@v0.6.1: parsing go.mod:
	module declares its path as: github.com/llm-d/llm-d-kv-cache
	        but was required as: github.com/llm-d/llm-d-kv-cache-manager

[red-hat-konflux]

Autoclosing Skipped

This PR has been flagged for autoclosing. However, it is being skipped due to the branch being already modified. Please close/delete it manually or report a bug if you think this is in error.