Skip to content

Add pure-Python filesystem secondary tier to offloading connector + FileMapper utility #599

@rshavitt

Description

@rshavitt

Add to vllm a pure-Python filesystem-based secondary tier for KV cache offloading, alongside a reusable path-mapping utility to unify file formats across storage backends (based on file mapper used for by the storage connector).

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions