Skip to content

Initial multiprocess mode support leveraging upstream LMCache experimental features #129

@matthewygf

Description

@matthewygf

Provide initial support for multiprocess mode in LMCache/LMCache-Ascend, as the upstream LMCache now offers experimental multiprocess capability.

Tasks:

  • Investigate upstream LMCache multiprocess implementation and API changes
  • Analyze compatibility and integration approach for LMCache/LMCache-Ascend
  • Implement foundational code changes required to enable multiprocess mode
  • Add initial tests and document known caveats or limitations
  • Update documentation to reflect multiprocess mode setup/integration steps

Note: This is an initial implementation. Please track future upstream changes for stable support and update accordingly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions