Skip to content

Latest commit

 

History

1 Commit

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

lmcache_xpu_device

lmcache_xpu_device is an out-of-tree LMCache XPU device plugin published as a wheel.

It carries the LMCache XPU DeviceSpec and DeviceOps implementation so an LMCache checkout can remove its built-in lmcache/v1/platform/xpu package and recover the same runtime behavior by installing this wheel into the same Python environment.

What this package owns

  • device_type="xpu" registration through the lmcache.device_plugins entry-point group
  • XpuDeviceSpec hardware detection
  • XpuDeviceOps lazy binding to lmcache.xpu_ops

What stays in LMCache

  • lmcache.xpu_ops native extension build
  • XPU GPU connector implementations
  • XPU tests and CI orchestration

Build

uv build

The wheel is written to dist/.

Install

Install the wheel into the same environment as LMCache:

uv pip install dist/lmcache_xpu_device-0.1.0-py3-none-any.whl

In an Intel XPU environment, LMCache should then resolve the xpu backend through this package's entry point.

About

External XPU device plugin for LMCache

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages