-
Notifications
You must be signed in to change notification settings - Fork 48
Open
Description
Valkey experimentally supports RDMA transfer - https://valkey.io/topics/RDMA/ - it would be wonderful if the golang client library supported this as well.
RDMA is extremely important in AI/HPC workloads, and a great differentiator for Valkey. Recently we encountered a need for golang client library support on the llm-d project. However, its use is blocked due to missing client library support.
- feat: Add Valkey and RDMA support for KV-cache indexing llm-d/llm-d-kv-cache#139
- https://github.com/llm-d/llm-d-kv-cache-manager/blob/main/examples/valkey_example/README.md
There is a golang interface for the system RDMA libraries that may prove helpful here:
Metadata
Metadata
Assignees
Labels
No labels