ossmodelconnector/v1.0.0rc8
·
2 commits
to main
since this release
- Using V4 signature in the Authorization header for Object Storage Service (OSS)
- Support using LD_PRELOAD in model connector (recommended), compatible with vLLM/LLaMA.cpp.
- Using shared memory to support multi-process, auto release shared memory.