Skip to content

ossmodelconnector/v1.0.0rc8

Compare
Choose a tag to compare
@github-actions github-actions released this 18 Mar 11:29
· 2 commits to main since this release
10e1ff1
  1. Using V4 signature in the Authorization header for Object Storage Service (OSS)
  2. Support using LD_PRELOAD in model connector (recommended), compatible with vLLM/LLaMA.cpp.
  3. Using shared memory to support multi-process, auto release shared memory.