Skip to content

2025.5.0

Choose a tag to compare

@quitrk quitrk released this 27 May 06:49
· 28 commits to master since this release
a99e77b

What's Changed

  • feat: implement slim openai api fallback by @quitrk in #205
  • chore: update deps by @quitrk in #206
  • feat: add streaming capability to completions api by @quitrk in #207
  • feat: add DISABLE_LLM_HEALTH_CHECK env variable by @vgerasymenko in #200
  • fix: downgrade vllm by @quitrk in #210
  • feat: prioritize running local inference jobs on skynet nodes with vLLM by @quitrk in #208

Full Changelog: 2025.4.1...2025.5.0