2025.5.0
What's Changed
- feat: implement slim openai api fallback by @quitrk in #205
- chore: update deps by @quitrk in #206
- feat: add streaming capability to completions api by @quitrk in #207
- feat: add DISABLE_LLM_HEALTH_CHECK env variable by @vgerasymenko in #200
- fix: downgrade vllm by @quitrk in #210
- feat: prioritize running local inference jobs on skynet nodes with vLLM by @quitrk in #208
Full Changelog: 2025.4.1...2025.5.0