Releases: InftyAI/llmaz
Releases · InftyAI/llmaz
v0.0.3
v0.0.2
What's Changed
✨ Feature:
- Feat: support modelscope by @vicoooo26 in #45
- Feat: support sglang backend by @vicoooo26 in #46
- Support Secrets to store HF_TOKEN by @kerthcet in #71
♻️ Cleanup:
- Add support for multithread when downloading weights by @kerthcet in #41
- Add dependabot and issue & pr template by @kerthcet in #51
- Add baseline for tests by @kerthcet in #57
🐛 Bug:
New Contributors
- @dependabot made their first contribution in #53
- @vicoooo26 made their first contribution in #45
Full Changelog: v0.0.1...v0.0.2
First release v0.0.1
What's Changed
- Add new core APIs, e.g.
Model
- Add new inference APIs, e.g.
Playground
,Inference
- Support serving models from huggingface
- Support sharing models weights on the same node
- Integrate with vllm by default
- Add webhooks for APIs
- Add installation documents and examples