v0.1.3

What's Changed

🚀 Major Features:

• Add open-webui as the default chatbot by @kerthcet in #357
• Add enovy ai gateway (helm dependencies + doc) by @pacoxu in #360

✨ Features:

• feature: install lws controller in llmaz-system namespace by @googs1025 in #354

♻️ Cleanups:

• Add default to configName by @kerthcet in #349
• feat: move lws controller replicas to global values by @Whitea029 in #358
• kubectl apply using --server-side to avoid apply failure by @pacoxu in #363

New Contributors

• @Whitea029 made their first contribution in #358

Full Changelog: v0.1.2...v0.1.3

v0.1.2

What's Changed

✨ Features:

• feat: spread container env to initContianers by @nayihz in #294
• feature(BackendRuntime): support lifecycle hook fields for BackendRuntime by @googs1025 in #303
• feat: add e2e test to verify service is avaliable by @nayihz in #310
• feat: make elasticConfig.maxReplicas to a required parameter by @nayihz in #331
• feat: metrics support for llmaz by @googs1025 in #316

♻️ Cleanups:

• build(deps): bump github.com/google/go-cmp from 0.6.0 to 0.7.0 by @dependabot in #283
• API refactor by @kerthcet in #285
• Refactor multi-host example by @kerthcet in #286
• cleanup: upgrade vllm version to v0.7.3 by @nayihz in #289
• Enable debug mode in workflow by @kerthcet in #290
• fix: fix some warnings when building images by @nayihz in #295
• build(deps): bump sigs.k8s.io/structured-merge-diff/v4 from 4.5.0 to 4.6.0 by @dependabot in #298
• build(deps): bump sigs.k8s.io/controller-runtime from 0.20.2 to 0.20.3 by @dependabot in #299
• build(deps): bump github.com/onsi/ginkgo/v2 from 2.22.2 to 2.23.0 by @dependabot in #297
• cleanup: upgrade e2e test tools by @nayihz in #296
• chore: fix BackendRuntime crds field Commands -> Command by @googs1025 in #315
• feature: add in-tree vllm BackendRuntime for preStop Hook by @googs1025 in #319
• cleanup: remove kube-rbac-proxy by @nayihz in #321
• use local GOPROXY by @pacoxu in #322
• add image repo for lws and all backend runtime, like llama.cpp by @pacoxu in #328
• build(deps): bump github.com/onsi/gomega from 1.36.3 to 1.37.0 by @dependabot in #337
• build(deps): bump github.com/onsi/ginkgo/v2 from 2.23.3 to 2.23.4 by @dependabot in #336
• build(deps): bump sigs.k8s.io/structured-merge-diff/v4 from 4.6.0 to 4.7.0 by @dependabot in #338
• chore: refactor handleUnexpectedCondition func by @googs1025 in #344
• fix(env): ensure BackendRuntimeConfig.Envs overrides base Envs by @googs1025 in #341

New Contributors

• @nayihz made their first contribution in #289
• @pacoxu made their first contribution in #322

Full Changelog: v0.1.1...v0.1.2

v0.1.1

What's Changed

🚀 Major Features:

• Add recommendedConfigs to backendRuntime by @kerthcet in #276

✨ Features:

• Add api reference by @kerthcet in #263
• Create a clusterIP service for load balancing by @kerthcet in #267
• Support shared memory size by @kerthcet in #269

♻️ Cleanups:

• Rename request to limits in Flavor by @kerthcet in #271

Full Changelog: v0.1.0...v0.1.1

v0.1.0

What's Changed

🚀 Major Features:

• Support HPA with Playground by @kerthcet in #252

✨ Features:

• Support multi-host inference with Playground by @kerthcet in #235
• Support multi probes in backendRuntime by @kerthcet in #242
• Support hostpath models by @kerthcet in #247

🐛 Bugs:

• Fix: golangci-lint slow by @kerthcet in #236

♻️ Cleanups:

• Add inferenceConfig to Playground by @kerthcet in #245

Full Changelog: v0.0.9...v0.1.0

v0.0.9

What's Changed

✨ Features:

• Support ollama by @qinguoyi in #193
• Feat: add argName to specify server arguments by @kerthcet in #226

🐛 Bugs:

• fix: helm INSTALLATION FAILED by @googs1025 in #203
• Fix: model-loader will not load any files by @kerthcet in #228

♻️ Cleanups:

• Update Features of Overview by @kerthcet in #214
• Remove ElasticConfig from Service by @kerthcet in #224

Full Changelog: v0.0.8...v0.0.9

v0.0.8

What's Changed

🚀 Major Features:

• Support TGI as another backendRuntime by @kerthcet in #182

✨ Features:

• feat:support apply llmaz to any ns by @qinguoyi in #172
• feat:update model loader by @qinguoyi in #178

🐛 Bugs:

• fix:catch os error by @qinguoyi in #174
• Make field Command optional by @kerthcet in #181

♻️ Cleanups:

• Add release checklist by @kerthcet in #159
• chore: bump LWS version to v0.4.0 by @googs1025 in #162
• Bump sigs.k8s.io/lws from 0.4.0 to 0.4.1 by @dependabot in #185
• feature(webhook): add BackendRuntimeConfig resources validation by @googs1025 in #170
• fix:load models cost seconds by @qinguoyi in #175
• Update Revision default to main by @kerthcet in #176
• Downsize model-loader image by @qinguoyi in #179

New Contributors

• @googs1025 made their first contribution in #162
• @qinguoyi made their first contribution in #168

Full Changelog: v0.0.7...v0.0.8

v0.0.7

What's Changed

🚀 Major Features:

• [1/N] Add backendRuntime CRD by @kerthcet in #138
• [2/N] Add backendRuntime implementation by @kerthcet in #139
• Add helm chart support by @kerthcet in #142

✨ Features:

• Add Architecture diagram by @kerthcet in #129

🐛 Bugs:

• Fix resource limits could be small than requests by @kerthcet in #136
• Fix filename error by @kerthcet in #147

♻️ Cleanups:

• Update installation doc by @kerthcet in #149
• Refactor backendRuntime by @kerthcet in #157

Full Changelog: v0.0.6...v0.0.7

v0.0.6

What's Changed

🚀 Major Features:

• Add project logo by @kerthcet in #112
• [1/N] Add SpeculativeDecoding support by @kerthcet in #118

✨ Features:

• Add model label to Playground by @kerthcet in #111
• Add new conditions to Playground by @kerthcet in #120
• Change ModelClaims API by @kerthcet in #125

🐛 Bugs:

• fix wrong field path in the openmodel webhook by @carlory in #107
• Playground should be triggered to create Services and then Pods once the model is created by @carlory in #109
• Fix watch for changes to LeaderWorkerSet created by llmaz and trigger a Reconcile for the owner by @carlory in #108

♻️ Cleanups:

• Add verbose log to modelLoader by @kerthcet in #124

New Contributors

• @carlory made their first contribution in #107

Full Changelog: v0.0.5...v0.0.6

v0.0.5

What's Changed

• Stop sharing model weights across Pods in the same node by @kerthcet in #102
• Change model name to github.com/inftyai/llmaz by @kerthcet in #104

Full Changelog: v0.0.4...v0.0.5

v0.0.4

What's Changed

• Support loading models from object store by @kerthcet in #87
• Support llama.cpp by @kerthcet in #94

Full Changelog: v0.0.3...v0.0.4