v1.30.0 #1105

mudler announced in Announcements

mudler
Sep 25, 2023
Maintainer

What's Changed

This is an exciting LocalAI release! Besides bug-fixes and enhancements this release brings the new backend to a whole new level by extending support to vllm and vall-e-x for audio generation!

Bug fixes 🐛

fix(llama): resolve lora adapters correctly from the model file by @mudler in fix(llama): resolve lora adapters correctly from the model file #964
fix(diffusers): correctly check alpha by @mudler in fix(diffusers): correctly check alpha #967
fix(utf8): prevent multi-byte utf8 characters from being mangled by @samm81 in fix(utf8): prevent multi-byte utf8 characters from being mangled #981
fix(vall-e-x): make audiopath relative to models by @mudler in fix(vall-e-x): make audiopath relative to models #1012
fix(vall-e-x): copy vall-e-x next to the local-ai binary in the container image by @mudler in fix(vall-e-x): copy vall-e-x next to the local-ai binary in the container image #1082

Exciting New Features 🎉

feat(diffusers): Add lora by @mudler in feat(diffusers): Add lora #965
feat: expose all the jobs via /models/jobs endpoint by @Jirubizu in feat: expose all the jobs via /models/jobs endpoint #983
feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints by @dave-gray101 in feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints #991
Allow to manually set the seed for the SD pipeline by @maxjcohen in Allow to manually set the seed for the SD pipeline #998
feat: add vall-e-x by @mudler in feat: add vall-e-x #1007
feat(vllm): Initial vllm backend implementation by @mudler in feat(vllm): Initial vllm backend implementation #1026
feat(speculative-sampling): allow to specify a draft model in the model config by @mudler in feat(speculative-sampling): allow to specify a draft model in the model config #1052
fix(vllm): set default top_p with vllm by @mudler in fix(vllm): set default top_p with vllm #1078
feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS by @mudler in feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS #1081
feat(vllm): Allow to set quantization by @mudler in feat(vllm): Allow to set quantization #1094

👒 Dependencies

fix(deps): update github.com/go-skynet/go-llama.cpp digest to 9072315 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to 9072315 #963
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #968
fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.0 by @renovate in fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.0 #966
fix(deps): update github.com/tmc/langchaingo digest to c85d396 by @renovate in fix(deps): update github.com/tmc/langchaingo digest to c85d396 #962
fix(deps): update module github.com/valyala/fasthttp to v1.49.0 by @renovate in fix(deps): update module github.com/valyala/fasthttp to v1.49.0 #971
fix(deps): update go-llama.cpp by @mudler in fix(deps): update go-llama.cpp #980
fix(deps): update github.com/go-skynet/go-llama.cpp digest to bf3f946 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to bf3f946 #979
fix(deps): update module github.com/sashabaranov/go-openai to v1.15.1 by @renovate in fix(deps): update module github.com/sashabaranov/go-openai to v1.15.1 #984
fix(deps): update module github.com/shirou/gopsutil/v3 to v3.23.8 by @renovate in fix(deps): update module github.com/shirou/gopsutil/v3 to v3.23.8 #989
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to b6e38d6 by @renovate in fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to b6e38d6 #988
fix(deps): update github.com/go-skynet/go-llama.cpp digest to c5622a8 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to c5622a8 #992
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #996
fix(deps): update github.com/go-skynet/go-llama.cpp digest to d8c8547 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to d8c8547 #997
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #1002
fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.1 by @renovate in fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.1 #1001
chore(deps): remove unused package by @appleboy in chore(deps): remove unused package #1003
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #1005
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 05dc4b6 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to 05dc4b6 #1004
feat(llama.cpp): update by @mudler in feat(llama.cpp): update #1024
fix(deps): update module github.com/sashabaranov/go-openai to v1.15.2 by @renovate in fix(deps): update module github.com/sashabaranov/go-openai to v1.15.2 #1022
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 4145bd5 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to 4145bd5 #1025
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #1027
fix(deps): update github.com/tmc/langchaingo digest to 9c8845b by @renovate in fix(deps): update github.com/tmc/langchaingo digest to 9c8845b #1029
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #1043
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to f0735ef by @renovate in fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to f0735ef #1034
fix(deps): update module github.com/sashabaranov/go-openai to v1.15.3 by @renovate in fix(deps): update module github.com/sashabaranov/go-openai to v1.15.3 #1035
chore(deps): update docker/build-push-action action to v5 by @renovate in chore(deps): update docker/build-push-action action to v5 #1039
chore(deps): update docker/login-action action to v3 by @renovate in chore(deps): update docker/login-action action to v3 #1040
fix(deps): update github.com/go-skynet/go-llama.cpp digest to cc8a123 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to cc8a123 #1041
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #1048
chore(deps): update docker/metadata-action action to v5 by @renovate in chore(deps): update docker/metadata-action action to v5 #1045
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cf4eb53 by @renovate in fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cf4eb53 #1047
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #1062
fix(deps): update module google.golang.org/grpc to v1.58.1 by @renovate in fix(deps): update module google.golang.org/grpc to v1.58.1 #1020
fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.2 by @renovate in fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.2 #1049
fix(deps): update module github.com/valyala/fasthttp to v1.50.0 by @renovate in fix(deps): update module github.com/valyala/fasthttp to v1.50.0 #1060
fix(deps): update github.com/go-skynet/go-llama.cpp digest to b471eb7 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to b471eb7 #1050
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to e86c637 by @renovate in fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to e86c637 #1059
⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in ⬆️ Update go-skynet/go-llama.cpp #1084
fix(llama.cpp): update, run go mod tidy by @mudler in fix(llama.cpp): update, run go mod tidy #1088
fix(deps): update module google.golang.org/grpc to v1.58.2 by @renovate in fix(deps): update module google.golang.org/grpc to v1.58.2 #1090
fix(deps): update github.com/tmc/langchaingo digest to 2c309cf by @renovate in fix(deps): update github.com/tmc/langchaingo digest to 2c309cf #1097

Other Changes

[query_data example] max_chunk_overlap in PromptHelper must be in 0..1 range by @quoing in [query_data example] max_chunk_overlap in PromptHelper must be in 0..1 range #1000
feat(diffusers): don't set seed in params and respect device by @mudler in feat(diffusers): don't set seed in params and respect device #1010
Update README to reflect changes in Continue's config file by @rdeaton in Update README to reflect changes in Continue's config file #1014
1038 - Streamlit bot with LocalAI by @majoshi1 in 1038 - Streamlit bot with LocalAI #1072
Cleaned up chatbot-ui READMEs by @jamesbraza in Cleaned up chatbot-ui READMEs #1075
Requested Changes from GPT4ALL to Luna-AI-Llama2 by @lunamidori5 in Requested Changes from GPT4ALL to Luna-AI-Llama2 #1092
Add the CONTRIBUTING.md by @Aisuko in Add the CONTRIBUTING.md #1098

New Contributors

@Jirubizu made their first contribution in feat: expose all the jobs via /models/jobs endpoint #983
@maxjcohen made their first contribution in Allow to manually set the seed for the SD pipeline #998
@appleboy made their first contribution in chore(deps): remove unused package #1003
@quoing made their first contribution in [query_data example] max_chunk_overlap in PromptHelper must be in 0..1 range #1000
@rdeaton made their first contribution in Update README to reflect changes in Continue's config file #1014
@majoshi1 made their first contribution in 1038 - Streamlit bot with LocalAI #1072
@jamesbraza made their first contribution in Cleaned up chatbot-ui READMEs #1075
@lunamidori5 made their first contribution in Requested Changes from GPT4ALL to Luna-AI-Llama2 #1092

Full Changelog: v1.25.0...v2.0.0

This discussion was created from the release v1.30.0.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment