v1.30.0

What's Changed

This is an exciting LocalAI release! Besides bug-fixes and enhancements this release brings the new backend to a whole new level by extending support to vllm and vall-e-x for audio generation!

Bug fixes 🐛

• fix(llama): resolve lora adapters correctly from the model file by @mudler in #964
• fix(diffusers): correctly check alpha by @mudler in #967
• fix(utf8): prevent multi-byte utf8 characters from being mangled by @samm81 in #981
• fix(vall-e-x): make audiopath relative to models by @mudler in #1012
• fix(vall-e-x): copy vall-e-x next to the local-ai binary in the container image by @mudler in #1082

Exciting New Features 🎉

• feat(diffusers): Add lora by @mudler in #965
• feat: expose all the jobs via /models/jobs endpoint by @Jirubizu in #983
• feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints by @dave-gray101 in #991
• Allow to manually set the seed for the SD pipeline by @maxjcohen in #998
• feat: add vall-e-x by @mudler in #1007
• feat(vllm): Initial vllm backend implementation by @mudler in #1026
• feat(speculative-sampling): allow to specify a draft model in the model config by @mudler in #1052
• fix(vllm): set default top_p with vllm by @mudler in #1078
• feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS by @mudler in #1081
• feat(vllm): Allow to set quantization by @mudler in #1094

👒 Dependencies

• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 9072315 by @renovate in #963
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #968
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.0 by @renovate in #966
• fix(deps): update github.com/tmc/langchaingo digest to c85d396 by @renovate in #962
• fix(deps): update module github.com/valyala/fasthttp to v1.49.0 by @renovate in #971
• fix(deps): update go-llama.cpp by @mudler in #980
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to bf3f946 by @renovate in #979
• fix(deps): update module github.com/sashabaranov/go-openai to v1.15.1 by @renovate in #984
• fix(deps): update module github.com/shirou/gopsutil/v3 to v3.23.8 by @renovate in #989
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to b6e38d6 by @renovate in #988
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to c5622a8 by @renovate in #992
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #996
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to d8c8547 by @renovate in #997
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1002
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.1 by @renovate in #1001
• chore(deps): remove unused package by @appleboy in #1003
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1005
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 05dc4b6 by @renovate in #1004
• feat(llama.cpp): update by @mudler in #1024
• fix(deps): update module github.com/sashabaranov/go-openai to v1.15.2 by @renovate in #1022
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 4145bd5 by @renovate in #1025
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1027
• fix(deps): update github.com/tmc/langchaingo digest to 9c8845b by @renovate in #1029
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1043
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to f0735ef by @renovate in #1034
• fix(deps): update module github.com/sashabaranov/go-openai to v1.15.3 by @renovate in #1035
• chore(deps): update docker/build-push-action action to v5 by @renovate in #1039
• chore(deps): update docker/login-action action to v3 by @renovate in #1040
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to cc8a123 by @renovate in #1041
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1048
• chore(deps): update docker/metadata-action action to v5 by @renovate in #1045
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cf4eb53 by @renovate in #1047
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1062
• fix(deps): update module google.golang.org/grpc to v1.58.1 by @renovate in #1020
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.2 by @renovate in #1049
• fix(deps): update module github.com/valyala/fasthttp to v1.50.0 by @renovate in #1060
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to b471eb7 by @renovate in #1050
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to e86c637 by @renovate in #1059
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1084
• fix(llama.cpp): update, run go mod tidy by @mudler in #1088
• fix(deps): update module google.golang.org/grpc to v1.58.2 by @renovate in #1090
• fix(deps): update github.com/tmc/langchaingo digest to 2c309cf by @renovate in #1097

Other Changes

• [query_data example] max_chunk_overlap in PromptHelper must be in 0..1 range by @quoing in #1000
• feat(diffusers): don't set seed in params and respect device by @mudler in #1010
• Update README to reflect changes in Continue's config file by @rdeaton in #1014
• 1038 - Streamlit bot with LocalAI by @majoshi1 in #1072
• Cleaned up chatbot-ui READMEs by @jamesbraza in #1075
• Requested Changes from GPT4ALL to Luna-AI-Llama2 by @lunamidori5 in #1092
• Add the CONTRIBUTING.md by @Aisuko in #1098

New Contributors

• @Jirubizu made their first contribution in #983
• @maxjcohen made their first contribution in #998
• @appleboy made their first contribution in #1003
• @quoing made their first contribution in #1000
• @rdeaton made their first contribution in #1014
• @majoshi1 made their first contribution in #1072
• @jamesbraza made their first contribution in #1075
• @lunamidori5 made their first contribution in #1092

Full Changelog: v1.25.0...v2.0.0