45ce1803f8
models(gallery): add hubble-4b-v1 ( #3444 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-01 12:33:18 +02:00
164dee65c3
chore(model-gallery): ⬆️ update checksum ( #3442 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-31 21:44:26 +00:00
2259512345
chore: ⬆️ Update ggerganov/llama.cpp to a47667cff41f5a198eb791974e0afcc1cddd3229 ( #3441 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-31 21:40:57 +00:00
b8e7a76524
chore(deps): update llama.cpp ( #3438 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-31 01:21:45 +02:00
72f97e62bb
feat: Added Piper voice it-paola-medium ( #3434 )
...
Added Piper voice it-paola-medium
Bundled from https://huggingface.co/rhasspy/piper-voices
Signed-off-by: fakezeta <fakezeta@gmail.com >
2024-08-30 23:27:49 +02:00
607fd066f0
chore(model-loader): increase test coverage of model loader ( #3433 )
...
chore(model-loader): increase coverage of model loader
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-30 15:20:39 +02:00
69a3b22fa1
chore(tests): replace runaway models for tests ( #3432 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-30 10:04:36 +02:00
11d960b2a6
chore(cli): be consistent between workers and expose ExtraLLamaCPPArgs to both ( #3428 )
...
* chore(cli): be consistent between workers and expose ExtraLLamaCPPArgs to both
Fixes: https://github.com/mudler/LocalAI/issues/3427
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* bump grpcio
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-30 00:10:17 +02:00
ae6d327698
chore: ⬆️ Update ggerganov/llama.cpp to 9fe94ccac92693d4ae1bc283ff0574e8b3f4e765 ( #3424 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-29 07:56:31 +00:00
bb9a5aea9e
chore(model-gallery): ⬆️ update checksum ( #3425 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-28 21:45:07 +00:00
49739e85a0
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-28 14:48:16 +02:00
12950cac21
chore(docs): update links
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-28 10:40:41 +02:00
d2da2f1672
chore(docs): add links to demo and explorer
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-28 10:38:18 +02:00
e1d0d94073
Revert "models(gallery): add phi-3.5-vision" ( #3422 )
...
Revert "models(gallery): add phi-3.5-vision (#3421 )"
This reverts commit b5b01ea635
2024-08-28 10:30:14 +02:00
b5b01ea635
models(gallery): add phi-3.5-vision ( #3421 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-28 09:42:06 +02:00
bc684c259c
chore: ⬆️ Update ggerganov/llama.cpp to 20f1789dfb4e535d64ba2f523c64929e7891f428 ( #3417 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-27 21:41:49 +00:00
da3bc8077d
fix(tts): check error before inspecting result ( #3415 )
...
Otherwise we panic when a res is nil
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-27 17:35:16 +02:00
6a6094a58d
chore(deps): update edgevpn to v0.28.3
2024-08-27 17:29:32 +02:00
8369614b6e
chore(deps): update edgevpn to v0.28.2
2024-08-27 13:03:16 +02:00
cac472d4a1
chore(deps): update edgevpn to v0.28 ( #3412 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-27 10:48:55 +02:00
6d0ede813f
chore: ⬆️ Update ggerganov/llama.cpp to 7d787ed96c32be18603c158ab0276992cf0dc346 ( #3409 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-27 08:44:08 +00:00
a0252127a2
chore(deps): Bump openai from 1.41.1 to 1.42.0 in /examples/langchain/langchainpy-localai-example ( #3401 )
...
chore(deps): Bump openai
Bumps [openai](https://github.com/openai/openai-python ) from 1.41.1 to 1.42.0.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.41.1...v1.42.0 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 05:34:28 +00:00
00ad01fd79
chore(deps): Bump openai from 1.40.5 to 1.42.0 in /examples/langchain-chroma ( #3405 )
...
chore(deps): Bump openai in /examples/langchain-chroma
Bumps [openai](https://github.com/openai/openai-python ) from 1.40.5 to 1.42.0.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.40.5...v1.42.0 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 04:39:18 +00:00
d5c0ad8a1b
chore(deps): Bump marshmallow from 3.21.3 to 3.22.0 in /examples/langchain/langchainpy-localai-example ( #3400 )
...
chore(deps): Bump marshmallow
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow ) from 3.21.3 to 3.22.0.
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst )
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.21.3...3.22.0 )
---
updated-dependencies:
- dependency-name: marshmallow
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 03:58:19 +00:00
11ed1cebb3
chore(deps): Bump llama-index from 0.10.67.post1 to 0.11.1 in /examples/langchain-chroma ( #3406 )
...
chore(deps): Bump llama-index in /examples/langchain-chroma
Bumps [llama-index](https://github.com/run-llama/llama_index ) from 0.10.67.post1 to 0.11.1.
- [Release notes](https://github.com/run-llama/llama_index/releases )
- [Changelog](https://github.com/run-llama/llama_index/blob/main/CHANGELOG.md )
- [Commits](https://github.com/run-llama/llama_index/compare/v0.10.67.post1...v0.11.1 )
---
updated-dependencies:
- dependency-name: llama-index
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 02:11:18 +00:00
fc640be591
chore(deps): Bump llama-index from 0.10.65 to 0.11.1 in /examples/chainlit ( #3404 )
...
chore(deps): Bump llama-index in /examples/chainlit
Bumps [llama-index](https://github.com/run-llama/llama_index ) from 0.10.65 to 0.11.1.
- [Release notes](https://github.com/run-llama/llama_index/releases )
- [Changelog](https://github.com/run-llama/llama_index/blob/main/CHANGELOG.md )
- [Commits](https://github.com/run-llama/llama_index/compare/v0.10.65...v0.11.1 )
---
updated-dependencies:
- dependency-name: llama-index
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 00:51:50 +00:00
311954f41b
chore(deps): Bump idna from 3.7 to 3.8 in /examples/langchain/langchainpy-localai-example ( #3399 )
...
chore(deps): Bump idna
Bumps [idna](https://github.com/kjd/idna ) from 3.7 to 3.8.
- [Release notes](https://github.com/kjd/idna/releases )
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst )
- [Commits](https://github.com/kjd/idna/compare/v3.7...v3.8 )
---
updated-dependencies:
- dependency-name: idna
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 00:11:11 +00:00
bbfa5075f6
chore(deps): Bump docs/themes/hugo-theme-relearn from 82a5e98 to 3a0ae52 ( #3391 )
...
chore(deps): Bump docs/themes/hugo-theme-relearn
Bumps [docs/themes/hugo-theme-relearn](https://github.com/McShelby/hugo-theme-relearn ) from `82a5e98` to `3a0ae52`.
- [Release notes](https://github.com/McShelby/hugo-theme-relearn/releases )
- [Commits](82a5e9876c...3a0ae52e61support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-26 21:44:22 +00:00
47fe31aa53
chore(deps): Bump openai from 1.41.1 to 1.42.0 in /examples/functions ( #3390 )
...
Bumps [openai](https://github.com/openai/openai-python ) from 1.41.1 to 1.42.0.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.41.1...v1.42.0 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-26 20:57:23 +00:00
18dddc1ae0
chore(deps): update edgevpn ( #3385 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-26 20:19:27 +02:00
b38fd8780b
models(gallery): add magnum-v3-34b ( #3384 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-26 17:53:47 +02:00
11eaf9c0a7
models(gallery): add calme-2.1-phi3.5-4b-i1 ( #3383 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-26 17:39:54 +02:00
5d892f86ea
chore(cuda): reduce binary size ( #3379 )
...
fix(cuda): reduce binary size
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-26 14:47:36 +02:00
7f06954425
fix(model-loading): keep track of open GRPC Clients ( #3377 )
...
Due to a previous refactor we moved the client constructor tight to the
model address, however that was just a string which we would use to
build the client each time.
With this change we make the loader to return a *Model which carries a
constructor for the client and stores the client on the first
connection.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-25 14:36:09 +02:00
771a052480
models(gallery): add phi-3.5 ( #3376 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-25 09:02:54 +02:00
99b57b321b
fix: devcontainer utils.sh ssh copy improvements ( #3372 )
...
fix utils.sh - use HOME variable, permissions and logging
Signed-off-by: Dave Lee <dave@gray101.com >
2024-08-24 22:42:05 +00:00
75ef6ccf1e
feat(swagger): update swagger ( #3370 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-24 21:53:18 +00:00
de1fbdca71
Update quickstart.md ( #3373 )
...
fix typo.
Signed-off-by: grant-wilson <grantm.wilsonii@gmail.com >
2024-08-24 23:01:34 +02:00
ce827139bb
fix(p2p): correctly allow to pass extra args to llama.cpp ( #3368 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-24 10:30:24 +02:00
0762aa5327
Update GPU-acceleration.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-24 09:58:49 +02:00
81ae92f017
feat: elevenlabs sound-generation api ( #3355 )
...
* initial version of elevenlabs compatible soundgeneration api and cli command
Signed-off-by: Dave Lee <dave@gray101.com >
* minor cleanup
Signed-off-by: Dave Lee <dave@gray101.com >
* restore TTS, add test
Signed-off-by: Dave Lee <dave@gray101.com >
* remove stray s
Signed-off-by: Dave Lee <dave@gray101.com >
* fix
Signed-off-by: Dave Lee <dave@gray101.com >
---------
Signed-off-by: Dave Lee <dave@gray101.com >
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-24 00:20:28 +00:00
84d6e5a987
chore(model-gallery): add more quants for popular models ( #3365 )
...
* models(gallery): add higher quants for some llama and hermes
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* models(gallery): vllm: specify a reasonable max_tokens
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-24 00:29:24 +02:00
ac5f6f210b
feat: external backend launching log improvements and relative path support ( #3348 )
...
* specify workdir when launching external backend for safety / relative paths, bump version, logs
Signed-off-by: Dave Lee <dave@gray101.com >
* sneak in a devcontainer fix
Signed-off-by: Dave Lee <dave@gray101.com >
---------
Signed-off-by: Dave Lee <dave@gray101.com >
2024-08-24 00:27:14 +02:00
61fe2404a0
chore: ⬆️ Update ggerganov/llama.cpp to 3ba780e2a8f0ffe13f571b27f0bbf2ca5a199efc ( #3361 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-23 21:49:18 +00:00
db2d8f4d04
docs: ⬆️ update docs version mudler/LocalAI ( #3366 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-23 21:44:06 +00:00
a9c521eb41
fix(deps): bump grpcio ( #3362 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-23 10:29:04 +02:00
a913fd310d
models(gallery): add hermes-3-llama-3.1(8B,70B,405B) with vLLM ( #3360 )
...
models(gallery): add hermes-3-llama-3.1 with vLLM
it adds 8b, 70b and 405b to the gallery
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-23 09:24:34 +02:00
fbaae8528d
fix(chat): re-generated uuid, created, and text on each request ( #3359 )
...
This was noticed by models returning content besides function calls.
Sadly we can't test that easily in the CI so it got unnoticed.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-22 10:56:05 +02:00
7d030b56b2
chore: ⬆️ Update ggerganov/whisper.cpp to 9e3c5345cd46ea718209db53464e426c3fe7a25e ( #3357 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-22 08:49:33 +00:00
0add16049e
chore: ⬆️ Update ggerganov/llama.cpp to fc54ef0d1c138133a01933296d50a36a1ab64735 ( #3356 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-21 22:14:02 +00:00
