49739e85a0
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-28 14:48:16 +02:00
12950cac21
chore(docs): update links
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-28 10:40:41 +02:00
d2da2f1672
chore(docs): add links to demo and explorer
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-28 10:38:18 +02:00
e1d0d94073
Revert "models(gallery): add phi-3.5-vision" ( #3422 )
...
Revert "models(gallery): add phi-3.5-vision (#3421 )"
This reverts commit b5b01ea635
2024-08-28 10:30:14 +02:00
b5b01ea635
models(gallery): add phi-3.5-vision ( #3421 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-28 09:42:06 +02:00
bc684c259c
chore: ⬆️ Update ggerganov/llama.cpp to 20f1789dfb4e535d64ba2f523c64929e7891f428 ( #3417 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-27 21:41:49 +00:00
da3bc8077d
fix(tts): check error before inspecting result ( #3415 )
...
Otherwise we panic when a res is nil
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-27 17:35:16 +02:00
6a6094a58d
chore(deps): update edgevpn to v0.28.3
2024-08-27 17:29:32 +02:00
8369614b6e
chore(deps): update edgevpn to v0.28.2
2024-08-27 13:03:16 +02:00
cac472d4a1
chore(deps): update edgevpn to v0.28 ( #3412 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-27 10:48:55 +02:00
6d0ede813f
chore: ⬆️ Update ggerganov/llama.cpp to 7d787ed96c32be18603c158ab0276992cf0dc346 ( #3409 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-27 08:44:08 +00:00
a0252127a2
chore(deps): Bump openai from 1.41.1 to 1.42.0 in /examples/langchain/langchainpy-localai-example ( #3401 )
...
chore(deps): Bump openai
Bumps [openai](https://github.com/openai/openai-python ) from 1.41.1 to 1.42.0.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.41.1...v1.42.0 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 05:34:28 +00:00
00ad01fd79
chore(deps): Bump openai from 1.40.5 to 1.42.0 in /examples/langchain-chroma ( #3405 )
...
chore(deps): Bump openai in /examples/langchain-chroma
Bumps [openai](https://github.com/openai/openai-python ) from 1.40.5 to 1.42.0.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.40.5...v1.42.0 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 04:39:18 +00:00
d5c0ad8a1b
chore(deps): Bump marshmallow from 3.21.3 to 3.22.0 in /examples/langchain/langchainpy-localai-example ( #3400 )
...
chore(deps): Bump marshmallow
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow ) from 3.21.3 to 3.22.0.
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst )
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.21.3...3.22.0 )
---
updated-dependencies:
- dependency-name: marshmallow
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 03:58:19 +00:00
11ed1cebb3
chore(deps): Bump llama-index from 0.10.67.post1 to 0.11.1 in /examples/langchain-chroma ( #3406 )
...
chore(deps): Bump llama-index in /examples/langchain-chroma
Bumps [llama-index](https://github.com/run-llama/llama_index ) from 0.10.67.post1 to 0.11.1.
- [Release notes](https://github.com/run-llama/llama_index/releases )
- [Changelog](https://github.com/run-llama/llama_index/blob/main/CHANGELOG.md )
- [Commits](https://github.com/run-llama/llama_index/compare/v0.10.67.post1...v0.11.1 )
---
updated-dependencies:
- dependency-name: llama-index
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 02:11:18 +00:00
fc640be591
chore(deps): Bump llama-index from 0.10.65 to 0.11.1 in /examples/chainlit ( #3404 )
...
chore(deps): Bump llama-index in /examples/chainlit
Bumps [llama-index](https://github.com/run-llama/llama_index ) from 0.10.65 to 0.11.1.
- [Release notes](https://github.com/run-llama/llama_index/releases )
- [Changelog](https://github.com/run-llama/llama_index/blob/main/CHANGELOG.md )
- [Commits](https://github.com/run-llama/llama_index/compare/v0.10.65...v0.11.1 )
---
updated-dependencies:
- dependency-name: llama-index
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 00:51:50 +00:00
311954f41b
chore(deps): Bump idna from 3.7 to 3.8 in /examples/langchain/langchainpy-localai-example ( #3399 )
...
chore(deps): Bump idna
Bumps [idna](https://github.com/kjd/idna ) from 3.7 to 3.8.
- [Release notes](https://github.com/kjd/idna/releases )
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst )
- [Commits](https://github.com/kjd/idna/compare/v3.7...v3.8 )
---
updated-dependencies:
- dependency-name: idna
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-27 00:11:11 +00:00
bbfa5075f6
chore(deps): Bump docs/themes/hugo-theme-relearn from 82a5e98 to 3a0ae52 ( #3391 )
...
chore(deps): Bump docs/themes/hugo-theme-relearn
Bumps [docs/themes/hugo-theme-relearn](https://github.com/McShelby/hugo-theme-relearn ) from `82a5e98` to `3a0ae52`.
- [Release notes](https://github.com/McShelby/hugo-theme-relearn/releases )
- [Commits](82a5e9876c...3a0ae52e61support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-26 21:44:22 +00:00
47fe31aa53
chore(deps): Bump openai from 1.41.1 to 1.42.0 in /examples/functions ( #3390 )
...
Bumps [openai](https://github.com/openai/openai-python ) from 1.41.1 to 1.42.0.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.41.1...v1.42.0 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-26 20:57:23 +00:00
18dddc1ae0
chore(deps): update edgevpn ( #3385 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-26 20:19:27 +02:00
b38fd8780b
models(gallery): add magnum-v3-34b ( #3384 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-26 17:53:47 +02:00
11eaf9c0a7
models(gallery): add calme-2.1-phi3.5-4b-i1 ( #3383 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-26 17:39:54 +02:00
5d892f86ea
chore(cuda): reduce binary size ( #3379 )
...
fix(cuda): reduce binary size
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-26 14:47:36 +02:00
7f06954425
fix(model-loading): keep track of open GRPC Clients ( #3377 )
...
Due to a previous refactor we moved the client constructor tight to the
model address, however that was just a string which we would use to
build the client each time.
With this change we make the loader to return a *Model which carries a
constructor for the client and stores the client on the first
connection.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-25 14:36:09 +02:00
771a052480
models(gallery): add phi-3.5 ( #3376 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-25 09:02:54 +02:00
99b57b321b
fix: devcontainer utils.sh ssh copy improvements ( #3372 )
...
fix utils.sh - use HOME variable, permissions and logging
Signed-off-by: Dave Lee <dave@gray101.com >
2024-08-24 22:42:05 +00:00
75ef6ccf1e
feat(swagger): update swagger ( #3370 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-24 21:53:18 +00:00
de1fbdca71
Update quickstart.md ( #3373 )
...
fix typo.
Signed-off-by: grant-wilson <grantm.wilsonii@gmail.com >
2024-08-24 23:01:34 +02:00
ce827139bb
fix(p2p): correctly allow to pass extra args to llama.cpp ( #3368 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-24 10:30:24 +02:00
0762aa5327
Update GPU-acceleration.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-24 09:58:49 +02:00
81ae92f017
feat: elevenlabs sound-generation api ( #3355 )
...
* initial version of elevenlabs compatible soundgeneration api and cli command
Signed-off-by: Dave Lee <dave@gray101.com >
* minor cleanup
Signed-off-by: Dave Lee <dave@gray101.com >
* restore TTS, add test
Signed-off-by: Dave Lee <dave@gray101.com >
* remove stray s
Signed-off-by: Dave Lee <dave@gray101.com >
* fix
Signed-off-by: Dave Lee <dave@gray101.com >
---------
Signed-off-by: Dave Lee <dave@gray101.com >
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-24 00:20:28 +00:00
84d6e5a987
chore(model-gallery): add more quants for popular models ( #3365 )
...
* models(gallery): add higher quants for some llama and hermes
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* models(gallery): vllm: specify a reasonable max_tokens
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-24 00:29:24 +02:00
ac5f6f210b
feat: external backend launching log improvements and relative path support ( #3348 )
...
* specify workdir when launching external backend for safety / relative paths, bump version, logs
Signed-off-by: Dave Lee <dave@gray101.com >
* sneak in a devcontainer fix
Signed-off-by: Dave Lee <dave@gray101.com >
---------
Signed-off-by: Dave Lee <dave@gray101.com >
2024-08-24 00:27:14 +02:00
61fe2404a0
chore: ⬆️ Update ggerganov/llama.cpp to 3ba780e2a8f0ffe13f571b27f0bbf2ca5a199efc ( #3361 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-23 21:49:18 +00:00
db2d8f4d04
docs: ⬆️ update docs version mudler/LocalAI ( #3366 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-23 21:44:06 +00:00
a9c521eb41
fix(deps): bump grpcio ( #3362 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-23 10:29:04 +02:00
a913fd310d
models(gallery): add hermes-3-llama-3.1(8B,70B,405B) with vLLM ( #3360 )
...
models(gallery): add hermes-3-llama-3.1 with vLLM
it adds 8b, 70b and 405b to the gallery
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-23 09:24:34 +02:00
fbaae8528d
fix(chat): re-generated uuid, created, and text on each request ( #3359 )
...
This was noticed by models returning content besides function calls.
Sadly we can't test that easily in the CI so it got unnoticed.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-22 10:56:05 +02:00
7d030b56b2
chore: ⬆️ Update ggerganov/whisper.cpp to 9e3c5345cd46ea718209db53464e426c3fe7a25e ( #3357 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-22 08:49:33 +00:00
0add16049e
chore: ⬆️ Update ggerganov/llama.cpp to fc54ef0d1c138133a01933296d50a36a1ab64735 ( #3356 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-21 22:14:02 +00:00
2bb48b0816
fix(parler-tts): pin torchaudio and torch for hipblas
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-21 18:27:20 +02:00
023ce59d44
feat(p2p): allow to set intervals ( #3353 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-21 18:23:51 +02:00
7822d944b5
chore(p2p): single-node when sharing federated instance ( #3354 )
...
* chore(p2p): single-node when sharing federated instance
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* chore: refactor out and extract into functions
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-21 18:23:42 +02:00
b510352393
chore(anime.js): drop unused ( #3351 )
...
* fix(anime.js): correctly set the static path
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Drop anime.js (unused)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-21 13:10:09 +02:00
d3a217c254
chore(docs): update p2p env var documentation ( #3350 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-21 13:09:57 +02:00
2a3427e533
fix(docs): Refer to the OpenAI documentation to update the openai-functions docu… ( #3317 )
...
* Refer to the OpenAI documentation to update the openai-functions documentation
I saw the openai official website, apIn the description: The parameters `function_call` and `functions` have been replaced by `tool_choice` and `tools`.So I submitted this update;But I haven't read the code of localai, so I'm not sure if it also applies to localai.
Signed-off-by: 四少爷 <sex@jermey.cn >
* Update Usage Example
The original usage example was too outdated, and calling with the new version of the openai python package would result in errors. Therefore, the curl example was rewritten (as curl examples are also used elsewhere).
Signed-off-by: 四少爷 <sex@jermey.cn >
* add python example
Signed-off-by: 四少爷 <sex@jermey.cn >
---------
Signed-off-by: 四少爷 <sex@jermey.cn >
2024-08-21 13:09:26 +02:00
7ec02babd5
fix(parler-tts): pin numba
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-21 13:09:12 +02:00
5a4c4f4ab2
fix(parler-tts): pin llvmlite
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-21 10:46:31 +02:00
af095204fa
fix(p2p): avoid starting the node twice ( #3349 )
...
* fix(p2p): avoid starting the node twice
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(p2p): keep exposing service if we don't start the llama.cpp runner
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-21 10:30:56 +02:00
70e53bc191
chore(deps): update edgevpn
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-21 10:18:43 +02:00
