c0d17c2ff6
Merge branch 'master' into default_miro
2024-07-18 17:52:32 +02:00
bf9dd1de7f
feat(functions): parse broken JSON when we parse the raw results, use dynamic rules for grammar keys ( #2912 )
...
* feat(functions): enhance parsing with broken JSON when we parse the raw results
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* breaking: make function name by default
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(grammar): dynamically generate grammars with mutating keys
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* refactor: simplify condition
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Update docs
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 17:52:22 +02:00
35d55572ac
fix: do not list txt files as potential models ( #2910 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 14:44:44 +02:00
c7357a9872
fix: short-circuit when nodes aren't detected ( #2909 )
...
Fixes:
```
panic: invalid argument to IntN
goroutine 401 [running]:
math/rand/v2.(*Rand).IntN(...)
/home/mudler/_git/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.4.linux-amd64/src/math/rand/v2/rand.go:190
math/rand/v2.IntN(...)
/home/mudler/_git/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.4.linux-amd64/src/math/rand/v2/rand.go:307
github.com/mudler/LocalAI/core/cli.Proxy.func2()
/home/mudler/_git/LocalAI/core/cli/federated.go:104 +0x76e
created by github.com/mudler/LocalAI/core/cli.Proxy in goroutine 1
/home/mudler/_git/LocalAI/core/cli/federated.go:91 +0x3c5
```
When no nodes are found and something is trying to hit the federated
endpoint (and no tunnels are ready yet).
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 14:44:31 +02:00
27e16a00fa
ci: correctly use the pinned nvidia version
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 14:36:26 +02:00
919e2e4369
feat(swagger): update swagger ( #2908 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-18 11:42:45 +00:00
4e4078854b
fix(llama.cpp): disable mirostat as default
...
Even if increasing the quality of the output, it has shown to have
performance drawbacks to be so noticeable that the confuses users about
speed of LocalAI ( see also
https://github.com/mudler/LocalAI/issues/2780 ).
This changeset disables Mirostat by default (which can
be still enabled manually).
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 12:35:11 +02:00
96f67efe32
ci(swagger): run protogen-go before
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 11:28:44 +02:00
607900a4bb
docs: more swagger, update docs ( #2907 )
...
* docs(swagger): finish convering gallery section
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add section to explain how to install models with local-ai run
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Minor docs adjustments
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 11:25:21 +02:00
53c8ab1020
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-18 10:01:08 +02:00
81d01e8a5f
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-18 10:00:05 +02:00
b8b0c7ad0b
docs(swagger): core more localai/openai endpoints ( #2904 )
...
* docs(swagger): core more localai/openai endpoints
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix swagger descriptions for backend_monitor.go
Signed-off-by: Dave <dave@gray101.com >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Signed-off-by: Dave <dave@gray101.com >
Co-authored-by: Dave <dave@gray101.com >
2024-07-18 00:38:41 -04:00
6de12c694a
docs: update try-it-out.md ( #2906 )
2024-07-18 03:21:22 +00:00
25f97910cc
chore: ⬆️ Update ggerganov/llama.cpp ( #2905 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-17 21:45:10 +00:00
89bd04c0ac
models(gallery): add flammenai/Mahou-1.3d-mistral-7B ( #2903 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-17 20:13:24 +02:00
195d3b9f03
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 20:11:52 +02:00
865496f80b
models(gallery): add MythicalMaid/EtherealMaid 15b ( #2902 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-17 19:29:43 +02:00
4a22e54cda
Update comment-pr.yaml
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 19:29:27 +02:00
bd8e2320c3
models(gallery): add mathstral-7b-v0.1-imat ( #2901 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-17 18:19:54 +02:00
b5661d6302
Update comment-pr.yaml
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 18:19:41 +02:00
e7813d4ec4
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 15:14:22 +02:00
d384627fa9
ci: evaluate diff from base branch
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 08:45:11 +02:00
1ed6b96dd7
ci: use github action ( #2899 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-16 23:57:01 -04:00
53f90218b0
chore: ⬆️ Update ggerganov/llama.cpp ( #2897 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-16 23:13:02 +00:00
112d6a3083
chore: ⬆️ Update ggerganov/whisper.cpp ( #2898 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-16 22:42:43 +00:00
1f7cedf5ee
build: fix go.mod - don't import ourself ( #2896 )
...
* minor cleanup to go.mod - importing ourself?
Signed-off-by: Dave Lee <dave@gray101.com >
* figured out why we were importing ourself and fixed it
Signed-off-by: Dave Lee <dave@gray101.com >
* set pull_request_target
Signed-off-by: Dave Lee <dave@gray101.com >
---------
Signed-off-by: Dave Lee <dave@gray101.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-16 22:49:43 +02:00
50cdfe0090
ci: change action for commenting PRs
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-16 22:40:09 +02:00
c6838d4301
ci: comment PRs as LocalAI bot
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-16 20:05:29 +02:00
4e84764787
fix: Lora loading ( #2893 )
...
- Fixed Lora loading
Co-authored-by: Alex <alex@akhbar.home >
2024-07-16 18:58:45 +02:00
f521e50fa8
ci: add workflow to comment new Opened PRs ( #2892 )
...
* ci: add workflow to comment new Opened PRs
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Update comment-pr.yaml
eliminate a stray ' character that was terminating the shell script by slightly rewriting the prompt
Signed-off-by: Dave <dave@gray101.com >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Signed-off-by: Dave <dave@gray101.com >
Co-authored-by: Dave <dave@gray101.com >
2024-07-16 16:49:23 +00:00
09de674b03
models(gallery): add l3-8b-niitama-v1 ( #2895 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-16 15:58:00 +02:00
b1da8aa145
chore(deps): Bump openai from 1.33.0 to 1.35.13 in /examples/langchain/langchainpy-localai-example ( #2876 )
...
chore(deps): Bump openai
Bumps [openai](https://github.com/openai/openai-python ) from 1.33.0 to 1.35.13.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.33.0...v1.35.13 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-16 05:14:42 +00:00
58f8f8d381
chore(deps): Bump langchain from 0.2.7 to 0.2.8 in /examples/langchain-chroma ( #2872 )
...
chore(deps): Bump langchain in /examples/langchain-chroma
Bumps [langchain](https://github.com/langchain-ai/langchain ) from 0.2.7 to 0.2.8.
- [Release notes](https://github.com/langchain-ai/langchain/releases )
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain==0.2.7...langchain==0.2.8 )
---
updated-dependencies:
- dependency-name: langchain
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-16 04:34:16 +00:00
db658adc7a
chore(deps): Bump langchain-community from 0.2.5 to 0.2.7 in /examples/langchain/langchainpy-localai-example ( #2875 )
...
chore(deps): Bump langchain-community
Bumps [langchain-community](https://github.com/langchain-ai/langchain ) from 0.2.5 to 0.2.7.
- [Release notes](https://github.com/langchain-ai/langchain/releases )
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain-community==0.2.5...langchain-community==0.2.7 )
---
updated-dependencies:
- dependency-name: langchain-community
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-16 03:01:53 +00:00
01a4f103f5
chore(deps): Bump debugpy from 1.8.1 to 1.8.2 in /examples/langchain/langchainpy-localai-example ( #2878 )
...
chore(deps): Bump debugpy
Bumps [debugpy](https://github.com/microsoft/debugpy ) from 1.8.1 to 1.8.2.
- [Release notes](https://github.com/microsoft/debugpy/releases )
- [Commits](https://github.com/microsoft/debugpy/compare/v1.8.1...v1.8.2 )
---
updated-dependencies:
- dependency-name: debugpy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-16 03:01:38 +00:00
38b3115a15
fix: cleanup indentation and remove duplicate dockerfile stanza ( #2889 )
...
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
2024-07-16 01:51:15 +00:00
a3eb6e04c1
fix: update grpcio version to match version used in builds ( #2888 )
...
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
2024-07-16 01:39:10 +00:00
a83fa725e1
chore: ⬆️ Update ggerganov/llama.cpp ( #2886 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-16 01:28:35 +00:00
b591d8c659
chore: ⬆️ Update ggerganov/whisper.cpp ( #2885 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-16 00:00:53 +00:00
bc2b8e0063
feat(swagger): update swagger ( #2884 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-15 23:39:48 +00:00
85c7b28364
chore(deps): Bump numexpr from 2.10.0 to 2.10.1 in /examples/langchain/langchainpy-localai-example ( #2877 )
...
chore(deps): Bump numexpr
Bumps [numexpr](https://github.com/pydata/numexpr ) from 2.10.0 to 2.10.1.
- [Release notes](https://github.com/pydata/numexpr/releases )
- [Changelog](https://github.com/pydata/numexpr/blob/master/RELEASE_NOTES.rst )
- [Commits](https://github.com/pydata/numexpr/compare/v2.10.0...v2.10.1 )
---
updated-dependencies:
- dependency-name: numexpr
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-15 21:41:42 +00:00
d1a5c343b7
chore(deps): Bump langchain from 0.2.7 to 0.2.8 in /examples/langchain/langchainpy-localai-example ( #2874 )
...
chore(deps): Bump langchain
Bumps [langchain](https://github.com/langchain-ai/langchain ) from 0.2.7 to 0.2.8.
- [Release notes](https://github.com/langchain-ai/langchain/releases )
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain==0.2.7...langchain==0.2.8 )
---
updated-dependencies:
- dependency-name: langchain
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-15 21:30:21 +00:00
7dbf49ab22
models(gallery): add ezo model series (llama3, gemma) ( #2891 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-15 23:19:55 +02:00
b375a654e7
chore(deps): Bump langchain from 0.2.7 to 0.2.8 in /examples/functions ( #2873 )
...
Bumps [langchain](https://github.com/langchain-ai/langchain ) from 0.2.7 to 0.2.8.
- [Release notes](https://github.com/langchain-ai/langchain/releases )
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain==0.2.7...langchain==0.2.8 )
---
updated-dependencies:
- dependency-name: langchain
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-15 21:09:16 +00:00
12a96c520a
models(gallery): ⬆️ update checksum ( #2887 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-15 22:56:35 +02:00
35561edb6e
feat(llama.cpp): support embeddings endpoints ( #2871 )
...
* feat(llama.cpp): add embeddings
Also enable embeddings by default for llama.cpp models
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(Makefile): prepare llama.cpp sources only once
Otherwise we keep cloning llama.cpp for each of the variants
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* do not set embeddings to false
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add embeddings to the YAML config reference
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-15 22:54:16 +02:00
6564e7ea01
docs(swagger): cover p2p endpoints ( #2862 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-15 08:31:38 +02:00
121bce581c
Revert "chore(deps): Bump numpy from 1.26.4 to 2.0.0 in /backend/python/openvoice" ( #2868 )
...
Revert "chore(deps): Bump numpy from 1.26.4 to 2.0.0 in /backend/python/openv…"
This reverts commit 6ba730d7f8
2024-07-15 08:31:27 +02:00
9d3c6d321e
chore: ⬆️ Update ggerganov/llama.cpp ( #2859 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-14 21:54:42 +00:00
23835f8cca
feat(swagger): update swagger ( #2858 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-14 21:44:18 +00:00
