86509e6002
chore: ⬆️ Update ggerganov/llama.cpp ( #2936 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-20 21:35:21 +00:00
8667a67695
docs: ⬆️ update docs version mudler/LocalAI ( #2935 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-20 21:33:54 +00:00
f505d7ab3f
models(gallery): add archangel_sft_pythia2-8b ( #2933 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-20 16:17:34 +02:00
450dbed820
models(gallery): add suzume-orpo ( #2932 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-20 16:16:29 +02:00
46b86f7e6e
models(gallery): add tulu 8b and 70b ( #2931 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-20 16:03:44 +02:00
0ee1f8c1cf
ci(Makefile): enable p2p on cross-arm64 builds ( #2928 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-20 10:43:34 +02:00
87bd831aba
docs: add federation ( #2929 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-20 10:43:18 +02:00
f9f83791d1
ci(release): run also on tags
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-20 09:15:48 +02:00
e75f73bf73
chore: ⬆️ Update ggerganov/llama.cpp ( #2927 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-19 22:10:26 +00:00
bd277162c7
docs: ⬆️ update docs version mudler/LocalAI ( #2926 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-19 21:56:58 +00:00
f19ee465d2
ci: disable comment-pr until it's fixed
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-19 19:00:36 +02:00
7b85ff7280
models(gallery): add celestev1 ( #2925 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-19 18:43:30 +02:00
134cb993c2
models(gallery): add emo-2b ( #2924 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-19 18:36:11 +02:00
2cf28f3c01
models(gallery): add gemma-2b-translation-v0.150 ( #2923 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-19 18:31:27 +02:00
18c0f4718d
models(gallery): add einstein-v4-7b ( #2922 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-19 15:20:15 +02:00
f878b63ee4
models(gallery): add qwen2-wukong-7b ( #2921 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-19 09:48:05 +02:00
6eaa01db15
models(gallery): add phillama-3.8b-v0.1 ( #2920 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-19 09:42:45 +02:00
1d605073a4
models(gallery): add big-tiger-gemma-27b-v1 ( #2918 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-19 09:10:08 +02:00
fc29c04f82
groundwork: add pkg/concurrency and the associated test file ( #2745 )
...
groundwork: add pkg/concurrency and the associated test case
Signed-off-by: Dave Lee <dave@gray101.com >
2024-07-18 23:29:21 +00:00
63fc22baab
Update comment-pr.yaml
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-18 23:25:03 +02:00
6a919b30ac
chore: ⬆️ Update ggerganov/llama.cpp ( #2917 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-18 23:21:17 +02:00
3f7ec2e596
feat(swagger): update swagger ( #2916 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-18 23:20:52 +02:00
82d5123c1e
Update comment-pr.yaml
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-18 23:20:37 +02:00
252961751c
feat(federation): add load balanced option ( #2915 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 23:18:53 +02:00
031627584b
ci: try to fix commit-pr workflow
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-18 19:44:18 +02:00
24a8eebcef
refactor: move federated server logic to its own service ( #2914 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 19:15:15 +02:00
bf9dd1de7f
feat(functions): parse broken JSON when we parse the raw results, use dynamic rules for grammar keys ( #2912 )
...
* feat(functions): enhance parsing with broken JSON when we parse the raw results
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* breaking: make function name by default
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(grammar): dynamically generate grammars with mutating keys
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* refactor: simplify condition
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Update docs
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 17:52:22 +02:00
35d55572ac
fix: do not list txt files as potential models ( #2910 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 14:44:44 +02:00
c7357a9872
fix: short-circuit when nodes aren't detected ( #2909 )
...
Fixes:
```
panic: invalid argument to IntN
goroutine 401 [running]:
math/rand/v2.(*Rand).IntN(...)
/home/mudler/_git/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.4.linux-amd64/src/math/rand/v2/rand.go:190
math/rand/v2.IntN(...)
/home/mudler/_git/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.4.linux-amd64/src/math/rand/v2/rand.go:307
github.com/mudler/LocalAI/core/cli.Proxy.func2()
/home/mudler/_git/LocalAI/core/cli/federated.go:104 +0x76e
created by github.com/mudler/LocalAI/core/cli.Proxy in goroutine 1
/home/mudler/_git/LocalAI/core/cli/federated.go:91 +0x3c5
```
When no nodes are found and something is trying to hit the federated
endpoint (and no tunnels are ready yet).
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 14:44:31 +02:00
27e16a00fa
ci: correctly use the pinned nvidia version
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 14:36:26 +02:00
919e2e4369
feat(swagger): update swagger ( #2908 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-18 11:42:45 +00:00
96f67efe32
ci(swagger): run protogen-go before
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 11:28:44 +02:00
607900a4bb
docs: more swagger, update docs ( #2907 )
...
* docs(swagger): finish convering gallery section
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add section to explain how to install models with local-ai run
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Minor docs adjustments
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 11:25:21 +02:00
53c8ab1020
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-18 10:01:08 +02:00
81d01e8a5f
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-18 10:00:05 +02:00
b8b0c7ad0b
docs(swagger): core more localai/openai endpoints ( #2904 )
...
* docs(swagger): core more localai/openai endpoints
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix swagger descriptions for backend_monitor.go
Signed-off-by: Dave <dave@gray101.com >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Signed-off-by: Dave <dave@gray101.com >
Co-authored-by: Dave <dave@gray101.com >
2024-07-18 00:38:41 -04:00
6de12c694a
docs: update try-it-out.md ( #2906 )
2024-07-18 03:21:22 +00:00
25f97910cc
chore: ⬆️ Update ggerganov/llama.cpp ( #2905 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-17 21:45:10 +00:00
89bd04c0ac
models(gallery): add flammenai/Mahou-1.3d-mistral-7B ( #2903 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-17 20:13:24 +02:00
195d3b9f03
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 20:11:52 +02:00
865496f80b
models(gallery): add MythicalMaid/EtherealMaid 15b ( #2902 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-17 19:29:43 +02:00
4a22e54cda
Update comment-pr.yaml
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 19:29:27 +02:00
bd8e2320c3
models(gallery): add mathstral-7b-v0.1-imat ( #2901 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-17 18:19:54 +02:00
b5661d6302
Update comment-pr.yaml
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 18:19:41 +02:00
e7813d4ec4
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 15:14:22 +02:00
d384627fa9
ci: evaluate diff from base branch
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-17 08:45:11 +02:00
1ed6b96dd7
ci: use github action ( #2899 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-16 23:57:01 -04:00
53f90218b0
chore: ⬆️ Update ggerganov/llama.cpp ( #2897 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-16 23:13:02 +00:00
112d6a3083
chore: ⬆️ Update ggerganov/whisper.cpp ( #2898 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-16 22:42:43 +00:00
1f7cedf5ee
build: fix go.mod - don't import ourself ( #2896 )
...
* minor cleanup to go.mod - importing ourself?
Signed-off-by: Dave Lee <dave@gray101.com >
* figured out why we were importing ourself and fixed it
Signed-off-by: Dave Lee <dave@gray101.com >
* set pull_request_target
Signed-off-by: Dave Lee <dave@gray101.com >
---------
Signed-off-by: Dave Lee <dave@gray101.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-16 22:49:43 +02:00
