9337a01e9d
chore(deps): Bump docs/themes/hugo-theme-relearn from 8b14837 to 82a5e98 ( #3274 )
...
chore(deps): Bump docs/themes/hugo-theme-relearn
Bumps [docs/themes/hugo-theme-relearn](https://github.com/McShelby/hugo-theme-relearn ) from `8b14837` to `82a5e98`.
- [Release notes](https://github.com/McShelby/hugo-theme-relearn/releases )
- [Commits](8b14837336...82a5e9876csupport@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-19 22:38:54 +00:00
faadabea14
Update binaries.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-08-14 10:08:32 +02:00
57c96fe05e
chore(deps): Bump docs/themes/hugo-theme-relearn from 7aec99b to 8b14837 ( #3142 )
...
chore(deps): Bump docs/themes/hugo-theme-relearn
Bumps [docs/themes/hugo-theme-relearn](https://github.com/McShelby/hugo-theme-relearn ) from `7aec99b` to `8b14837`.
- [Release notes](https://github.com/McShelby/hugo-theme-relearn/releases )
- [Commits](7aec99b38d...8b14837336support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-06 00:46:41 +00:00
01d83129a2
docs: ⬆️ update docs version mudler/LocalAI ( #3109 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-08-01 22:09:50 +00:00
7c4e526853
fix: install.sh bash specific equality check ( #3038 )
...
fix == to = for sh portability
Signed-off-by: Dave Lee <dave@gray101.com >
2024-07-29 01:19:36 +02:00
5d08b9ac68
docs: ⬆️ update docs version mudler/LocalAI ( #3039 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-28 21:47:02 +00:00
9031d2b9eb
docs: ⬆️ update docs version mudler/LocalAI ( #3002 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-24 22:32:10 +00:00
89484efaed
docs: update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-24 12:27:49 +02:00
2966979161
chore(deps): Bump docs/themes/hugo-theme-relearn from 1b2e139 to 7aec99b ( #2952 )
...
chore(deps): Bump docs/themes/hugo-theme-relearn
Bumps [docs/themes/hugo-theme-relearn](https://github.com/McShelby/hugo-theme-relearn ) from `1b2e139` to `7aec99b`.
- [Release notes](https://github.com/McShelby/hugo-theme-relearn/releases )
- [Commits](1b2e139512...7aec99b38dsupport@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-22 22:26:35 +00:00
153e977155
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-07-22 17:35:10 +02:00
8667a67695
docs: ⬆️ update docs version mudler/LocalAI ( #2935 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-20 21:33:54 +00:00
87bd831aba
docs: add federation ( #2929 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-20 10:43:18 +02:00
bd277162c7
docs: ⬆️ update docs version mudler/LocalAI ( #2926 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-19 21:56:58 +00:00
bf9dd1de7f
feat(functions): parse broken JSON when we parse the raw results, use dynamic rules for grammar keys ( #2912 )
...
* feat(functions): enhance parsing with broken JSON when we parse the raw results
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* breaking: make function name by default
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(grammar): dynamically generate grammars with mutating keys
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* refactor: simplify condition
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Update docs
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 17:52:22 +02:00
607900a4bb
docs: more swagger, update docs ( #2907 )
...
* docs(swagger): finish convering gallery section
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add section to explain how to install models with local-ai run
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Minor docs adjustments
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-18 11:25:21 +02:00
6de12c694a
docs: update try-it-out.md ( #2906 )
2024-07-18 03:21:22 +00:00
35561edb6e
feat(llama.cpp): support embeddings endpoints ( #2871 )
...
* feat(llama.cpp): add embeddings
Also enable embeddings by default for llama.cpp models
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(Makefile): prepare llama.cpp sources only once
Otherwise we keep cloning llama.cpp for each of the variants
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* do not set embeddings to false
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add embeddings to the YAML config reference
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-15 22:54:16 +02:00
edea2e7c3a
docs: add a note on benchmarks ( #2857 )
...
Add a note on LocalAI defaults and benchmarks in our FAQ section.
See also https://github.com/mudler/LocalAI/issues/2780
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-14 12:16:04 +02:00
3ed03d04df
chore(deps): Bump docs/themes/hugo-theme-relearn from c25bc2a to 1b2e139 ( #2801 )
...
chore(deps): Bump docs/themes/hugo-theme-relearn
Bumps [docs/themes/hugo-theme-relearn](https://github.com/McShelby/hugo-theme-relearn ) from `c25bc2a` to `1b2e139`.
- [Release notes](https://github.com/McShelby/hugo-theme-relearn/releases )
- [Commits](c25bc2a27a...1b2e139512support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-13 01:54:40 +00:00
fc87507012
chore(deps): Update Dependencies ( #2538 )
...
* chore(deps): Update dependencies
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com >
* chore(deps): Upgrade github.com/imdario/mergo to dario.cat/mergo
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com >
* remove version identifiers for MeloTTS
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com >
---------
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com >
Signed-off-by: Dave <dave@gray101.com >
Co-authored-by: Dave <dave@gray101.com >
2024-07-12 19:54:08 +00:00
95e31fd279
feat(install.sh): support federated install ( #2752 )
...
* feat(install.sh): support federated install
This allows to support federation by exposing:
- FEDERATED: true/false to share the instance
- FEDERATED_SERVER: true/false to start the federated load balancer (it
forwards requests to the federation)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: update installer parameters
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: Dave <dave@gray101.com >
2024-07-12 08:42:21 +02:00
d5a56f04be
feat(p2p): allow to disable DHT and use only LAN ( #2751 )
...
This allows LocalAI to be less noisy avoiding to connect outside.
Needed if e.g. there is no plan into using p2p across separate networks.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-09 23:10:02 +02:00
cca881ec49
feat(p2p): Federation and AI swarms ( #2723 )
...
* Wip p2p enhancements
* get online state
* Pass-by token to show in the dashboard
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Style
* Minor fixups
* parametrize SearchID
* Refactoring
* Allow to expose/bind more services
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Add federation
* Display federated mode in the WebUI
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Small fixups
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* make federated nodes visible from the WebUI
* Fix version display
* improve web page
* live page update
* visual enhancements
* enhancements
* visual enhancements
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-07-08 22:04:06 +02:00
62b4030278
⬆️ Update docs version mudler/LocalAI ( #2699 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-07-03 00:22:53 +00:00
522f185baf
⬆️ Update docs version mudler/LocalAI ( #2676 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-29 01:20:50 +00:00
7b1e792732
deps(llama.cpp): bump to latest, update build variables ( #2669 )
...
* arrow_up: Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* deps(llama.cpp): update build variables to follow upstream
Update build recipes with https://github.com/ggerganov/llama.cpp/pull/8006
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable shared libs by default in llama.cpp
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable shared libs in llama.cpp Makefile
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable metal embedding for now, until it is tested
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(mac): explicitly enable metal
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* debug
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix typo
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-27 23:10:04 +02:00
5d83c8d3a2
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-25 19:23:58 +02:00
8f968d0341
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-25 19:18:43 +02:00
9e6dec0bc4
fix(install.sh): not all systems have nproc
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 18:21:20 +02:00
69206fcd4b
fix(install.sh): move ARCH detection so it works also for mac ( #2646 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 10:34:35 +02:00
2c94e15746
fix(install.sh): fix version typo ( #2645 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 10:30:17 +02:00
0f9aa1ef91
fix(install.sh): install CUDA toolkit only if CUDA is detected
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:21:59 +02:00
3ee5ceb9fa
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:16:55 +02:00
1bd72a3be5
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:16:27 +02:00
fbd14118bf
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:14:53 +02:00
515d98b978
Update model-gallery.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:10:49 +02:00
789cf6c599
Update model-gallery.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:10:27 +02:00
0bc82d7270
fix(install.sh): properly detect suse distros
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:08:48 +02:00
9a7ad75bff
docs: update to include installer and update advanced YAML options ( #2631 )
...
* docs: update quickstart and advanced sections
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: improvements
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* examples(kubernete): add nvidia example
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:00:38 +02:00
070fd1b9da
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:06:09 +02:00
dda5b9f260
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:05:48 +02:00
260f2e1d94
fix(install.sh): correctly handle systemd service installation ( #2627 )
...
Fixup install.sh systemd service installation
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-21 23:56:06 +02:00
db0e52ae9d
⬆️ Update docs version mudler/LocalAI ( #2605 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-20 00:05:19 +00:00
c30b57a629
⬆️ Update docs version mudler/LocalAI ( #2593 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-18 01:47:04 +00:00
3f464d2d9e
Fix standard image latest Docker tags ( #2574 )
...
- Fix standard image latest Docker tags
Signed-off-by: Nate Harris <nwithan8@users.noreply.github.com >
2024-06-15 22:08:30 +02:00
f404580256
docs: bump go version
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-13 00:49:51 +02:00
603d81dda1
feat(install): add install.sh for quick installs ( #2489 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-07 22:30:41 +02:00
148adebe16
docs: fix p2p commands ( #2472 )
...
Also change icons on GPT vision page
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-03 16:58:53 +02:00
b99182c8d4
TTS API improvements ( #2308 )
...
* update doc on COQUI_LANGUAGE env variable
Signed-off-by: blob42 <contact@blob42.xyz >
* return errors from tts gRPC backend
Signed-off-by: blob42 <contact@blob42.xyz >
* handle speaker_id and language in coqui TTS backend
Signed-off-by: blob42 <contact@blob42.xyz >
* TTS endpoint: add optional language paramter
Signed-off-by: blob42 <contact@blob42.xyz >
* tts fix: empty language string breaks non-multilingual models
Signed-off-by: blob42 <contact@blob42.xyz >
* allow tts param definition in config file
- consolidate TTS options under `tts` config entry
Signed-off-by: blob42 <contact@blob42.xyz >
* tts: update doc
Signed-off-by: blob42 <contact@blob42.xyz >
---------
Signed-off-by: blob42 <contact@blob42.xyz >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-01 18:26:27 +00:00
c603b95ac7
ci: pin build-time protoc ( #2461 )
...
ci: pin protoc
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 18:59:15 +02:00
