7b1e792732
deps(llama.cpp): bump to latest, update build variables ( #2669 )
...
* arrow_up: Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* deps(llama.cpp): update build variables to follow upstream
Update build recipes with https://github.com/ggerganov/llama.cpp/pull/8006
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable shared libs by default in llama.cpp
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable shared libs in llama.cpp Makefile
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable metal embedding for now, until it is tested
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(mac): explicitly enable metal
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* debug
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix typo
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-27 23:10:04 +02:00
5d83c8d3a2
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-25 19:23:58 +02:00
8f968d0341
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-25 19:18:43 +02:00
3ee5ceb9fa
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:16:55 +02:00
1bd72a3be5
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:16:27 +02:00
fbd14118bf
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:14:53 +02:00
515d98b978
Update model-gallery.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:10:49 +02:00
789cf6c599
Update model-gallery.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:10:27 +02:00
9a7ad75bff
docs: update to include installer and update advanced YAML options ( #2631 )
...
* docs: update quickstart and advanced sections
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: improvements
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* examples(kubernete): add nvidia example
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:00:38 +02:00
070fd1b9da
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:06:09 +02:00
dda5b9f260
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:05:48 +02:00
3f464d2d9e
Fix standard image latest Docker tags ( #2574 )
...
- Fix standard image latest Docker tags
Signed-off-by: Nate Harris <nwithan8@users.noreply.github.com >
2024-06-15 22:08:30 +02:00
148adebe16
docs: fix p2p commands ( #2472 )
...
Also change icons on GPT vision page
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-03 16:58:53 +02:00
b99182c8d4
TTS API improvements ( #2308 )
...
* update doc on COQUI_LANGUAGE env variable
Signed-off-by: blob42 <contact@blob42.xyz >
* return errors from tts gRPC backend
Signed-off-by: blob42 <contact@blob42.xyz >
* handle speaker_id and language in coqui TTS backend
Signed-off-by: blob42 <contact@blob42.xyz >
* TTS endpoint: add optional language paramter
Signed-off-by: blob42 <contact@blob42.xyz >
* tts fix: empty language string breaks non-multilingual models
Signed-off-by: blob42 <contact@blob42.xyz >
* allow tts param definition in config file
- consolidate TTS options under `tts` config entry
Signed-off-by: blob42 <contact@blob42.xyz >
* tts: update doc
Signed-off-by: blob42 <contact@blob42.xyz >
---------
Signed-off-by: blob42 <contact@blob42.xyz >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-01 18:26:27 +00:00
c603b95ac7
ci: pin build-time protoc ( #2461 )
...
ci: pin protoc
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 18:59:15 +02:00
5d31e5269d
feat(functions): allow response_regex to be a list ( #2447 )
...
feat(functions): allow regex match to be a list
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-31 22:52:02 +02:00
ff8a6962cd
build(Makefile): add back single target to build native llama-cpp ( #2448 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-31 18:35:33 +02:00
b90cdced59
docs: rewording
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-25 20:18:25 +02:00
fc3502b56f
docs: rewording
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-25 20:17:04 +02:00
785adc1ed5
docs: updaet title
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-25 16:13:48 +02:00
bb3ec56de3
docs: add distributed inferencing docs
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-25 16:12:08 +02:00
003b43f6fc
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-25 10:18:20 +02:00
e1d6b706f4
Update quickstart.md ( #2404 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-25 10:08:23 +02:00
b76d2fe68a
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-24 09:02:59 +02:00
114f549f5e
Add warning for running the binary on MacOS ( #2389 )
2024-05-23 22:40:55 +02:00
cf513efa78
Update openai-functions.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-10 17:09:51 +02:00
9e8b34427a
Update openai-functions.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-10 17:05:16 +02:00
88d0aa1e40
docs: update function docs
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-10 17:03:56 +02:00
e28ba4b807
Add missing Homebrew dependencies ( #2256 )
...
Signed-off-by: Michael Mior <michael.mior@gmail.com >
Signed-off-by: Michael Mior <mmior@mail.rit.edu >
2024-05-07 16:34:30 +00:00
169d8d21ff
gallery: Added some OpenVINO models ( #2249 )
...
* Added some OpenVINO models
Added Phi-3 trust_remote_code: true
Added Hermes 2 Pro Llama3
Added Multilingual-E5-base embedding model with OpenVINO acceleration (CPU and XPU)
Added all-MiniLM-L6-v2 with OpenVINO acceleration (CPU and XPU)
* Added Remote Code for phi, fixed error on Yamllint
* update openvino.yaml
I need to go to rest: today is not my day...
2024-05-06 10:52:05 +02:00
fa10302dd2
docs: updated Transformer parameters description ( #2234 )
...
updated Transformer parameters
2024-05-04 10:45:25 +02:00
147440b39b
docs: add reference for concurrent requests
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-04-29 18:31:50 +02:00
74d903acca
[Documentations] Removed invalid numberings from troubleshooting mac ( #2174 )
...
* updated troubleshooting mac
Signed-off-by: LeonSijiaLu <leonsijialu1@gmail.com >
* prepend -
Signed-off-by: LeonSijiaLu <leonsijialu1@gmail.com >
---------
Signed-off-by: LeonSijiaLu <leonsijialu1@gmail.com >
2024-04-29 02:21:51 +00:00
a24cd4fda0
docs: enhance and condense few sections ( #2178 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-28 23:41:59 +02:00
26e1892521
Issue-1720: Updated Build on mac documentations ( #2171 )
...
updated build on macs documentation
Signed-off-by: LeonSijiaLu <leonsijialu1@gmail.com >
2024-04-28 19:38:02 +02:00
a78cd67737
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-04-28 19:30:23 +02:00
5e243ceaeb
docs: update gallery, add rerankers ( #2166 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-28 15:54:15 +02:00
1a0a6f60a7
docs: update model-gallery.md with correct gallery file ( #2163 )
...
* Update model-gallery.md with correct gallery file
The readme points to a file that hasn't been updated in months so when there are announcements about new models, user's won't get them pointing to the old file. Point to the updated files instead.
Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com >
* Update model-gallery.md
second pass with more understanding
Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com >
* Update model-gallery.md
Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com >
* Update model-gallery.md
Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com >
---------
Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com >
2024-04-28 12:34:15 +02:00
9dbd217c59
docs(integrations): add Wave terminal
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-04-24 19:56:51 +02:00
0d8bf91699
feat: Galleries UI ( #2104 )
...
* WIP: add models to webui
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Register routes
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix: don't cache models
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* small fixups
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix: fixup multiple installs (strings.Clone)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-23 09:22:58 +02:00
b6f0e80d54
Update text-generation.md ( #2095 )
...
Signed-off-by: Taikono-Himazin <kazu@po.harenet.ne.jp >
2024-04-22 16:37:13 +02:00
729378ca98
AMD/ROCm Documentation update + formatting fix ( #2100 )
...
* Update aio-images.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
* Update aio-images.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
* Update aio-images.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
---------
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com >
2024-04-22 15:47:51 +02:00
b9e7708643
feat: enable polling configs for systems with broken fsnotify (docker volumes on windows) ( #2081 )
...
* feat: enable polling configs for systems with broken fsnotify (docker volumes on windows)
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: update logging to make it clear that the config file is being polled
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
---------
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
2024-04-19 19:31:15 -05:00
df4a13a08b
docs: fix stores link ( #2044 )
...
Signed-off-by: Adrien Brault <adrien.brault@gmail.com >
2024-04-16 11:10:23 +02:00
c751a4ac06
fix: remove build path from help text documentation ( #2037 )
...
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
2024-04-15 19:47:51 +00:00
4486db912b
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-04-13 22:57:46 +02:00
1981154f49
fix: dont commit generated files to git ( #1993 )
...
* fix: initial work towards not committing generated files to the repository
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat: improve build docs
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: remove unused folder from .dockerignore and .gitignore
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: attempt to fix extra backend tests
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: attempt to fix other tests
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: more test fixes
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: fix apple tests
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: more extras tests fixes
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: add GOBIN to PATH in docker build
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: extra tests and Dockerfile corrections
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: remove build dependency checks
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: add golang protobuf compilers to tests-linux action
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: ensure protogen is run for extra backend installs
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: use newer protobuf
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: more missing protoc binaries
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: missing dependencies during docker build
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: don't install grpc compilers in the final stage if they aren't needed
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: python-grpc-tools in 22.04 repos is too old
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: add a couple of extra build dependencies to Makefile
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: unbreak container rebuild functionality
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
---------
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
2024-04-13 09:37:32 +02:00
b2785ff06e
feat(gallery): support ConfigURLs ( #2012 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-12 00:49:23 +02:00
70c4f110a4
Update overview.md
2024-04-11 20:18:05 +02:00
24d7dadfed
feat: kong cli refactor fixes #1955 ( #1974 )
...
* feat: migrate to alecthomas/kong for CLI
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat: bring in new flag for granular log levels
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* chore: go mod tidy
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat: allow loading cli flag values from ["./localai.yaml", "~/.config/localai.yaml", "/etc/localai.yaml"] in that order
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat: load from .env file instead of a yaml file
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat: better loading for environment files
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat(doc): add initial documentation about configuration
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: remove test log lines
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat: integrate new documentation into existing pages
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat: add documentation on .env files
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* fix: cleanup some documentation table errors
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* feat: refactor CLI logic out to it's own package under core/cli
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
---------
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
2024-04-11 09:19:24 +02:00
