3a4fb6fa4b
feat(entrypoint): optionally prepare extra endpoints ( #1405 )
...
entrypoint: optionally prepare extra endpoints
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-08 20:04:13 +01:00
b181503c30
docs: update v2.0.0 notes
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-08 16:06:24 +01:00
887b3dff04
feat: cuda transformers ( #1401 )
...
* Use cuda in transformers if available
tensorflow probably needs a different check.
Signed-off-by: Erich Schubert <kno10@users.noreply.github.com >
* feat: expose CUDA at top level
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* tests: add to tests and create workflow for py extra backends
* doc: update note on how to use core images
---------
Signed-off-by: Erich Schubert <kno10@users.noreply.github.com >
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: Erich Schubert <kno10@users.noreply.github.com >
2023-12-08 15:45:04 +01:00
3822bd2369
docs: updates
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-08 15:11:44 +01:00
4de2c6a421
docs: update news
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-08 14:59:25 +01:00
6c4231fd35
docs: 2.0 updates
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-08 14:58:53 +01:00
adfa7aa1fa
docs: site update fixing old image text / How To update updating GPU and CPU docker pages ( #1399 )
...
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-08 10:27:21 +01:00
8b6e601405
Feat: new backend: transformers-musicgen ( #1387 )
...
Transformers-MusicGen
---------
Signed-off-by: Dave <dave@gray101.com >
2023-12-08 10:01:02 +01:00
6011911746
fix(piper): pin petals, phonemize and espeak ( #1393 )
...
* fix: pin phonemize and espeak
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix: pin petals deps
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-07 22:58:41 +01:00
997119c27a
⬆️ Update ggerganov/llama.cpp ( #1385 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-05 15:44:24 +01:00
2eb6865a27
Fix: API Key / JSON Fast Follow #1 ( #1388 )
...
fast follow fix #1 - imports, final loop, one last chance to skip
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-05 10:35:27 +00:00
2b2d6673ff
exllama(v2): fix exllamav1, add exllamav2 ( #1384 )
...
* fix(exllama): fix exllama deps with anaconda
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(exllamav2): add exllamav2 backend
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-05 08:15:37 +01:00
563c5b7ea0
Added Check API KEYs file to API.go ( #1381 )
...
Added API KEYs file
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-04 22:06:45 -05:00
67966b623c
⬆️ Update ggerganov/llama.cpp ( #1379 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-04 18:36:34 +01:00
9fc3fd04be
⬆️ Update ggerganov/whisper.cpp ( #1378 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-04 18:36:22 +01:00
238fec244a
fix(vall-e-x): correctly install reqs in environment ( #1377 )
2023-12-03 21:16:36 +01:00
3d71bc9b64
⬆️ Update ggerganov/whisper.cpp ( #1227 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-03 01:16:07 +01:00
3923024d84
update whisper_cpp with CUBLAS, HIPBLAS, METAL, OPENBLAS, CLBLAST support ( #1302 )
...
update whisper_cpp to 1.5.1 with OPENBLAS, METAL, HIPBLAS, CUBLAS, CLBLAST support
2023-12-02 10:10:18 +00:00
710b195be1
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:55:26 +01:00
6e408137ee
Update fine-tuning.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:54:21 +01:00
9b205cfcfc
Update fine-tuning.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:52:00 +01:00
42a80d1b8b
⬆️ Update ggerganov/llama.cpp ( #1375 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-02 00:09:48 +00:00
d6073ac18e
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-01 20:05:58 +01:00
1c450d46cf
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-01 20:01:07 +01:00
6b312a8522
Site Clean up - How to Clean up ( #1342 )
...
* Create easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-curl.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-openai-v0.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-openai-v1.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-openai-v1.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-openai-v0.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-curl.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update and rename easy-model-import-downloaded.md to easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/autogen-setup.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-autogen.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-01 19:12:21 +01:00
2b2007ae9e
docs: add fine-tuning example ( #1374 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-01 19:11:45 +01:00
e94a34be8c
fix: OSX Build Fix Part 1: Metal ( #1365 )
...
* Make Metal the default on OSX, simplify osx-specific code, and fix the file copy error.
* fix endif / comment
2023-11-30 19:50:50 +01:00
c3fb4b1d8e
ci: rename workflow
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-11-30 19:25:33 +01:00
e3ca1a7dbe
ci: split into reusable workflows ( #1366 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-30 19:24:37 +01:00
2d64d8b444
fix/docs: Python backend dependencies ( #1360 )
...
* Update docs for new requirements.txt path
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
* Fix typo (.PONY -> .PHONY) in python backend makefiles
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
2023-11-30 17:46:55 +01:00
9b98be160a
ci: limit concurrent jobs ( #1364 )
...
* ci: limit concurrent image push
* docs: mention core images
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-30 17:45:20 +01:00
9f708ff318
⬆️ Update ggerganov/llama.cpp ( #1363 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-30 00:06:28 +01:00
4e0ad33d92
docs: Update getting started and GPU section ( #1362 )
2023-11-29 18:51:57 +01:00
519285bf38
⬆️ Update ggerganov/llama.cpp ( #1351 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-29 08:29:03 +01:00
fd1b7b3f22
docs: Add docker instructions, add community projects section in README ( #1359 )
...
docs: Add docker instructions
2023-11-28 23:14:16 +01:00
687730a7f5
fix: go-piper add libucd at linking time ( #1357 )
...
Signed-off-by: Gianluca Boiano <morf3089@gmail.com >
2023-11-28 19:55:09 +00:00
b7821361c3
feat(petals): add backend ( #1350 )
...
* feat(petals): add backend
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fixups
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-28 09:01:46 +01:00
63e1f8fffd
⬆️ Update ggerganov/llama.cpp ( #1345 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-27 09:02:19 +01:00
824612f1b4
feat: initial watchdog implementation ( #1341 )
...
* feat: initial watchdog implementation
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* fiuxups
* Add more output
* wip: idletime checker
* wire idle watchdog checks
* enlarge watchdog time window
* small fixes
* Use stopmodel
* Always delete process
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-26 18:36:23 +01:00
9482acfdfc
⬆️ Update ggerganov/llama.cpp ( #1340 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-26 09:27:42 +01:00
c75bdd99e4
fix: rename transformers.py to avoid circular import ( #1337 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-26 08:49:43 +01:00
6f34e8f044
fix: propagate CMAKE_ARGS when building grpc ( #1334 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-25 13:53:51 +01:00
6d187af643
fix: handle grpc and llama-cpp with REBUILD=true ( #1328 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-25 08:48:24 +01:00
97e9598c79
⬆️ Update ggerganov/llama.cpp ( #1330 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-24 23:45:05 +01:00
5a6a6de3d7
docs: Update Features->Embeddings page to reflect backend restructuring ( #1325 )
...
* Update path to sentencetransformers backend for local execution
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
* Rename huggingface-embeddings -> sentencetransformers in embeddings.md for consistency with the backend structure
The Dockerfile still knows the "huggingface-embeddings"
backend (I assume for compatibility reasons) but uses the
sentencetransformers backend under the hood anyway.
I figured it would be good to update the docs to use the new naming to
make it less confusing moving forward. As the docker container knows
both the "huggingface-embeddings" and the "sentencetransformers"
backend, this should not break anything.
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
2023-11-24 18:21:04 +01:00
b1a20effde
⬆️ Update ggerganov/llama.cpp ( #1323 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-24 08:32:36 +01:00
ba5ab26f2e
docs: Add llava, update hot topics ( #1322 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-23 18:54:55 +01:00
69f53211a1
Feat: OSX Local Codesigning ( #1319 )
...
* stage makefile
* OSX local code signing and entitlements file to fix incoming connections prompt
2023-11-23 15:22:54 +01:00
9dddd1134d
fix: move python header comments below shebang in some backends ( #1321 )
...
* Fix python header comments for some extra gRPC backends
When a Python script is to be executed directly via exec(3), either the platform knows how to execute
the file itself (i.e. special configuration is necessary) or the first line
contains a shebang (#!) specifying the interpreter to run it (similar to
shell scripts).
The shebang MUST be on the first line for the script to work on all platforms,
so any header comments need to be in the lines following it. Otherwise
executing these scripts as extra backends will yield an "exec format
error" message.
Changes:
* Move introductory comments below the shebang line
* Change header comment in transformers.py to refer to the correct
python module
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
* Make header comment in ttsbark.py more specific
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
2023-11-23 15:22:37 +01:00
c5c77d2b0d
docs: Initial import from localai-website ( #1312 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-22 18:13:50 +01:00
