1b7ed5e2e6
docs: add aikit to integrations ( #1412 )
...
* docs: add aikit to integrations
Signed-off-by: Sertac Ozercan <sozercan@gmail.com >
* docs: add to readme
Signed-off-by: Sertac Ozercan <sozercan@gmail.com >
---------
Signed-off-by: Sertac Ozercan <sozercan@gmail.com >
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-12 18:58:57 +01:00
86fac272d8
⬆️ Update ggerganov/llama.cpp ( #1391 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-12 18:22:48 +01:00
865e523ff1
Documentation for Hipblas ( #1425 )
...
hiplas arch
2023-12-12 15:05:01 +01:00
9aa2a7ca13
extras: add vllm,bark,vall-e-x tests, bump diffusers ( #1422 )
...
* tests: add vllm
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* tests: Add vall-e-x tests
* Add bark tests
* bump diffusers
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-12 00:39:26 +01:00
e80cbca6b0
Update _index.en.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-12 00:37:01 +01:00
718a5d4a9e
fix(transformers*): add sentence-transformers and transformers-musicgen tests, fix musicgen wrapper ( #1420 )
...
* tests: add sentence-transformers and transformers-musicgen
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* fix: tranformers-musicgen conda env
Initialize correctly the environment for the transformers-musicgen backend.
* fix(tests): transformer-musicgen tests fixups
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-11 19:26:02 +01:00
9222bec8b1
How To Updates / Model Used Switched / Removed "docker-compose" (RIP) ( #1417 )
...
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-11 14:27:29 +00:00
4a965e1b0e
⬆️ Update ggerganov/whisper.cpp ( #1418 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-11 08:24:48 +01:00
48e5380e45
tests: add diffusers tests ( #1419 )
2023-12-11 08:20:34 +01:00
831418612b
⬆️ Update mudler/go-piper ( #1400 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-10 08:50:26 +01:00
89ff12309d
⬆️ Update ggerganov/whisper.cpp ( #1390 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-09 09:23:40 +01:00
3a4fb6fa4b
feat(entrypoint): optionally prepare extra endpoints ( #1405 )
...
entrypoint: optionally prepare extra endpoints
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-08 20:04:13 +01:00
b181503c30
docs: update v2.0.0 notes
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-08 16:06:24 +01:00
887b3dff04
feat: cuda transformers ( #1401 )
...
* Use cuda in transformers if available
tensorflow probably needs a different check.
Signed-off-by: Erich Schubert <kno10@users.noreply.github.com >
* feat: expose CUDA at top level
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* tests: add to tests and create workflow for py extra backends
* doc: update note on how to use core images
---------
Signed-off-by: Erich Schubert <kno10@users.noreply.github.com >
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: Erich Schubert <kno10@users.noreply.github.com >
2023-12-08 15:45:04 +01:00
3822bd2369
docs: updates
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-08 15:11:44 +01:00
4de2c6a421
docs: update news
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-08 14:59:25 +01:00
6c4231fd35
docs: 2.0 updates
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-08 14:58:53 +01:00
adfa7aa1fa
docs: site update fixing old image text / How To update updating GPU and CPU docker pages ( #1399 )
...
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-08 10:27:21 +01:00
8b6e601405
Feat: new backend: transformers-musicgen ( #1387 )
...
Transformers-MusicGen
---------
Signed-off-by: Dave <dave@gray101.com >
2023-12-08 10:01:02 +01:00
6011911746
fix(piper): pin petals, phonemize and espeak ( #1393 )
...
* fix: pin phonemize and espeak
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix: pin petals deps
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-07 22:58:41 +01:00
997119c27a
⬆️ Update ggerganov/llama.cpp ( #1385 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-05 15:44:24 +01:00
2eb6865a27
Fix: API Key / JSON Fast Follow #1 ( #1388 )
...
fast follow fix #1 - imports, final loop, one last chance to skip
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-05 10:35:27 +00:00
2b2d6673ff
exllama(v2): fix exllamav1, add exllamav2 ( #1384 )
...
* fix(exllama): fix exllama deps with anaconda
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(exllamav2): add exllamav2 backend
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-05 08:15:37 +01:00
563c5b7ea0
Added Check API KEYs file to API.go ( #1381 )
...
Added API KEYs file
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-04 22:06:45 -05:00
67966b623c
⬆️ Update ggerganov/llama.cpp ( #1379 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-04 18:36:34 +01:00
9fc3fd04be
⬆️ Update ggerganov/whisper.cpp ( #1378 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-04 18:36:22 +01:00
238fec244a
fix(vall-e-x): correctly install reqs in environment ( #1377 )
2023-12-03 21:16:36 +01:00
3d71bc9b64
⬆️ Update ggerganov/whisper.cpp ( #1227 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-03 01:16:07 +01:00
3923024d84
update whisper_cpp with CUBLAS, HIPBLAS, METAL, OPENBLAS, CLBLAST support ( #1302 )
...
update whisper_cpp to 1.5.1 with OPENBLAS, METAL, HIPBLAS, CUBLAS, CLBLAST support
2023-12-02 10:10:18 +00:00
710b195be1
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:55:26 +01:00
6e408137ee
Update fine-tuning.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:54:21 +01:00
9b205cfcfc
Update fine-tuning.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:52:00 +01:00
42a80d1b8b
⬆️ Update ggerganov/llama.cpp ( #1375 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-02 00:09:48 +00:00
d6073ac18e
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-01 20:05:58 +01:00
1c450d46cf
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-01 20:01:07 +01:00
6b312a8522
Site Clean up - How to Clean up ( #1342 )
...
* Create easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-curl.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-openai-v0.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-openai-v1.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-openai-v1.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-openai-v0.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-curl.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update and rename easy-model-import-downloaded.md to easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/autogen-setup.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-autogen.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-01 19:12:21 +01:00
2b2007ae9e
docs: add fine-tuning example ( #1374 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-01 19:11:45 +01:00
e94a34be8c
fix: OSX Build Fix Part 1: Metal ( #1365 )
...
* Make Metal the default on OSX, simplify osx-specific code, and fix the file copy error.
* fix endif / comment
2023-11-30 19:50:50 +01:00
c3fb4b1d8e
ci: rename workflow
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-11-30 19:25:33 +01:00
e3ca1a7dbe
ci: split into reusable workflows ( #1366 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-30 19:24:37 +01:00
2d64d8b444
fix/docs: Python backend dependencies ( #1360 )
...
* Update docs for new requirements.txt path
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
* Fix typo (.PONY -> .PHONY) in python backend makefiles
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
2023-11-30 17:46:55 +01:00
9b98be160a
ci: limit concurrent jobs ( #1364 )
...
* ci: limit concurrent image push
* docs: mention core images
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-30 17:45:20 +01:00
9f708ff318
⬆️ Update ggerganov/llama.cpp ( #1363 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-30 00:06:28 +01:00
4e0ad33d92
docs: Update getting started and GPU section ( #1362 )
2023-11-29 18:51:57 +01:00
519285bf38
⬆️ Update ggerganov/llama.cpp ( #1351 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-29 08:29:03 +01:00
fd1b7b3f22
docs: Add docker instructions, add community projects section in README ( #1359 )
...
docs: Add docker instructions
2023-11-28 23:14:16 +01:00
687730a7f5
fix: go-piper add libucd at linking time ( #1357 )
...
Signed-off-by: Gianluca Boiano <morf3089@gmail.com >
2023-11-28 19:55:09 +00:00
b7821361c3
feat(petals): add backend ( #1350 )
...
* feat(petals): add backend
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fixups
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-28 09:01:46 +01:00
63e1f8fffd
⬆️ Update ggerganov/llama.cpp ( #1345 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-27 09:02:19 +01:00
824612f1b4
feat: initial watchdog implementation ( #1341 )
...
* feat: initial watchdog implementation
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* fiuxups
* Add more output
* wip: idletime checker
* wire idle watchdog checks
* enlarge watchdog time window
* small fixes
* Use stopmodel
* Always delete process
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-26 18:36:23 +01:00
