9fc3fd04be
⬆️ Update ggerganov/whisper.cpp ( #1378 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-04 18:36:22 +01:00
238fec244a
fix(vall-e-x): correctly install reqs in environment ( #1377 )
2023-12-03 21:16:36 +01:00
3d71bc9b64
⬆️ Update ggerganov/whisper.cpp ( #1227 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-03 01:16:07 +01:00
3923024d84
update whisper_cpp with CUBLAS, HIPBLAS, METAL, OPENBLAS, CLBLAST support ( #1302 )
...
update whisper_cpp to 1.5.1 with OPENBLAS, METAL, HIPBLAS, CUBLAS, CLBLAST support
2023-12-02 10:10:18 +00:00
710b195be1
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:55:26 +01:00
6e408137ee
Update fine-tuning.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:54:21 +01:00
9b205cfcfc
Update fine-tuning.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-02 08:52:00 +01:00
42a80d1b8b
⬆️ Update ggerganov/llama.cpp ( #1375 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-02 00:09:48 +00:00
d6073ac18e
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-01 20:05:58 +01:00
1c450d46cf
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-01 20:01:07 +01:00
6b312a8522
Site Clean up - How to Clean up ( #1342 )
...
* Create easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-curl.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-openai-v0.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request-openai-v1.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-openai-v1.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-openai-v0.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-curl.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update and rename easy-model-import-downloaded.md to easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/autogen-setup.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Delete docs/content/howtos/easy-request-autogen.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-01 19:12:21 +01:00
2b2007ae9e
docs: add fine-tuning example ( #1374 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-01 19:11:45 +01:00
e94a34be8c
fix: OSX Build Fix Part 1: Metal ( #1365 )
...
* Make Metal the default on OSX, simplify osx-specific code, and fix the file copy error.
* fix endif / comment
2023-11-30 19:50:50 +01:00
c3fb4b1d8e
ci: rename workflow
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-11-30 19:25:33 +01:00
e3ca1a7dbe
ci: split into reusable workflows ( #1366 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-30 19:24:37 +01:00
2d64d8b444
fix/docs: Python backend dependencies ( #1360 )
...
* Update docs for new requirements.txt path
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
* Fix typo (.PONY -> .PHONY) in python backend makefiles
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
2023-11-30 17:46:55 +01:00
9b98be160a
ci: limit concurrent jobs ( #1364 )
...
* ci: limit concurrent image push
* docs: mention core images
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-30 17:45:20 +01:00
9f708ff318
⬆️ Update ggerganov/llama.cpp ( #1363 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-30 00:06:28 +01:00
4e0ad33d92
docs: Update getting started and GPU section ( #1362 )
2023-11-29 18:51:57 +01:00
519285bf38
⬆️ Update ggerganov/llama.cpp ( #1351 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-29 08:29:03 +01:00
fd1b7b3f22
docs: Add docker instructions, add community projects section in README ( #1359 )
...
docs: Add docker instructions
2023-11-28 23:14:16 +01:00
687730a7f5
fix: go-piper add libucd at linking time ( #1357 )
...
Signed-off-by: Gianluca Boiano <morf3089@gmail.com >
2023-11-28 19:55:09 +00:00
b7821361c3
feat(petals): add backend ( #1350 )
...
* feat(petals): add backend
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fixups
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-28 09:01:46 +01:00
63e1f8fffd
⬆️ Update ggerganov/llama.cpp ( #1345 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-27 09:02:19 +01:00
824612f1b4
feat: initial watchdog implementation ( #1341 )
...
* feat: initial watchdog implementation
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* fiuxups
* Add more output
* wip: idletime checker
* wire idle watchdog checks
* enlarge watchdog time window
* small fixes
* Use stopmodel
* Always delete process
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-26 18:36:23 +01:00
9482acfdfc
⬆️ Update ggerganov/llama.cpp ( #1340 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-26 09:27:42 +01:00
c75bdd99e4
fix: rename transformers.py to avoid circular import ( #1337 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-26 08:49:43 +01:00
6f34e8f044
fix: propagate CMAKE_ARGS when building grpc ( #1334 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-25 13:53:51 +01:00
6d187af643
fix: handle grpc and llama-cpp with REBUILD=true ( #1328 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-25 08:48:24 +01:00
97e9598c79
⬆️ Update ggerganov/llama.cpp ( #1330 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-24 23:45:05 +01:00
5a6a6de3d7
docs: Update Features->Embeddings page to reflect backend restructuring ( #1325 )
...
* Update path to sentencetransformers backend for local execution
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
* Rename huggingface-embeddings -> sentencetransformers in embeddings.md for consistency with the backend structure
The Dockerfile still knows the "huggingface-embeddings"
backend (I assume for compatibility reasons) but uses the
sentencetransformers backend under the hood anyway.
I figured it would be good to update the docs to use the new naming to
make it less confusing moving forward. As the docker container knows
both the "huggingface-embeddings" and the "sentencetransformers"
backend, this should not break anything.
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
2023-11-24 18:21:04 +01:00
b1a20effde
⬆️ Update ggerganov/llama.cpp ( #1323 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-24 08:32:36 +01:00
ba5ab26f2e
docs: Add llava, update hot topics ( #1322 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-23 18:54:55 +01:00
69f53211a1
Feat: OSX Local Codesigning ( #1319 )
...
* stage makefile
* OSX local code signing and entitlements file to fix incoming connections prompt
2023-11-23 15:22:54 +01:00
9dddd1134d
fix: move python header comments below shebang in some backends ( #1321 )
...
* Fix python header comments for some extra gRPC backends
When a Python script is to be executed directly via exec(3), either the platform knows how to execute
the file itself (i.e. special configuration is necessary) or the first line
contains a shebang (#!) specifying the interpreter to run it (similar to
shell scripts).
The shebang MUST be on the first line for the script to work on all platforms,
so any header comments need to be in the lines following it. Otherwise
executing these scripts as extra backends will yield an "exec format
error" message.
Changes:
* Move introductory comments below the shebang line
* Change header comment in transformers.py to refer to the correct
python module
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
* Make header comment in ttsbark.py more specific
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com >
2023-11-23 15:22:37 +01:00
c5c77d2b0d
docs: Initial import from localai-website ( #1312 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-22 18:13:50 +01:00
763f94ca80
⬆️ Update ggerganov/llama.cpp ( #1313 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-22 08:37:11 +01:00
20d637e7b7
fix: ExLlama Backend Context Size & Rope Scaling ( #1311 )
...
* fix: context_size not propagated to exllama backend
* fix: exllama rope scaling
2023-11-21 19:26:39 +01:00
480b14c8dc
⬆️ Update ggerganov/llama.cpp ( #1310 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-21 00:20:37 +01:00
999db4301a
ci(core): add -core images without python deps ( #1309 )
...
* ci(core): add -core images without python deps
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* ci(core): use public runners
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-11-20 23:01:31 +01:00
92cbc4d516
feat(transformers): add embeddings with Automodel ( #1308 )
...
* Update huggingface.py
Switch SentenceTransformer for AutoModel in order to set trust_remote_code needed to use the encode method with embeddings models like jinai-v2
Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu >
* feat(transformers): split in separate backend
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu >
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: Lucas Hänke de Cansino <lhc@next-boss.eu >
2023-11-20 21:21:17 +01:00
ff9afdb0fe
⬆️ Update ggerganov/llama.cpp ( #1306 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-20 08:16:00 +01:00
3e35b20a02
⬆️ Update mudler/go-piper ( #1305 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-19 09:01:40 +01:00
9ea371d6cd
⬆️ Update ggerganov/llama.cpp ( #1304 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-19 08:49:05 +01:00
7a0f9767da
docs: fix heading
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-11-18 15:04:00 +01:00
9d7363f2a7
docs: update configuration readme
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-11-18 15:03:15 +01:00
8ee5cf38fd
Delete examples/configurations/llava/README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-11-18 15:01:39 +01:00
a6b788d220
docs: update LLaVa instructions
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-11-18 15:01:16 +01:00
ccd87cd9f0
llava.yaml (yaml format standardization) ( #1303 )
...
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-11-18 14:48:54 +01:00
b5af87fc6c
⬆️ Update ggerganov/llama.cpp ( #1300 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-11-18 08:19:10 +01:00
