LocalAI/api/backend
Ettore Di Giacinto 887b3dff04
feat: cuda transformers (#1401)
* Use cuda in transformers if available

tensorflow probably needs a different check.

Signed-off-by: Erich Schubert <kno10@users.noreply.github.com>

* feat: expose CUDA at top level

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* tests: add to tests and create workflow for py extra backends

* doc: update note on how to use core images

---------

Signed-off-by: Erich Schubert <kno10@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Erich Schubert <kno10@users.noreply.github.com>
2023-12-08 15:45:04 +01:00
..
embeddings.go feat: add --single-active-backend to allow only one backend active at the time (#925) 2023-08-19 01:49:33 +02:00
image.go feat: cuda transformers (#1401) 2023-12-08 15:45:04 +01:00
llm.go 🔥 add LaVA support and GPT vision API, Multiple requests for llama.cpp, return JSON types (#1254) 2023-11-11 13:14:59 +01:00
options.go feat: cuda transformers (#1401) 2023-12-08 15:45:04 +01:00
transcript.go fix: drop racy code, refactor and group API schema (#931) 2023-08-20 14:04:45 +02:00
tts.go Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00