8 Commits

Author SHA1 Message Date
Ettore Di Giacinto
b664edde29
feat(rerankers): Add new backend, support jina rerankers API ()
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-04-25 00:19:02 +02:00
cryptk
86bc5f1350
fix: use exec in entrypoint scripts to fix signal handling () 2024-04-02 09:15:44 +02:00
Ettore Di Giacinto
eab4a91a9b
fix(aio): correctly detect intel systems ()
Also rename SIZE to PROFILE
2024-03-30 12:04:32 +01:00
Ettore Di Giacinto
e58410fa99
feat(aio): add intel profile ()
* feat(aio): add intel profile

* docs: clarify AIO images features
2024-03-26 18:45:25 +01:00
Enrico Ros
08c7b17298
Fix NVIDIA VRAM detection on WSL2 environments ()
* NVIDIA VRAM detection on WSL2 environments

More robust single NVIDIA GPU memory detection, following the
improved NVIDIA WSL2 detection patch yesterday .

Tested and working on WSL2, Linux.

Signed-off-by: Enrico Ros <enrico.ros@gmail.com>

* Update aio/entrypoint.sh

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Enrico Ros <enrico.ros@gmail.com>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-03-25 18:36:18 +01:00
Enrico Ros
5e12382524
NVIDIA GPU detection support for WSL2 environments ()
This change makes the assumption that "Microsoft Corporation Device 008e"
is an NVIDIA CUDA device. If this is not the case, please update the
hardware detection script here.

Signed-off-by: Enrico Ros <enrico.ros@gmail.com>
Co-authored-by: Dave <dave@gray101.com>
2024-03-25 08:32:40 +01:00
Ettore Di Giacinto
4b1ee0c170
feat(aio): add tests, update model definitions () 2024-03-22 21:13:11 +01:00
Ettore Di Giacinto
abc9360dc6
feat(aio): entrypoint, update workflows () 2024-03-21 22:09:04 +01:00