LocalAI/aio/cpu
Ettore Di Giacinto 35290e146b
fix(grammar): respect JSONmode and grammar from user input (#1935)
* fix(grammar): Fix JSON mode and custom grammar

* tests(aio): add jsonmode test

* tests(aio): add functioncall test

* fix(aio): use hermes-2-pro-mistral as llm for CPU profile

* add phi-2-orange
2024-03-31 13:04:09 +02:00
..
embeddings.yaml feat(aio): add intel profile (#1901) 2024-03-26 18:45:25 +01:00
image-gen.yaml feat(aio): add intel profile (#1901) 2024-03-26 18:45:25 +01:00
README.md feat(aio): entrypoint, update workflows (#1872) 2024-03-21 22:09:04 +01:00
speech-to-text.yaml feat(aio): add tests, update model definitions (#1880) 2024-03-22 21:13:11 +01:00
text-to-speech.yaml feat(aio): add tests, update model definitions (#1880) 2024-03-22 21:13:11 +01:00
text-to-text.yaml fix(grammar): respect JSONmode and grammar from user input (#1935) 2024-03-31 13:04:09 +02:00
vision.yaml feat(aio): add intel profile (#1901) 2024-03-26 18:45:25 +01:00

AIO CPU size

Use this image with CPU-only.

Please keep using only C++ backends so the base image is as small as possible (without CUDA, cuDNN, python, etc).