LocalAI/backend/python
Ettore Di Giacinto 2553de0187
feat(vllm): add support for image-to-text and video-to-text (#3729)
* feat(vllm): add support for image-to-text

Related to https://github.com/mudler/LocalAI/issues/3670

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): add support for video-to-text

Closes: https://github.com/mudler/LocalAI/issues/2318

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): support CPU installations

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): add bnb

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: add docs reference

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Apply suggestions from code review

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-10-04 23:42:05 +02:00
..
autogptq chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
bark chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
common chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
coqui chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
diffusers chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
exllama2 chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
mamba chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
openvoice chore(deps): Bump gradio from 4.38.1 to 4.44.1 in /backend/python/openvoice (#3701) 2024-10-01 10:40:36 +02:00
parler-tts chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
rerankers chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
sentencetransformers chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
transformers chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
transformers-musicgen chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
vall-e-x chore(deps): bump grpcio to 1.66.2 (#3690) 2024-09-30 09:09:51 +02:00
vllm feat(vllm): add support for image-to-text and video-to-text (#3729) 2024-10-04 23:42:05 +02:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>