LocalAI/requirements-cublas12.txt at 1b44a5a3b7a94f102ec0bfe11d2cfdfc5afac788 - LocalAI - Gitea

ExternalVendorCode/LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2024-12-19 12:47:54 +00:00

Ettore Di Giacinto 2553de0187

feat(vllm): add support for image-to-text and video-to-text (#3729 )

* feat(vllm): add support for image-to-text

Related to https://github.com/mudler/LocalAI/issues/3670

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): add support for video-to-text

Closes: https://github.com/mudler/LocalAI/issues/2318

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): support CPU installations

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): add bnb

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: add docs reference

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Apply suggestions from code review

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

2024-10-04 23:42:05 +02:00

4 lines

42 B

Plaintext

Raw Blame History

 accelerate
 torch
 transformers
 bitsandbytes