LocalAI/backend
Ettore Di Giacinto 2553de0187
feat(vllm): add support for image-to-text and video-to-text (#3729)
* feat(vllm): add support for image-to-text

Related to https://github.com/mudler/LocalAI/issues/3670

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): add support for video-to-text

Closes: https://github.com/mudler/LocalAI/issues/2318

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): support CPU installations

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vllm): add bnb

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: add docs reference

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Apply suggestions from code review

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-10-04 23:42:05 +02:00
..
cpp feat: Add Get Token Metrics to GRPC server (#3687) 2024-10-01 14:41:20 +02:00
go fix: untangle pkg/grpc and core/schema for Transcription (#3419) 2024-09-02 15:48:53 +02:00
python feat(vllm): add support for image-to-text and video-to-text (#3729) 2024-10-04 23:42:05 +02:00
backend.proto feat: Add Get Token Metrics to GRPC server (#3687) 2024-10-01 14:41:20 +02:00