|
ae1ec4e096
|
feat(vllm): expose 'load_format' (#3943)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2024-10-23 15:34:57 +02:00 |
|
|
26c4058be4
|
fix(vllm): do not set videos if we don't have any (#3885)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2024-10-20 11:44:28 +02:00 |
|
|
9db068388b
|
fix(vllm): images and videos are base64 by default (#3867)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2024-10-17 17:32:57 +02:00 |
|
|
2553de0187
|
feat(vllm): add support for image-to-text and video-to-text (#3729)
* feat(vllm): add support for image-to-text
Related to https://github.com/mudler/LocalAI/issues/3670
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* feat(vllm): add support for video-to-text
Closes: https://github.com/mudler/LocalAI/issues/2318
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* feat(vllm): support CPU installations
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* feat(vllm): add bnb
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* chore: add docs reference
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* Apply suggestions from code review
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
|
2024-10-04 23:42:05 +02:00 |
|
|
68fc014c6d
|
feat(vllm): add support for embeddings (#3440)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2024-09-02 21:44:32 +02:00 |
|
|
e2de8a88f7
|
feat: create bash library to handle install/run/test of python backends (#2286)
* feat: create bash library to handle install/run/test of python backends
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
* chore: minor cleanup
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
* fix: remove incorrect LIMIT_TARGETS from parler-tts
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
* fix: update runUnitests to handle running tests from a custom test file
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
* chore: document runUnittests
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
---------
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
|
2024-05-11 18:32:46 +02:00 |
|