LocalAI/backend/python/vllm/requirements-intel.txt

--extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
intel-extension-for-pytorch
accelerate
torch
transformers
optimum[openvino]
setuptools==75.1.0 # https://github.com/mudler/LocalAI/issues/2406
bitsandbytes
fix: add missing openvino/optimum/etc libraries for Intel, fixes #2289 (#2292) Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com> 2024-05-12 02:01:45 -05:00			`--extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/`
			`intel-extension-for-pytorch`
fix(python): move accelerate and GPU-specific libs to build-type (#3194) Some of the dependencies in `requirements.txt`, even if generic, pulls down the line CUDA libraries. This changes moves mostly all GPU-specific libs to the build-type, and tries a safer approach. In `requirements.txt` now are listed only "first-level" dependencies, for instance, grpc, but libs-dependencies are moved down to the respective build-type `requirements.txt` to avoid any mixin. This should fix #2737 and #1592. Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2024-08-07 17:02:32 +02:00			`accelerate`
fix: add missing openvino/optimum/etc libraries for Intel, fixes #2289 (#2292) Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com> 2024-05-12 02:01:45 -05:00			`torch`
fix(python): move accelerate and GPU-specific libs to build-type (#3194) Some of the dependencies in `requirements.txt`, even if generic, pulls down the line CUDA libraries. This changes moves mostly all GPU-specific libs to the build-type, and tries a safer approach. In `requirements.txt` now are listed only "first-level" dependencies, for instance, grpc, but libs-dependencies are moved down to the respective build-type `requirements.txt` to avoid any mixin. This should fix #2737 and #1592. Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2024-08-07 17:02:32 +02:00			`transformers`
fix: add setuptools to all requirements-intel.txt files for python backends (#2333) Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com> 2024-05-16 12:15:46 -05:00			`optimum[openvino]`
feat(vllm): add support for image-to-text and video-to-text (#3729) * feat(vllm): add support for image-to-text Related to https://github.com/mudler/LocalAI/issues/3670 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(vllm): add support for video-to-text Closes: https://github.com/mudler/LocalAI/issues/2318 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(vllm): support CPU installations Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(vllm): add bnb Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore: add docs reference Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Apply suggestions from code review Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> 2024-10-04 23:42:05 +02:00			`setuptools==75.1.0 # https://github.com/mudler/LocalAI/issues/2406`
			`bitsandbytes`