ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-02-20 09:26:15 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

deps: Update version of vLLM to add support of Cohere Command_R model in vLLM inference (#1975)

Browse Source 
* Update vLLM version to add support of Command_R

Signed-off-by: Koen Farell <hellios.dt@gmail.com>

* fix: Fixed vllm version from requirements

Signed-off-by: Koen Farell <hellios.dt@gmail.com>

* chore: Update transformers-rocm.yml

Signed-off-by: Koen Farell <hellios.dt@gmail.com>

* chore: Update transformers.yml version of vllm

Signed-off-by: Koen Farell <hellios.dt@gmail.com>

---------

Signed-off-by: Koen Farell <hellios.dt@gmail.com>
This commit is contained in:
Koen Farell 2024-04-10 14:25:26 +03:00 committed by GitHub
parent d23e73b118
commit 36da11a0ee
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
backend/python/common-env/transformers/transformers-nvidia.yml
View File

@ -116,7 +116,7 @@ dependencies:
- sudachipy
- sudachidict_core
- vocos
- vllm==0.3.2
- vllm>=0.4.0
- transformers>=4.38.2 # Updated Version
- transformers_stream_generator==0.0.5
- xformers==0.0.23.post1

2
backend/python/common-env/transformers/transformers-rocm.yml
View File

@ -104,7 +104,7 @@ dependencies:
- sudachipy
- sudachidict_core
- vocos
- vllm==0.3.2
- vllm>=0.4.0
- transformers>=4.38.2 # Updated Version
- transformers_stream_generator==0.0.5
- xformers==0.0.23.post1

2
backend/python/common-env/transformers/transformers.yml
View File

@ -108,7 +108,7 @@ dependencies:
- sudachipy
- sudachidict_core
- vocos
- vllm==0.3.2
- vllm>=0.4.0
- transformers>=4.38.2 # Updated Version
- transformers_stream_generator==0.0.5
- xformers==0.0.23.post1