Bump vLLM version + more options when loading models in vLLM (#1782)

Browse Source

* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama

...

This commit is contained in:

Ludovic Leroux

2024-03-01 16:48:53 -05:00

committed by GitHub

parent 1c312685aa

commit 939411300a

28 changed files with 736 additions and 641 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

66

backend/python/petals/backend_pb2.py

File diff suppressed because one or more lines are too long