mirror of
https://github.com/mudler/LocalAI.git
synced 2024-12-22 05:57:50 +00:00
939411300a
* Bump vLLM version to 0.3.2 * Add vLLM model loading options * Remove transformers-exllama * Fix install exllama |
||
---|---|---|
.. | ||
backend_pb2_grpc.py | ||
backend_pb2.py | ||
Makefile | ||
README.md | ||
run.sh | ||
test_transformers_server.py | ||
test.sh | ||
transformers_server.py |
Creating a separate environment for the transformers project
make transformers