mirror of
https://github.com/mudler/LocalAI.git
synced 2025-04-30 16:00:05 +00:00
* Bump vLLM version to 0.3.2 * Add vLLM model loading options * Remove transformers-exllama * Fix install exllama
Creating a separate environment for the vllm project
make vllm