ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-22 00:13:38 +00:00
Code Issues Actions 16 Packages Projects Releases Wiki Activity

bugfix: CUDA acceleration not working (#2475)

Browse Source 
* bugfix: CUDA acceleration not working

CUDA not working after #2286.
Refactored the code to be more polish

* Update requirements.txt

Missing imports

Signed-off-by: fakezeta <fakezeta@gmail.com>

* Update requirements.txt

Signed-off-by: fakezeta <fakezeta@gmail.com>

---------

Signed-off-by: fakezeta <fakezeta@gmail.com>
This commit is contained in:
fakezeta
2024-06-03 22:41:42 +02:00
committed by GitHub
parent daa7544d9c
commit 6ef78ef7f6
3 changed files with 16 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
backend/python/transformers/requirements.txt
View File

@ -3,4 +3,7 @@ transformers
grpcio==1.64.0
protobuf
torch
certifi
certifi
intel-extension-for-transformers
bitsandbytes
setuptools==69.5.1 # https://github.com/mudler/LocalAI/issues/2406