exllama(v2): fix exllamav1, add exllamav2 (#1384)

Browse Source

* fix(exllama): fix exllama deps with anaconda

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(exllamav2): add exllamav2 backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

...

This commit is contained in:

Ettore Di Giacinto

2023-12-05 08:15:37 +01:00

committed by GitHub

parent 563c5b7ea0

commit 2b2d6673ff

13 changed files with 683 additions and 11 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

61

backend/python/exllama2/backend_pb2.py Normal file

File diff suppressed because one or more lines are too long