ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-22 16:39:05 +00:00
Code Issues Actions 16 Packages Projects Releases Wiki Activity

feat(transformers): add embeddings with Automodel (#1308)

Browse Source 
* Update huggingface.py

Switch SentenceTransformer for AutoModel in order to set trust_remote_code needed to use the encode method with embeddings models like jinai-v2

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>

* feat(transformers): split in separate backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
This commit is contained in:
Ettore Di Giacinto
2023-11-20 21:21:17 +01:00
committed by GitHub
parent ff9afdb0fe
commit 92cbc4d516
23 changed files with 783 additions and 34 deletions
Download Patch File Download Diff File Expand all files Collapse all files

18
backend/python/transformers/Makefile Normal file
View File

@ -0,0 +1,18 @@
.PONY: transformers
transformers:
@echo "Creating virtual environment..."
@conda env create --name transformers --file transformers.yml
@echo "Virtual environment created."
.PONY: run
run:
@echo "Running transformers..."
bash run.sh
@echo "transformers run."
# It is not working well by using command line. It only6 works with IDE like VSCode.
.PONY: test
test:
@echo "Testing transformers..."
bash test.sh
@echo "transformers tested."