ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-13 12:38:11 +00:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity

feat(conda): share envs with transformer-based backends (#1465)

Browse Source 
* feat(conda): share env between diffusers and bark

* Detect if env already exists

* share diffusers and petals

* tests: add petals

* Use smaller model for tests with petals

* test only model load on petals

* tests(petals): run only load model tests

* Revert "test only model load on petals"

This reverts commit 111cfa97f1.

* move transformers and sentencetransformers to common env

* Share also transformers-musicgen
This commit is contained in:
Ettore Di Giacinto
2023-12-21 02:35:15 -05:00
committed by GitHub
parent 23eced1644
commit b4b21a446b
23 changed files with 189 additions and 266 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
backend/python/vllm/test_backend_vllm.py
View File

@ -66,7 +66,7 @@ class TestBackendServicer(unittest.TestCase):
stub = backend_pb2_grpc.BackendStub(channel)
response = stub.LoadModel(backend_pb2.ModelOptions(Model="facebook/opt-125m"))
self.assertTrue(response.success)
req = backend_pb2.PredictOptions(prompt="The capital of France is")
req = backend_pb2.PredictOptions(Prompt="The capital of France is")
resp = stub.Predict(req)
self.assertIsNotNone(resp.message)
except Exception as err: