ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-18 23:18:10 +00:00
Code Issues Actions 15 Packages Projects Releases Wiki Activity

feat: add --single-active-backend to allow only one backend active at the time (#925)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto
2023-08-19 01:49:33 +02:00
committed by GitHub
parent 1079b18ff7
commit afdc0ebfd7
20 changed files with 238 additions and 164 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
extra/grpc/huggingface/huggingface.py
View File

@ -34,7 +34,7 @@ class BackendServicer(backend_pb2_grpc.BackendServicer):
def serve(address):
server = grpc.server(futures.ThreadPoolExecutor(max_workers=10))
server = grpc.server(futures.ThreadPoolExecutor(max_workers=1))
backend_pb2_grpc.add_BackendServicer_to_server(BackendServicer(), server)
server.add_insecure_port(address)
server.start()