Ettore Di Giacinto bdf3f95346

feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) ...

**Description**

this allows to customize the maximum number of grpc workers for python
backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2023-09-19 21:30:39 +02:00

..

autogptq

feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081)

2023-09-19 21:30:39 +02:00

bark

feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081)

2023-09-19 21:30:39 +02:00

diffusers

feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081)

2023-09-19 21:30:39 +02:00

exllama

feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081)

2023-09-19 21:30:39 +02:00

huggingface

feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081)

2023-09-19 21:30:39 +02:00

vall-e-x

feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081)

2023-09-19 21:30:39 +02:00

vllm

feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081)

2023-09-19 21:30:39 +02:00