ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-24 23:06:42 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
bdf3f95346
LocalAI/extra/grpc/vllm
History
Ettore Di Giacinto bdf3f95346
feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 
**Description**

this allows to customize the maximum number of grpc workers for python
backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-09-19 21:30:39 +02:00
..
backend_pb2_grpc.py feat(vllm): Initial vllm backend implementation 2023-09-09 17:03:23 +02:00
backend_pb2.py feat(speculative-sampling): allow to specify a draft model in the model config (#1052) 2023-09-14 17:44:16 +02:00
backend_vllm.py feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 2023-09-19 21:30:39 +02:00