4 Commits

Author	SHA1	Message	Date
Ettore Di Giacinto	548959b50f	feat: queue up requests if not running parallel requests (#1296) ... Return a GRPC which handles a lock in case it is not meant to be parallel. Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-11-16 22:20:16 +01:00
Ettore Di Giacinto	fdd95d1d86	feat: allow to run parallel requests (#1290) ... * feat: allow to run parallel requests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fixup Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-11-16 08:20:05 +01:00
Dave	10b0e13882	feat: backend monitor shutdown endpoint, process based (#938) ... This PR adds a new endpoint to the backend monitor section `/backend/shutdown` which terminates the grpc process for the related model.	2023-08-23 18:38:37 +02:00
Dave	8cb1061c11	Usage Features (#863)	2023-08-18 21:23:14 +02:00