Dave 10b0e13882

feat: backend monitor shutdown endpoint, process based (#938) ...

This PR adds a new endpoint to the backend monitor section
`/backend/shutdown` which terminates the grpc process for the related
model.

2023-08-23 18:38:37 +02:00

..

initializers.go

feat: add llama-stable backend (#932)

2023-08-20 16:35:42 +02:00

loader.go

feat: backend monitor shutdown endpoint, process based (#938)

2023-08-23 18:38:37 +02:00

options.go

feat: add --single-active-backend to allow only one backend active at the time (#925)

2023-08-19 01:49:33 +02:00

process.go

feat: add --single-active-backend to allow only one backend active at the time (#925)

2023-08-19 01:49:33 +02:00