4 Commits

Author	SHA1	Message	Date
Aman Gupta Karmani	12fe0932c4	feat: cancel stream generation if client disappears (#792)	2023-07-24 23:10:54 +02:00
Ettore Di Giacinto	94916749c5	feat: add external grpc and model autoloading	2023-07-20 22:10:12 +02:00
Ettore Di Giacinto	1d0ed95a54	feat: move other backends to grpc ... This finally makes everything more consistent Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-07-15 01:19:43 +02:00
Ettore Di Giacinto	5dcfdbe51d	feat: various refactorings ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-07-15 01:19:43 +02:00