4 Commits

Author	SHA1	Message	Date
Ettore Di Giacinto	a843e64fc2	feat: add initial AutoGPTQ backend implementation	2023-08-07 22:53:28 +02:00
Aman Gupta Karmani	12fe0932c4	feat: cancel stream generation if client disappears (#792)	2023-07-24 23:10:54 +02:00
Ettore Di Giacinto	94817b557c	fix: make completions endpoint more close to OpenAI specification (#790) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-07-22 00:53:52 +02:00
Ettore Di Giacinto	5dcfdbe51d	feat: various refactorings ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-07-15 01:19:43 +02:00