LocalAI/core
Ettore Di Giacinto cf747bcdec
feat: extract output with regexes from LLMs (#3491)
* feat: extract output with regexes from LLMs

This changset adds `extract_regex` to the LLM config. It is a list of
regexes that can match output and will be used to re extract text from
the LLM output. This is particularly useful for LLMs which outputs final
results into tags.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add tests, enhance output in case of configuration error

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-09-13 13:27:36 +02:00
..
backend feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
cli chore(cli): be consistent between workers and expose ExtraLLamaCPPArgs to both (#3428) 2024-08-30 00:10:17 +02:00
clients feat(store): add Golang client (#1977) 2024-04-16 15:54:14 +02:00
config feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
dependencies_manager fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
explorer feat(explorer): make possible to run sync in a separate process (#3224) 2024-08-12 19:25:44 +02:00
gallery fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
http feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
p2p feat(p2p): allow to set intervals (#3353) 2024-08-21 18:23:51 +02:00
schema feat: add endpoint to list system informations (#3449) 2024-09-05 20:44:30 +02:00
services fix(model-loading): keep track of open GRPC Clients (#3377) 2024-08-25 14:36:09 +02:00
startup chore: drop gpt4all.cpp (#3106) 2024-08-07 23:35:55 +02:00
application.go feat(model-list): be consistent, skip known files from listing (#2760) 2024-07-10 15:28:39 +02:00