LocalAI/core/backend
Ettore Di Giacinto cf747bcdec
feat: extract output with regexes from LLMs (#3491)
* feat: extract output with regexes from LLMs

This changset adds `extract_regex` to the LLM config. It is a list of
regexes that can match output and will be used to re extract text from
the LLM output. This is particularly useful for LLMs which outputs final
results into tags.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add tests, enhance output in case of configuration error

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-09-13 13:27:36 +02:00
..
backend_suite_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
embeddings.go chore: fix go.mod module (#2635) 2024-06-23 08:24:36 +00:00
image.go chore: fix go.mod module (#2635) 2024-06-23 08:24:36 +00:00
llm_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
llm.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
options.go feat(llama.cpp): support embeddings endpoints (#2871) 2024-07-15 22:54:16 +02:00
rerank.go chore: fix go.mod module (#2635) 2024-06-23 08:24:36 +00:00
soundgeneration.go feat: elevenlabs sound-generation api (#3355) 2024-08-24 00:20:28 +00:00
stores.go chore: fix go.mod module (#2635) 2024-06-23 08:24:36 +00:00
transcript.go fix: speedup and improve cachability of docker build of builder-sd (#3430) 2024-09-10 08:57:16 +02:00
tts.go fix(tts): check error before inspecting result (#3415) 2024-08-27 17:35:16 +02:00