LocalAI/core
Ettore Di Giacinto cea5a0ea42
feat(template): read jinja templates from gguf files (#4332)
* Read jinja templates as fallback

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Move templating out of model loader

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Test TemplateMessages

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Set role and content from transformers

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Tests: be more flexible

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* More jinja

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Small refactoring and adaptations

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-12-08 13:50:33 +01:00
..
application feat(template): read jinja templates from gguf files (#4332) 2024-12-08 13:50:33 +01:00
backend feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache (#4329) 2024-12-06 10:23:59 +01:00
cli feat(template): read jinja templates from gguf files (#4332) 2024-12-08 13:50:33 +01:00
clients feat(store): add Golang client (#1977) 2024-04-16 15:54:14 +02:00
config feat(template): read jinja templates from gguf files (#4332) 2024-12-08 13:50:33 +01:00
dependencies_manager fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
explorer feat(explorer): make possible to run sync in a separate process (#3224) 2024-08-12 19:25:44 +02:00
gallery feat(backends): Drop bert.cpp (#4272) 2024-11-27 16:34:28 +01:00
http feat(template): read jinja templates from gguf files (#4332) 2024-12-08 13:50:33 +01:00
p2p fix(p2p): parse maddr correctly (#4219) 2024-11-21 14:06:49 +01:00
schema feat(silero): add Silero-vad backend (#4204) 2024-11-20 14:48:40 +01:00
services Fix: listmodelservice / welcome endpoint use LOOSE_ONLY (#3791) 2024-10-11 23:49:00 +02:00