LocalAI/pkg/model
Ettore Di Giacinto cea5a0ea42
feat(template): read jinja templates from gguf files (#4332)
* Read jinja templates as fallback

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Move templating out of model loader

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Test TemplateMessages

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Set role and content from transformers

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Tests: be more flexible

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* More jinja

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Small refactoring and adaptations

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-12-08 13:50:33 +01:00
..
filters.go chore(refactor): drop duplicated shutdown logics (#3589) 2024-09-17 16:51:40 +02:00
initializers.go feat(backends): Drop bert.cpp (#4272) 2024-11-27 16:34:28 +01:00
loader_options.go fix(llama-cpp): consistently select fallback (#3789) 2024-10-11 16:55:57 +02:00
loader_test.go feat: track internally started models by ID (#3693) 2024-10-02 08:55:58 +02:00
loader.go feat(template): read jinja templates from gguf files (#4332) 2024-12-08 13:50:33 +01:00
model_suite_test.go tests: add template tests (#2063) 2024-04-18 10:57:24 +02:00
model.go chore(refactor): track grpcProcess in the model structure (#3663) 2024-09-26 12:44:55 +02:00
process.go fix(initializer): correctly reap dangling processes (#3717) 2024-10-02 20:37:40 +02:00
watchdog.go fix(model-loading): keep track of open GRPC Clients (#3377) 2024-08-25 14:36:09 +02:00