LocalAI/pkg/model
Ettore Di Giacinto 0965c6cd68
feat: track internally started models by ID (#3693)
* chore(refactor): track internally started models by ID

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Just extend options, no need to copy

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Improve debugging for rerankers failures

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Simplify model loading with rerankers

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Be more consistent when generating model options

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Uncommitted code

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make deleteProcess more idiomatic

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Adapt CLI for sound generation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixup threads definition

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Handle corner case where c.Seed is nil

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Consistently use ModelOptions

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Adapt new code to refactoring

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Dave <dave@gray101.com>
2024-10-02 08:55:58 +02:00
..
filters.go chore(refactor): drop duplicated shutdown logics (#3589) 2024-09-17 16:51:40 +02:00
initializers.go feat: track internally started models by ID (#3693) 2024-10-02 08:55:58 +02:00
loader_test.go feat: track internally started models by ID (#3693) 2024-10-02 08:55:58 +02:00
loader.go feat: track internally started models by ID (#3693) 2024-10-02 08:55:58 +02:00
model_suite_test.go tests: add template tests (#2063) 2024-04-18 10:57:24 +02:00
model.go chore(refactor): track grpcProcess in the model structure (#3663) 2024-09-26 12:44:55 +02:00
options.go feat: track internally started models by ID (#3693) 2024-10-02 08:55:58 +02:00
process.go feat: track internally started models by ID (#3693) 2024-10-02 08:55:58 +02:00
template_test.go fix(model-loading): keep track of open GRPC Clients (#3377) 2024-08-25 14:36:09 +02:00
template.go fix(model-loading): keep track of open GRPC Clients (#3377) 2024-08-25 14:36:09 +02:00
watchdog.go fix(model-loading): keep track of open GRPC Clients (#3377) 2024-08-25 14:36:09 +02:00