Ettore Di Giacinto aae7ad9d73

feat(llama.cpp): guess model defaults from file (#2522) ...

* wip: guess informations from gguf file

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* update go mod

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Small fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Identify llama3

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Do not try to guess the name, as reading gguf files can be expensive

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Allow to disable guessing

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-06-08 22:13:02 +02:00

..

application_config.go

feat(llama.cpp): guess model defaults from file (#2522)

2024-06-08 22:13:02 +02:00

backend_config_loader.go

feat(llama.cpp): guess model defaults from file (#2522)

2024-06-08 22:13:02 +02:00

backend_config_test.go

refactor: Minor improvements to BackendConfigLoader (#2353)

2024-05-23 22:48:12 +02:00

backend_config.go

feat(llama.cpp): guess model defaults from file (#2522)

2024-06-08 22:13:02 +02:00

config_suite_test.go

dependencies(grpcio): bump to fix CI issues (#2362)

2024-05-21 14:33:47 +02:00

config_test.go

feat(llama.cpp): guess model defaults from file (#2522)

2024-06-08 22:13:02 +02:00

guesser.go

feat(llama.cpp): guess model defaults from file (#2522)

2024-06-08 22:13:02 +02:00