LocalAI/core
Ettore Di Giacinto aae7ad9d73
feat(llama.cpp): guess model defaults from file (#2522)
* wip: guess informations from gguf file

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* update go mod

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Small fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Identify llama3

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Do not try to guess the name, as reading gguf files can be expensive

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Allow to disable guessing

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-06-08 22:13:02 +02:00
..
backend TTS API improvements (#2308) 2024-06-01 18:26:27 +00:00
cli feat(llama.cpp): guess model defaults from file (#2522) 2024-06-08 22:13:02 +02:00
clients feat(store): add Golang client (#1977) 2024-04-16 15:54:14 +02:00
config feat(llama.cpp): guess model defaults from file (#2522) 2024-06-08 22:13:02 +02:00
dependencies_manager feat(webui): statically embed js/css assets (#2348) 2024-05-19 18:24:27 +02:00
http feat(llama.cpp): guess model defaults from file (#2522) 2024-06-08 22:13:02 +02:00
p2p feat(llama.cpp): Totally decentralized, private, distributed, p2p inference (#2343) 2024-05-20 19:17:59 +02:00
schema TTS API improvements (#2308) 2024-06-01 18:26:27 +00:00
services feat:OpaqueErrors to hide error information (#2486) 2024-06-05 08:45:24 +02:00
startup feat(llama.cpp): guess model defaults from file (#2522) 2024-06-08 22:13:02 +02:00
application.go refactor(application): introduce application global state (#2072) 2024-04-29 17:42:37 +00:00