LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2025-03-25 13:27:43 +00:00

History

Ettore Di Giacinto 4e4078854b fix(llama.cpp): disable mirostat as default

Even if increasing the quality of the output, it has shown to have
performance drawbacks to be so noticeable that the confuses users about
speed of LocalAI ( see also
https://github.com/mudler/LocalAI/issues/2780 ).

This changeset disables Mirostat by default (which can
be still enabled manually).

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-07-18 12:35:11 +02:00

backend

feat(llama.cpp): support embeddings endpoints (#2871 )

2024-07-15 22:54:16 +02:00

cli

feat: HF /scan endpoint (#2566 )

2024-07-10 13:18:32 +02:00

clients

feat(store): add Golang client (#1977 )

2024-04-16 15:54:14 +02:00

config

fix(llama.cpp): disable mirostat as default