Ettore Di Giacinto d4c1746c7d

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache (#4329) ...

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-12-06 10:23:59 +01:00

..

patches

chore(deps): update llama.cpp (#3497)

2024-09-12 20:55:27 +02:00

CMakeLists.txt

deps(llama.cpp): update, support Gemma models (#1734)

2024-02-21 17:23:38 +01:00

grpc-server.cpp

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache (#4329)

2024-12-06 10:23:59 +01:00

json.hpp

🔥 add LaVA support and GPT vision API, Multiple requests for llama.cpp, return JSON types (#1254)

2023-11-11 13:14:59 +01:00

Makefile

fix(llama.cpp): embed metal file into result binary for darwin (#4279)

2024-11-28 04:17:00 +00:00

prepare.sh

chore(deps): update llama.cpp (#3497)

2024-09-12 20:55:27 +02:00

utils.hpp

chore(deps): update llama.cpp (#3497)

2024-09-12 20:55:27 +02:00