Ettore Di Giacinto e49ea0123b

feat(llama.cpp): add flash_attention and no_kv_offloading (#2310) ...

feat(llama.cpp): add flash_attn and no_kv_offload

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-05-13 19:07:51 +02:00

..

cpp

feat(llama.cpp): add flash_attention and no_kv_offloading (#2310)

2024-05-13 19:07:51 +02:00

go

feat(llama.cpp): do not specify backends to autoload and add llama.cpp variants (#2232)

2024-05-04 17:56:12 +02:00

python

add setuptools for openvino (#2301)

2024-05-12 19:31:43 +00:00

backend.proto

feat(llama.cpp): add flash_attention and no_kv_offloading (#2310)

2024-05-13 19:07:51 +02:00