Ettore Di Giacinto d4c1746c7d

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache (#4329) ...

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-12-06 10:23:59 +01:00

..

backend_suite_test.go

feat: extract output with regexes from LLMs (#3491)

2024-09-13 13:27:36 +02:00

embeddings.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00

image.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00

llm_test.go

feat: extract output with regexes from LLMs (#3491)

2024-09-13 13:27:36 +02:00

llm.go

feat: include tokens usage for streamed output (#4282)

2024-11-28 14:47:56 +01:00

options.go

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache (#4329)

2024-12-06 10:23:59 +01:00

rerank.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00

soundgeneration.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00

stores.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00

token_metrics.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00

tokenize.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00

transcript.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00

tts.go

chore(refactor): drop unnecessary code in loader (#4096)

2024-11-08 21:54:25 +01:00