Bas Hulsken bbf30d416d

fix: change initialization order of llama-cpp-avx512 to go before avx2 variant (#4837) ...

changed to initialization order of the avx512 version of llama.cpp, now tries before avx2

Signed-off-by: Bas Hulsken <bhulsken@hotmail.com>

2025-02-17 09:32:21 +01:00

..

filters.go

chore(refactor): drop duplicated shutdown logics (#3589)

2024-09-17 16:51:40 +02:00

initializers.go

fix: change initialization order of llama-cpp-avx512 to go before avx2 variant (#4837)

2025-02-17 09:32:21 +01:00

loader_options.go

feat: Centralized Request Processing middleware (#3847)

2025-02-10 12:06:16 +01:00

loader_test.go

feat: track internally started models by ID (#3693)

2024-10-02 08:55:58 +02:00

loader.go

feat(tts): Add Kokoro backend (#4616)

2025-01-16 22:23:09 +01:00

model_suite_test.go

tests: add template tests (#2063)

2024-04-18 10:57:24 +02:00

model.go

chore(refactor): track grpcProcess in the model structure (#3663)

2024-09-26 12:44:55 +02:00

process.go

fix(initializer): correctly reap dangling processes (#3717)

2024-10-02 20:37:40 +02:00

watchdog.go

fix(model-loading): keep track of open GRPC Clients (#3377)

2024-08-25 14:36:09 +02:00