LocalAI/core/backend
mintyleaf 96f8ec0402
feat: add machine tag and inference timings (#4577)
* Add machine tag option, add extraUsage option, grpc-server -> proto -> endpoint extraUsage data is broken for now

Signed-off-by: mintyleaf <mintyleafdev@gmail.com>

* remove redurant timing fields, fix not working timings output

Signed-off-by: mintyleaf <mintyleafdev@gmail.com>

* use middleware for Machine-Tag only if tag is specified

Signed-off-by: mintyleaf <mintyleafdev@gmail.com>

---------

Signed-off-by: mintyleaf <mintyleafdev@gmail.com>
2025-01-17 17:05:58 +01:00
..
backend_suite_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
embeddings.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
image.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
llm_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
llm.go feat: add machine tag and inference timings (#4577) 2025-01-17 17:05:58 +01:00
options.go chore(vall-e-x): Drop backend (#4619) 2025-01-17 09:35:10 +01:00
rerank.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
soundgeneration.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
stores.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
token_metrics.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
tokenize.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
transcript.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
tts.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00