mirror of
https://github.com/mudler/LocalAI.git
synced 2024-12-18 20:27:57 +00:00
0d6c3a7d57
Use pb.Reply instead of []byte with Reply.GetMessage() in llama grpc to get the proper usage data in reply streaming mode at the last [DONE] frame Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| backend_suite_test.go | ||
| embeddings.go | ||
| image.go | ||
| llm_test.go | ||
| llm.go | ||
| options.go | ||
| rerank.go | ||
| soundgeneration.go | ||
| stores.go | ||
| token_metrics.go | ||
| tokenize.go | ||
| transcript.go | ||
| tts.go | ||