ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-14 13:08:08 +00:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity

refactor: backend/service split, channel-based llm flow (#1963)

Browse Source 
Refactor: channel based llm flow and services split

---------

Signed-off-by: Dave Lee <dave@gray101.com>
This commit is contained in:
Dave
2024-04-13 03:45:34 -04:00
committed by GitHub
parent 1981154f49
commit eed5706994
52 changed files with 3064 additions and 2279 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
pkg/grpc/interface.go
View File

@ -15,7 +15,7 @@ type LLM interface {
Load(*pb.ModelOptions) error
Embeddings(*pb.PredictOptions) ([]float32, error)
GenerateImage(*pb.GenerateImageRequest) error
AudioTranscription(*pb.TranscriptRequest) (schema.Result, error)
AudioTranscription(*pb.TranscriptRequest) (schema.TranscriptionResult, error)
TTS(*pb.TTSRequest) error
TokenizeString(*pb.PredictOptions) (pb.TokenizationResponse, error)
Status() (pb.StatusResponse, error)