ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-21 05:33:09 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

fix: byte utf-8 encode results from autogptq

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2023-08-08 01:20:07 +02:00
parent 3c8fc37c56
commit bb7772a364
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
extra/grpc/autogptq/autogptq.py
View File

@ -61,7 +61,7 @@ class BackendServicer(backend_pb2_grpc.BackendServicer):
top_p=top_p, top_p=top_p,
repetition_penalty=penalty, repetition_penalty=penalty,
) )
return backend_pb2.Result(message=bytes(pipeline(request.Prompt)[0]["generated_text"])) return backend_pb2.Result(message=bytes(pipeline(request.Prompt)[0]["generated_text"], encoding='utf-8'))
def PredictStream(self, request, context): def PredictStream(self, request, context):
# Implement PredictStream RPC # Implement PredictStream RPC