ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-19 04:37:53 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

fix: byte utf-8 encode results from autogptq

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2023-08-08 01:20:07 +02:00
parent 3c8fc37c56
commit bb7772a364
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
extra/grpc/autogptq/autogptq.py
View File

@ -61,7 +61,7 @@ class BackendServicer(backend_pb2_grpc.BackendServicer):
top_p=top_p,
repetition_penalty=penalty,
)
return backend_pb2.Result(message=bytes(pipeline(request.Prompt)[0]["generated_text"]))
return backend_pb2.Result(message=bytes(pipeline(request.Prompt)[0]["generated_text"], encoding='utf-8'))
def PredictStream(self, request, context):
# Implement PredictStream RPC