ExternalVendorCode/lollms
1
0
Fork 0
mirror of https://github.com/ParisNeo/lollms.git synced 2025-01-20 03:36:30 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

added stopgen

Browse Source
This commit is contained in:
Saifeddine ALOUI 2024-01-07 20:44:39 +01:00
parent 4ef9f5d72c
commit 310eafa0ab
1 changed files with 7 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
lollms/server/endpoints/lollms_generator.py
View File

@ -299,3 +299,10 @@ def v1_instruct_generate(request_data: V1InstructGenerateRequest):
return output["text"]
else:
return None
@router.post("/stop_gen")
def stop_gen():
elf_server.cancel_gen = True
return {"status": True}