ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-07 11:08:27 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

feat: add flux single file support (#3959)

Browse Source 
feat: flux pipeline single file

Signed-off-by: Sertac Ozercan <sozercan@gmail.com>
This commit is contained in:
Sertaç Özercan 2024-10-25 01:12:43 -07:00 committed by GitHub
parent 5be2d22117
commit 07ce0a3c17
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 7 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
backend/python/diffusers/backend.py
View File

@ -247,6 +247,11 @@ class BackendServicer(backend_pb2_grpc.BackendServicer):
use_safetensors=True, use_safetensors=True,
variant=variant) variant=variant)
elif request.PipelineType == "FluxPipeline": elif request.PipelineType == "FluxPipeline":
if fromSingleFile:
self.pipe = FluxPipeline.from_single_file(modelFile,
torch_dtype=torchType,
use_safetensors=True)
else:
self.pipe = FluxPipeline.from_pretrained( self.pipe = FluxPipeline.from_pretrained(
request.Model, request.Model,
torch_dtype=torch.bfloat16) torch_dtype=torch.bfloat16)