ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-21 09:47:55 +00:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity

fix(diffusers): correctly check alpha (#967)

Browse Source 
**Description**

Loras that have no alpha would crash otherwise

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2023-08-27 15:35:59 +02:00 committed by GitHub
parent 997c39ccd5
commit 158c7867e7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
extra/grpc/diffusers/backend_diffusers.py
View File

@ -278,7 +278,7 @@ class BackendServicer(backend_pb2_grpc.BackendServicer):
# get elements for this layer # get elements for this layer
weight_up = elems['lora_up.weight'].to(dtype) weight_up = elems['lora_up.weight'].to(dtype)
weight_down = elems['lora_down.weight'].to(dtype) weight_down = elems['lora_down.weight'].to(dtype)
alpha = elems['alpha'] alpha = elems['alpha'] if 'alpha' in elems else None
if alpha: if alpha:
alpha = alpha.item() / weight_up.shape[1] alpha = alpha.item() / weight_up.shape[1]
else: else: