ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-08 03:28:27 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

chore(model gallery): add qwen-3-32b-medical-reasoning-i1 (#5305)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2025-05-03 10:24:07 +02:00 committed by GitHub
parent c087cd1377
commit 1da0644aa3
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 18 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

18
gallery/index.yaml
View File

@ -409,6 +409,24 @@
- filename: amoral-qwen3-14B.Q4_K_M.gguf
sha256: 7a73332b4dd49d5df1de2dbe84fc274019f33e564bcdce722e6e2ddf4e93cc77
uri: huggingface://mradermacher/amoral-qwen3-14B-GGUF/amoral-qwen3-14B.Q4_K_M.gguf
- !!merge <<: *qwen3
name: "qwen-3-32b-medical-reasoning-i1"
urls:
- https://huggingface.co/nicoboss/Qwen-3-32B-Medical-Reasoning
- https://huggingface.co/mradermacher/Qwen-3-32B-Medical-Reasoning-i1-GGUF
description: |
This is https://huggingface.co/kingabzpro/Qwen-3-32B-Medical-Reasoning applied to https://huggingface.co/Qwen/Qwen3-32B Original model card created by @kingabzpro
Original model card from @kingabzpro
Fine-tuning Qwen3-32B in 4-bit Quantization for Medical Reasoning
This project fine-tunes the Qwen/Qwen3-32B model using a medical reasoning dataset (FreedomIntelligence/medical-o1-reasoning-SFT) with 4-bit quantization for memory-efficient training.
overrides:
parameters:
model: Qwen-3-32B-Medical-Reasoning.i1-Q4_K_M.gguf
files:
- filename: Qwen-3-32B-Medical-Reasoning.i1-Q4_K_M.gguf
sha256: 3d5ca0c8dfde8f9466e4d89839f08cd2f45ef97d6c28fa61f9428645877497b0
uri: huggingface://mradermacher/Qwen-3-32B-Medical-Reasoning-i1-GGUF/Qwen-3-32B-Medical-Reasoning.i1-Q4_K_M.gguf
- &gemma3
url: "github:mudler/LocalAI/gallery/gemma.yaml@master"
name: "gemma-3-27b-it"