ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-30 22:14:15 +00:00
Code Issues Actions 32 Packages Projects Releases Wiki Activity

chore(model gallery): add huihui-ai_qwen3-14b-abliterated (#5324)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2025-05-06 10:35:55 +02:00 committed by GitHub
parent 4a27c99928
commit 7fa437bbcc
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 16 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

16
gallery/index.yaml
View File

@ -511,6 +511,22 @@
- filename: allura-org_remnant-qwen3-8b-Q4_K_M.gguf
sha256: 94e179bb1f1fe0069804a7713bd6b1343626ef11d17a67c6990be7b813d26aeb
uri: huggingface://bartowski/allura-org_remnant-qwen3-8b-GGUF/allura-org_remnant-qwen3-8b-Q4_K_M.gguf
- !!merge <<: *qwen3
name: "huihui-ai_qwen3-14b-abliterated"
urls:
- https://huggingface.co/huihui-ai/Qwen3-14B-abliterated
- https://huggingface.co/bartowski/huihui-ai_Qwen3-14B-abliterated-GGUF
description: |
This is an uncensored version of Qwen/Qwen3-14B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
Ablation was performed using a new and faster method, which yields better results.
overrides:
parameters:
model: huihui-ai_Qwen3-14B-abliterated-Q4_K_M.gguf
files:
- filename: huihui-ai_Qwen3-14B-abliterated-Q4_K_M.gguf
sha256: d76889059a3bfab30bc565012a0184827ff2bdc10197f6babc24541b98451dbe
uri: huggingface://bartowski/huihui-ai_Qwen3-14B-abliterated-GGUF/huihui-ai_Qwen3-14B-abliterated-Q4_K_M.gguf
- &gemma3
url: "github:mudler/LocalAI/gallery/gemma.yaml@master"
name: "gemma-3-27b-it"