ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-01-19 03:06:58 +00:00
Code Issues Actions 16 Packages Projects Releases Wiki Activity

models(gallery): add hermes-3-llama-3.1-70b-lorablated (#3823)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-10-14 10:17:23 +02:00 committed by GitHub
parent 93ba5ea14f
commit 304484c59b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 18 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

18
gallery/index.yaml
View File

@ -1478,6 +1478,24 @@
- filename: Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf
sha256: b548ad47caf7008a697afb3556190359529f5a05ec0e4e48ef992c7869e14255
uri: huggingface://Lewdiculous/Llama-3.1-8B-ArliAI-Formax-v1.0-GGUF-IQ-ARM-Imatrix/Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf
- !!merge <<: *llama31
name: "hermes-3-llama-3.1-70b-lorablated"
icon: https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/4Hbw5n68jKUSBQeTqQIeT.png
urls:
- https://huggingface.co/mlabonne/Hermes-3-Llama-3.1-70B-lorablated
- https://huggingface.co/mradermacher/Hermes-3-Llama-3.1-70B-lorablated-GGUF
description: |
This is an uncensored version of NousResearch/Hermes-3-Llama-3.1-70B using lorablation.
The recipe is based on @grimjim's grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter (special thanks):
Extraction: We extract a LoRA adapter by comparing two models: a censored Llama 3 (meta-llama/Meta-Llama-3-70B-Instruct) and an abliterated Llama 3.1 (failspy/Meta-Llama-3.1-70B-Instruct-abliterated).
Merge: We merge this new LoRA adapter using task arithmetic to the censored NousResearch/Hermes-3-Llama-3.1-70B to abliterate it.
overrides:
parameters:
model: Hermes-3-Llama-3.1-70B-lorablated.Q4_K_M.gguf
files:
- filename: Hermes-3-Llama-3.1-70B-lorablated.Q4_K_M.gguf
sha256: 9294875ae3b8822855072b0f710ce800536d144cf303a91bcb087c4a307b578d
uri: huggingface://mradermacher/Hermes-3-Llama-3.1-70B-lorablated-GGUF/Hermes-3-Llama-3.1-70B-lorablated.Q4_K_M.gguf
- &deepseek
## Deepseek
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master"