ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-04-15 23:16:48 +00:00
Code Issues Actions 18 Packages Projects Releases Wiki Activity

chore(model): add llama-3.1-8b-instruct-ortho-v3 to the gallery (#4226)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-11-22 11:33:20 +01:00 committed by GitHub
parent cfc45dff37
commit f5fdef72e3
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 15 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

15
gallery/index.yaml
View File

@ -2969,6 +2969,21 @@
- filename: LLaMA-Mesh-Q4_K_M.gguf
sha256: 150ac70c92bb7351468768bcc84bd3018f44b624f709821fee8e5e816e4868e7
uri: huggingface://bartowski/LLaMA-Mesh-GGUF/LLaMA-Mesh-Q4_K_M.gguf
- !!merge <<: *llama31
name: "llama-3.1-8b-instruct-ortho-v3"
urls:
- https://huggingface.co/lodrick-the-lafted/llama-3.1-8b-instruct-ortho-v3
- https://huggingface.co/mradermacher/llama-3.1-8b-instruct-ortho-v3-GGUF
description: |
A few different attempts at orthogonalization/abliteration of llama-3.1-8b-instruct using variations of the method from "Mechanistically Eliciting Latent Behaviors in Language Models".
Each of these use different vectors and have some variations in where the new refusal boundaries lie. None of them seem totally jailbroken.
overrides:
parameters:
model: llama-3.1-8b-instruct-ortho-v3.Q4_K_M.gguf
files:
- filename: llama-3.1-8b-instruct-ortho-v3.Q4_K_M.gguf
sha256: 8d1dd638ed80019f5cd61240d1f06fd1333413f61427bef4d288c5b8cd9d8cea
uri: huggingface://mradermacher/llama-3.1-8b-instruct-ortho-v3-GGUF/llama-3.1-8b-instruct-ortho-v3.Q4_K_M.gguf
- &deepseek
## Deepseek
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master"