ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-19 20:57:54 +00:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity

models(gallery): add llama-3.1-8b-arliai-formax-v1.0-iq-arm-imatrix (#3821)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-10-14 08:59:41 +02:00 committed by GitHub
parent b6f681315a
commit 8ec828a654
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 19 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

19
gallery/index.yaml
View File

@ -1444,6 +1444,25 @@
- filename: Llama3.1-Gutenberg-Doppel-70B.Q4_K_M.gguf
sha256: af558f954fa26c5bb75352178cb815bbf268f01c0ca0b96f2149422d4c19511b
uri: huggingface://mradermacher/Llama3.1-Gutenberg-Doppel-70B-GGUF/Llama3.1-Gutenberg-Doppel-70B.Q4_K_M.gguf
- !!merge <<: *llama31
name: "llama-3.1-8b-arliai-formax-v1.0-iq-arm-imatrix"
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
icon: https://iili.io/2HmlLn2.md.png
urls:
- https://huggingface.co/Lewdiculous/Llama-3.1-8B-ArliAI-Formax-v1.0-GGUF-IQ-ARM-Imatrix
description: |
Quants for ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0.
"Formax is a model that specializes in following response format instructions. Tell it the format of it's response and it will follow it perfectly. Great for data processing and dataset creation tasks."
"It is also a highly uncensored model that will follow your instructions very well."
overrides:
parameters:
model: Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf
files:
- filename: Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf
sha256: b548ad47caf7008a697afb3556190359529f5a05ec0e4e48ef992c7869e14255
uri: huggingface://Lewdiculous/Llama-3.1-8B-ArliAI-Formax-v1.0-GGUF-IQ-ARM-Imatrix/Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf
- &deepseek
## Deepseek
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master"