ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-01-29 15:44:17 +00:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity

models(gallery): add llama3-8B-aifeifei-1.2-iq-imatrix (#2544)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-06-11 10:54:21 +02:00 committed by GitHub
parent 5da10fb769
commit 2eb2ed84ab
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 15 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

15
gallery/index.yaml
View File

@ -850,6 +850,21 @@
- filename: llama3-8B-aifeifei-1.0-Q4_K_M-imat.gguf
sha256: 0bc21be5894c2e252ff938ba908bb702774b7de53daca864d707d41f0f98a833
uri: huggingface://Lewdiculous/llama3-8B-aifeifei-1.0-GGUF-IQ-Imatrix/llama3-8B-aifeifei-1.0-Q4_K_M-imat.gguf
- !!merge <<: *llama3
name: "llama3-8B-aifeifei-1.2-iq-imatrix"
urls:
- https://huggingface.co/aifeifei798/llama3-8B-aifeifei-1.2
- https://huggingface.co/Lewdiculous/llama3-8B-aifeifei-1.2-GGUF-IQ-Imatrix
icon: https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/nn_446H9BiIbjPmOVVNyJ.png
description: |
This model has a narrow use case in mind. Read the original description.
overrides:
parameters:
model: llama3-8B-aifeifei-1.2-Q4_K_M-imat.gguf
files:
- filename: llama3-8B-aifeifei-1.2-Q4_K_M-imat.gguf
sha256: 0320e19ae19eec47a77956721ea3339a5c8bae4db69177a020850ec57a34e5c3
uri: huggingface://Lewdiculous/llama3-8B-aifeifei-1.2-GGUF-IQ-Imatrix/llama3-8B-aifeifei-1.2-Q4_K_M-imat.gguf
- !!merge <<: *llama3
name: "rawr_llama3_8b-iq-imatrix"
urls: