ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-18 20:27:57 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

models(gallery): add phi-3-4x4b (#2497)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-06-05 23:29:15 +02:00 committed by GitHub
parent 956d652314
commit 88fd000065
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 14 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
gallery/index.yaml
View File

@ -1781,6 +1781,20 @@
- filename: Cream-Phi-3-14B-v1-Q4_K_M.gguf
uri: huggingface://TheDrummer/Cream-Phi-3-14B-v1-GGUF/Cream-Phi-3-14B-v1-Q4_K_M.gguf
sha256: ec67018a86090da415517acf21ad48f28e02dff664a1dd35602f1f8fa94f6a27
- !!merge <<: *phi-3
name: "phi3-4x4b-v1"
description: |
a continually pretrained phi3-mini sparse moe upcycle
urls:
- https://huggingface.co/bartowski/phi3-4x4b-v1-GGUF
- https://huggingface.co/Fizzarolli/phi3-4x4b-v1
overrides:
parameters:
model: phi3-4x4b-v1-Q4_K_M.gguf
files:
- filename: phi3-4x4b-v1-Q4_K_M.gguf
uri: huggingface://bartowski/phi3-4x4b-v1-GGUF/phi3-4x4b-v1-Q4_K_M.gguf
sha256: fd33220186b7076f4b306f27b3a8913384435a2ca90185a71c9df5a752d3a298
- &hermes-2-pro-mistral
### START Hermes
url: "github:mudler/LocalAI/gallery/hermes-2-pro-mistral.yaml@master"