ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-21 13:37:51 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

models(gallery): add theia-llama-3.1-8b-v1 (#3861)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-10-17 11:06:24 +02:00 committed by GitHub
parent e65e3253a3
commit e416843f22
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 14 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
gallery/index.yaml
View File

@ -1732,6 +1732,20 @@
- filename: L3.1-EtherealRainbow-v1.0-rc1-8B.Q4_K_M.gguf - filename: L3.1-EtherealRainbow-v1.0-rc1-8B.Q4_K_M.gguf
sha256: c5556b2563112e512acca171415783f0988545b02c1834696c1cc35952def72c sha256: c5556b2563112e512acca171415783f0988545b02c1834696c1cc35952def72c
uri: huggingface://mradermacher/L3.1-EtherealRainbow-v1.0-rc1-8B-GGUF/L3.1-EtherealRainbow-v1.0-rc1-8B.Q4_K_M.gguf uri: huggingface://mradermacher/L3.1-EtherealRainbow-v1.0-rc1-8B-GGUF/L3.1-EtherealRainbow-v1.0-rc1-8B.Q4_K_M.gguf
- !!merge <<: *llama31
name: "theia-llama-3.1-8b-v1"
urls:
- https://huggingface.co/Chainbase-Labs/Theia-Llama-3.1-8B-v1
- https://huggingface.co/QuantFactory/Theia-Llama-3.1-8B-v1-GGUF
description: |
Theia-Llama-3.1-8B-v1 is an open-source large language model (LLM) trained specifically in the cryptocurrency domain. It was fine-tuned from the Llama-3.1-8B base model using a dataset curated from top 2000 cryptocurrency projects and comprehensive research reports to specialize in crypto-related tasks. Theia-Llama-3.1-8B-v1 has been quantized to optimize it for efficient deployment and reduced memory footprint. It's benchmarked highly for crypto knowledge comprehension and generation, knowledge coverage, and reasoning capabilities. The system prompt used for its training is "You are a helpful assistant who will answer crypto related questions." The recommended parameters for performance include sequence length of 256, temperature of 0, top-k-sampling of -1, top-p of 1, and context window of 39680.
overrides:
parameters:
model: Theia-Llama-3.1-8B-v1.Q4_K_M.gguf
files:
- filename: Theia-Llama-3.1-8B-v1.Q4_K_M.gguf
sha256: db876d033f86f118b49a1f1006e5d078d494c93b73c7e595bd10ca789a0c8fdb
uri: huggingface://QuantFactory/Theia-Llama-3.1-8B-v1-GGUF/Theia-Llama-3.1-8B-v1.Q4_K_M.gguf
- &deepseek - &deepseek
## Deepseek ## Deepseek
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master" url: "github:mudler/LocalAI/gallery/deepseek.yaml@master"