ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-03-12 23:44:53 +00:00
Code Issues Actions 15 Packages Projects Releases Wiki Activity

chore(model gallery): add ibm-granite_granite-3.2-2b-instruct (#4928)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2025-03-02 10:22:35 +01:00 committed by GitHub
parent 0404d98190
commit 326be287da
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 15 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

15
gallery/index.yaml
View File

@ -1094,6 +1094,21 @@
- filename: ibm-granite_granite-3.2-8b-instruct-Q4_K_M.gguf
sha256: bd041eb5bc5e75e4f9a863372000046fd6490374f4dec07f399ca152b1df09c2
uri: huggingface://bartowski/ibm-granite_granite-3.2-8b-instruct-GGUF/ibm-granite_granite-3.2-8b-instruct-Q4_K_M.gguf
- !!merge <<: *granite3
name: "ibm-granite_granite-3.2-2b-instruct"
url: "github:mudler/LocalAI/gallery/granite3-2.yaml@master"
urls:
- https://huggingface.co/ibm-granite/granite-3.2-2b-instruct
- https://huggingface.co/bartowski/ibm-granite_granite-3.2-2b-instruct-GGUF
description: |
Granite-3.2-2B-Instruct is an 2-billion-parameter, long-context AI model fine-tuned for thinking capabilities. Built on top of Granite-3.1-2B-Instruct, it has been trained using a mix of permissively licensed open-source datasets and internally generated synthetic data designed for reasoning tasks. The model allows controllability of its thinking capability, ensuring it is applied only when required.
overrides:
parameters:
model: ibm-granite_granite-3.2-2b-instruct-Q4_K_M.gguf
files:
- filename: ibm-granite_granite-3.2-2b-instruct-Q4_K_M.gguf
sha256: e1b915b0849becf4fdda188dee7b09cbebbfabd71c6f3f2b75dd3eca0a8fded1
uri: huggingface://bartowski/ibm-granite_granite-3.2-2b-instruct-GGUF/ibm-granite_granite-3.2-2b-instruct-Q4_K_M.gguf
- name: "moe-girl-1ba-7bt-i1"
icon: https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/kTXXSSSqpb21rfyOX7FUa.jpeg
# chatml