ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-11 04:52:52 +00:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity

Update transformers-tinyllama.yaml

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
This commit is contained in:
Ettore Di Giacinto 2024-01-26 18:29:38 +01:00 committed by GitHub
parent 9f1be45552
commit 670cee8274
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
embedded/models/transformers-tinyllama.yaml
View File

@ -6,7 +6,6 @@ parameters:
model: TinyLlama/TinyLlama-1.1B-Chat-v1.0 model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
temperature: 0.2 temperature: 0.2
top_k: 40 top_k: 40
seed: -1
top_p: 0.95 top_p: 0.95
max_tokens: 4096 max_tokens: 4096
@ -29,4 +28,4 @@ usage: |
"model": "tinyllama-chat", "model": "tinyllama-chat",
"messages": [{"role": "user", "content": "Say this is a test!"}], "messages": [{"role": "user", "content": "Say this is a test!"}],
"temperature": 0.7 "temperature": 0.7
}' }'