ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-05 18:18:20 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

Update codellama-7b.yaml

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
This commit is contained in:
Ettore Di Giacinto 2024-01-26 18:35:33 +01:00 committed by GitHub
parent 670cee8274
commit 072f71dfb7
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
embedded/models/codellama-7b.yaml
View File

@ -4,11 +4,10 @@ parameters:
model: codellama/CodeLlama-7b-hf model: codellama/CodeLlama-7b-hf
temperature: 0.2 temperature: 0.2
top_k: 40 top_k: 40
seed: -1
top_p: 0.95 top_p: 0.95
usage: | usage: |
curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{ curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{
"model": "codellama-7b", "model": "codellama-7b",
"prompt": "import socket\n\ndef ping_exponential_backoff(host: str):" "prompt": "import socket\n\ndef ping_exponential_backoff(host: str):"
}' }'