Update phi-2.yaml

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
This commit is contained in:
Ettore Di Giacinto 2024-01-26 16:22:54 +01:00 committed by GitHub
parent ac19998e5e
commit f1846ae5ac
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -15,4 +15,11 @@ template:
chat: &template |
Instruct: {{.Input}}
Output:
completion: *template
completion: *template
usage: |
To use this model, interact with the API (in another terminal) with curl for instance:
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "phi-2",
"messages": [{"role": "user", "content": "How are you doing?", "temperature": 0.1}]
}'