LocalAI/gallery/vicuna-chat.yaml
Ettore Di Giacinto e65e3253a3
models(gallery): add apollo2-9b ()
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-10-17 10:16:52 +02:00

27 lines
442 B
YAML

---
name: "vicuna-chat"
description: |
Vicuna chat
license: "LLaMA"
config_file: |
backend: llama-cpp
context_size: 4096
roles:
user: "User: "
system: "System: "
assistant: "Assistant: "
f16: true
stopwords:
- <|end|>
- <|endoftext|>
- <eos>
template:
completion: |
Complete the following sentence: {{.Input}}
chat: |
{{.Input}}
ASSISTANT: