LocalAI/gallery/llava.yaml

---
name: "llava"

config_file: |
  backend: llama-cpp
  context_size: 4096
  f16: true

  mmap: true
  roles:
    user: "USER:"
    assistant: "ASSISTANT:"
    system: "SYSTEM:"

  template:
    chat: |
      A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
      {{.Input}}
      ASSISTANT:
fix: yamlint warnings and errors (#2131) fix yamlint warnings and errors Signed-off-by: Dave Lee <dave@gray101.com> 2024-04-25 13:25:56 -04:00			`---`
feat(gallery): add llama3, hermes, phi-3, and others (#2110) Also adds embeddings and llava models Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2024-04-23 19:35:45 +02:00			`name: "llava"`

			`config_file: \|`
			`backend: llama-cpp`
			`context_size: 4096`
			`f16: true`

			`mmap: true`
			`roles:`
			`user: "USER:"`
			`assistant: "ASSISTANT:"`
			`system: "SYSTEM:"`

			`template:`
			`chat: \|`
			`A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.`
			`{{.Input}}`
			`ASSISTANT:`