mirror of
https://github.com/mudler/LocalAI.git
synced 2024-12-27 00:01:07 +00:00
169d8d21ff
* Added some OpenVINO models Added Phi-3 trust_remote_code: true Added Hermes 2 Pro Llama3 Added Multilingual-E5-base embedding model with OpenVINO acceleration (CPU and XPU) Added all-MiniLM-L6-v2 with OpenVINO acceleration (CPU and XPU) * Added Remote Code for phi, fixed error on Yamllint * update openvino.yaml I need to go to rest: today is not my day...
10 lines
152 B
YAML
10 lines
152 B
YAML
---
|
|
name: openvino
|
|
|
|
config_file: |
|
|
backend: transformers
|
|
context_size: 8192
|
|
type: OVModelForCausalLM
|
|
template:
|
|
use_tokenizer_template: true
|