ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-24 01:03:28 +00:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity

feat: use tokenizer.apply_chat_template() in vLLM (#1990)

Browse Source 
Use tokenizer.apply_chat_template() in vLLM

Signed-off-by: Ludovic LEROUX <ludovic@inpher.io>
This commit is contained in:
Ludovic Leroux
2024-04-11 13:20:22 -04:00
committed by GitHub
parent cbda06fb96
commit 12c0d9443e
34 changed files with 3088 additions and 989 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
core/config/backend_config.go
View File

@ -165,11 +165,12 @@ type Functions struct {
}
type TemplateConfig struct {
Chat string `yaml:"chat"`
ChatMessage string `yaml:"chat_message"`
Completion string `yaml:"completion"`
Edit string `yaml:"edit"`
Functions string `yaml:"function"`
Chat string `yaml:"chat"`
ChatMessage string `yaml:"chat_message"`
Completion string `yaml:"completion"`
Edit string `yaml:"edit"`
Functions string `yaml:"function"`
UseTokenizerTemplate bool `yaml:"use_tokenizer_template"`
}
func (c *BackendConfig) SetFunctionCallString(s string) {