ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-18 06:58:09 +00:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity

feat: Add UseFastTokenizer

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto
2023-08-08 01:10:05 +02:00
parent 39805b09e5
commit 3c8fc37c56
10 changed files with 198 additions and 169 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
api/openai/request.go
View File

@ -83,6 +83,10 @@ func updateConfig(config *config.Config, input *OpenAIRequest) {
config.NegativePromptScale = input.NegativePromptScale
}
if input.UseFastTokenizer {
config.UseFastTokenizer = input.UseFastTokenizer
}
if input.NegativePrompt != "" {
config.NegativePrompt = input.NegativePrompt
}