ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-18 15:08:08 +00:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity

transformers: correctly load automodels (#1643)

Browse Source 
* backends(transformers): use AutoModel with LLM types

* examples: animagine-xl

* Add codellama examples
This commit is contained in:
Ettore Di Giacinto
2024-01-26 00:13:21 +01:00
committed by GitHub
parent 3733250b3c
commit cb7512734d
27 changed files with 1144 additions and 569 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
api/config/config.go
View File

@ -128,7 +128,9 @@ type LLMConfig struct {
Quantization string `yaml:"quantization"`
MMProj string `yaml:"mmproj"`
RopeScaling string `yaml:"rope_scaling"`
RopeScaling string `yaml:"rope_scaling"`
ModelType string `yaml:"type"`
YarnExtFactor float32 `yaml:"yarn_ext_factor"`
YarnAttnFactor float32 `yaml:"yarn_attn_factor"`
YarnBetaFast float32 `yaml:"yarn_beta_fast"`