ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-15 21:48:07 +00:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity

transformers: correctly load automodels (#1643)

Browse Source 
* backends(transformers): use AutoModel with LLM types

* examples: animagine-xl

* Add codellama examples
This commit is contained in:
Ettore Di Giacinto
2024-01-26 00:13:21 +01:00
committed by GitHub
parent 3733250b3c
commit cb7512734d
27 changed files with 1144 additions and 569 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
api/backend/options.go
View File

@ -63,6 +63,8 @@ func gRPCModelOpts(c config.Config) *pb.ModelOptions {
F16Memory: c.F16,
MLock: c.MMlock,
RopeFreqBase: c.RopeFreqBase,
RopeScaling: c.RopeScaling,
Type: c.ModelType,
RopeFreqScale: c.RopeFreqScale,
NUMA: c.NUMA,
Embeddings: c.Embeddings,