a96c3bc885
feat(diffusers): various enhancements ( #895 )
2023-08-14 23:12:00 +02:00
8c781a6a44
feat: Add Diffusers ( #874 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-08-09 08:38:51 +02:00
3c8fc37c56
feat: Add UseFastTokenizer
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-08-08 01:10:05 +02:00
39805b09e5
fix: pass by env in managed services
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-08-08 00:58:38 +02:00
63b01199fe
fix: match lowercase of the input, not of the model
2023-08-08 00:46:22 +02:00
a843e64fc2
feat: add initial AutoGPTQ backend implementation
2023-08-07 22:53:28 +02:00
acd829a7a0
fix: do not break on newlines on function returns ( #864 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-08-04 21:46:36 +02:00
4aa5dac768
feat: update integer, number and string rules - allow primitives as root types ( #862 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-08-03 23:32:30 +02:00
5ca21ee398
feat: add ngqa and RMSNormEps parameters ( #860 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-08-03 00:51:08 +02:00
7fb8b4191f
feat: "simple" chat/edit/completion template system prompt from config ( #856 )
2023-08-03 00:19:55 +02:00
d603a9cbb5
fix(gallery): preload from file should by in YAML format ( #846 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-31 21:13:16 +02:00
ce8e9dc690
feature: model list :: filter query string parameter ( #830 )
2023-07-31 19:14:32 +02:00
8e8d474ae8
refactor: Remove remaining uses of depreciated package io/ioutil ( #837 )
2023-07-30 11:23:43 +00:00
5ce0f216cf
Fix: Model Gallery Downloads ( #835 )
2023-07-30 09:47:22 +02:00
00ccb8d4f1
fix: set default rope freq base to 10000 during model load
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-29 10:40:56 +02:00
8b90ac2b1a
1000 -> 10,000 for ropeFreqBase?
...
the error message talks about a default of 10k, so setting this to 10k instead of 1k experimentally.
2023-07-29 02:37:24 -04:00
f085baa77d
fix: set default rope if not specified
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-29 01:07:16 +02:00
096d98c3d9
fix: add rope settings during model load, fix CUDA ( #821 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-27 21:56:05 +02:00
b96e30e66c
fix: use bytes in gRPC proto instead of strings ( #813 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-27 18:41:04 +02:00
569c1d1163
feat: add rope settings and negative prompt, drop grammar backend ( #797 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-25 19:05:27 +02:00
12fe0932c4
feat: cancel stream generation if client disappears ( #792 )
2023-07-24 23:10:54 +02:00
c6bf67f446
feat(llama2): add template for chat messages ( #782 )
...
Co-authored-by: Aman Karmani <aman@tmm1.net >
Lays some of the groundwork for LLAMA2 compatibility as well as other future models with complex prompting schemes.
Started small refactoring in pkg/model/loader.go regarding template loading. Currently still a part of ModelLoader, but should be easy to add template loading for situations other than overall prompt templates and the new chat-specific per-message templates
Adds support for new chat-endpoint-specific, per-message templates as an alternative to the existing Role: XYZ sprintf method.
Includes a temporary prompt template as an example, since I have a few questions before we merge in the model-gallery side changes (see )
Minor debug logging changes.
2023-07-22 11:31:39 -04:00
c71c729bc2
debug
2023-07-21 10:53:26 +02:00
94916749c5
feat: add external grpc and model autoloading
2023-07-20 22:10:12 +02:00
47cc95fc9f
feat: add all backends to autoload
...
Now since gRPCs are not crashing the main thread we can just greedly
attempt all the backends we have available.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-20 00:40:28 +02:00
3feb632eb4
refactor: rename "llama-master" and "llama" ( #776 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-20 00:36:16 +02:00
236497e331
feat: resolve JSONSchema refs (planners) ( #774 )
2023-07-19 22:56:13 +02:00
6352448b72
feat: add llama-master backend ( #752 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-17 23:58:15 +02:00
1d0ed95a54
feat: move other backends to grpc
...
This finally makes everything more consistent
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-15 01:19:43 +02:00
5dcfdbe51d
feat: various refactorings
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-15 01:19:43 +02:00
f2f1d7fe72
feat: use gRPC for transformers
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-15 01:19:43 +02:00
ae533cadef
feat: move gpt4all to a grpc service
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-15 01:19:43 +02:00
58f6aab637
feat: move llama to a grpc
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-15 01:19:43 +02:00
b816009db0
feat: add falcon ggllm via grpc client
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-15 01:19:43 +02:00
55befe396a
Add grammar_json to the request parameters to facilitate JSON generation
2023-07-06 19:08:04 +02:00
c0578031b5
Add tests
...
Signed-off-by: mudler <mudler@localai.io >
2023-07-04 18:58:19 +02:00
b722e7eb7e
feat: cleanups, small enhancements
...
Signed-off-by: mudler <mudler@localai.io >
2023-07-04 18:58:19 +02:00
f09ddd2983
feat: add grammar and functions call support
2023-07-04 18:58:19 +02:00
a6839fd238
feat: [whisper] Partial support for verbose_json format in transcribe endpoint ( #721 )
2023-07-04 14:31:31 +02:00
bf5acf646e
fix: adapt whisper to bindings updates ( #702 )
...
Signed-off-by: mudler <mudler@localai.io >
2023-06-29 11:26:07 +02:00
78f3c3da48
refactor: consolidate usage of GetURI ( #674 )
...
Signed-off-by: mudler <mudler@localai.io >
2023-06-26 12:25:38 +02:00
d18f85df46
fix: add tags
...
Signed-off-by: mudler <mudler@localai.io >
2023-06-25 23:03:58 +02:00
6213da330a
fix: add omitempty where needed ( #671 )
2023-06-25 22:51:02 +02:00
60db5957d3
Gallery repository ( #663 )
...
Signed-off-by: mudler <mudler@localai.io >
2023-06-24 08:18:17 +02:00
a7bb029d23
feat: add tts with go-piper ( #649 )
...
Signed-off-by: mudler <mudler@localai.io >
2023-06-22 17:53:10 +02:00
e37361985c
deps: update gpt4all bindings, fix search path on new versions ( #592 )
2023-06-14 13:24:53 +02:00
84946e9275
feat: display download progress when installing models ( #543 )
2023-06-08 21:33:18 +02:00
d62aef2016
feat: add experimental support for falcon-7b ( #516 )
...
Signed-off-by: mudler <mudler@mocaccino.org >
2023-06-06 17:23:19 +02:00
b447a2a719
feat: support upscaled image generation with esrgan ( #509 )
2023-06-05 17:21:38 +02:00
78ad4813df
feat: Update gpt4all, support multiple implementations in runtime ( #472 )
...
Signed-off-by: mudler <mudler@mocaccino.org >
2023-06-01 23:38:52 +02:00
