fa4de05c14
fix: symlink libphonemize in the container
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-28 19:40:21 +02:00
dde12b492b
fix: select function calls if 'name' is set in the request ( #827 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-28 01:17:11 +02:00
096d98c3d9
fix: add rope settings during model load, fix CUDA ( #821 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-27 21:56:05 +02:00
147cae9ed8
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 39acbc8 ( #817 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-27 18:56:59 +02:00
c63709014b
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6ba16de ( #820 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-27 18:56:39 +02:00
9b307799ce
fix missing openai_api_base on langchain-chroma example ( #818 )
2023-07-27 18:41:53 +02:00
78e36779cf
fix(deps): update module google.golang.org/grpc to v1.57.0 ( #815 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-27 18:41:29 +02:00
90ae35e2e4
⬆️ Update nomic-ai/gpt4all ( #814 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-27 18:41:15 +02:00
b96e30e66c
fix: use bytes in gRPC proto instead of strings ( #813 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-27 18:41:04 +02:00
0af0df7423
fix(deps): update module github.com/sashabaranov/go-openai to v1.14.1 ( #783 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-27 18:40:50 +02:00
0883d324d9
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 562d2b5 ( #766 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-26 22:06:05 +02:00
77597e6a16
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 9100b2e ( #753 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-26 22:05:55 +02:00
eae6b36d03
fix(deps): update github.com/donomii/go-rwkv.cpp digest to c898cd0 ( #748 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-26 22:05:42 +02:00
c4bc7c41b1
fix(deps): update github.com/tmc/langchaingo digest to 7d5f9fd ( #768 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-26 22:05:32 +02:00
c79ddd6fc4
⬆️ Update nomic-ai/gpt4all ( #807 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-25 23:03:02 +02:00
ae58fb8821
fix: update gitignore and make clean ( #798 )
...
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-07-25 23:02:46 +02:00
569c1d1163
feat: add rope settings and negative prompt, drop grammar backend ( #797 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-25 19:05:27 +02:00
12fe0932c4
feat: cancel stream generation if client disappears ( #792 )
2023-07-24 23:10:54 +02:00
72e3e236de
Added CPU information to entrypoint.sh ( #794 )
2023-07-23 19:27:55 +00:00
ab59b238b3
fix: update README
2023-07-23 18:58:24 +02:00
bed9570e48
⬆️ Update nomic-ai/gpt4all ( #785 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-23 09:51:42 +02:00
c6bf67f446
feat(llama2): add template for chat messages ( #782 )
...
Co-authored-by: Aman Karmani <aman@tmm1.net >
Lays some of the groundwork for LLAMA2 compatibility as well as other future models with complex prompting schemes.
Started small refactoring in pkg/model/loader.go regarding template loading. Currently still a part of ModelLoader, but should be easy to add template loading for situations other than overall prompt templates and the new chat-specific per-message templates
Adds support for new chat-endpoint-specific, per-message templates as an alternative to the existing Role: XYZ sprintf method.
Includes a temporary prompt template as an example, since I have a few questions before we merge in the model-gallery side changes (see )
Minor debug logging changes.
2023-07-22 11:31:39 -04:00
5ee186b8e5
⬆️ Update go-skynet/go-llama.cpp ( #723 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-22 00:55:33 +02:00
94817b557c
fix: make completions endpoint more close to OpenAI specification ( #790 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-22 00:53:52 +02:00
26e1496075
Update README.md
2023-07-21 23:10:02 +02:00
92fca8ae74
ci: release space before build
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-21 22:56:43 +02:00
7fa5b8401d
[Telegram-bot example] Fix lint for command docker-compose ( #787 )
...
Co-authored-by: Stepan Zhashkov <steven.z@spectral-team.com >
2023-07-21 20:56:04 +02:00
0eac0402e1
feat: backends improvements ( #778 )
2023-07-21 20:55:49 +02:00
c71c729bc2
debug
2023-07-21 10:53:26 +02:00
e459f114cd
fix: fix tests, small refactors
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-20 23:52:04 +02:00
982a7e86a8
feat: add huggingface embeddings backend
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-20 22:10:42 +02:00
94916749c5
feat: add external grpc and model autoloading
2023-07-20 22:10:12 +02:00
5ce5f87a26
fix: move metal file to grpcs assets ( #777 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-20 22:00:07 +02:00
1d2ae46ddc
tests: clean up logs
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-20 01:36:34 +02:00
71ac331f90
⬆️ Update nomic-ai/gpt4all ( #775 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-20 01:22:44 +02:00
47cc95fc9f
feat: add all backends to autoload
...
Now since gRPCs are not crashing the main thread we can just greedly
attempt all the backends we have available.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-20 00:40:28 +02:00
3feb632eb4
refactor: rename "llama-master" and "llama" ( #776 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-20 00:36:16 +02:00
236497e331
feat: resolve JSONSchema refs (planners) ( #774 )
2023-07-19 22:56:13 +02:00
a38dc497b2
⬆️ Update go-skynet/go-llama.cpp ( #770 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-19 19:44:33 +02:00
28ed52fa94
⬆️ Update nomic-ai/gpt4all ( #769 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-19 19:44:21 +02:00
e995b95c94
[build] pass build type to cmake on libtransformers.a build ( #741 )
...
Co-authored-by: Enzo Einhorn <enzo.einhorn@hiventive.com >
2023-07-18 19:04:19 +02:00
8379cce209
example(functions): Add OpenAI functions example ( #767 )
2023-07-18 00:04:21 +02:00
3c6b798522
⬆️ Update nomic-ai/gpt4all ( #759 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-17 23:58:40 +02:00
c18770a61a
⬆️ Update go-skynet/go-bert.cpp ( #758 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-17 23:58:25 +02:00
6352448b72
feat: add llama-master backend ( #752 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-17 23:58:15 +02:00
fb6cce487f
fix(deps): update module github.com/gofiber/fiber/v2 to v2.48.0 ( #757 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-16 22:02:30 +02:00
3079cc4167
fix(deps): update github.com/go-skynet/go-bert.cpp digest to 6abe312 ( #756 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-16 22:01:53 +02:00
27ef8b1eb7
⬆️ Update go-skynet/go-ggml-transformers.cpp ( #711 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-16 09:57:16 +02:00
c00435d72b
⬆️ Update nomic-ai/gpt4all ( #735 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-07-16 09:57:00 +02:00
d0e67cce75
fix: make last stream message to send empty content
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-07-16 00:09:28 +02:00
