Ettore Di Giacinto
1120847f72
feat: bump llama.cpp, add gguf support ( #943 )
...
**Description**
This PR syncs up the `llama` backend to use `gguf`
(https://github.com/go-skynet/go-llama.cpp/pull/180 ). It also adds
`llama-stable` to the targets so we can still load ggml. It adapts the
current tests to use the `llama-backend` for ggml and uses a `gguf`
model to run tests on the new backend.
In order to consume the new version of go-llama.cpp, it also bump go to
1.21 (images, pipelines, etc)
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-08-24 01:18:58 +02:00
renovate[bot]
6583eed6b2
fix(deps): update module github.com/google/uuid to v1.3.1 ( #936 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-22 10:51:04 +02:00
renovate[bot]
02f7c555af
fix(deps): update github.com/tmc/langchaingo digest to fef0821 ( #922 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-19 01:50:04 +02:00
renovate[bot]
d982b38f76
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 36f7fb5 ( #908 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-19 01:49:51 +02:00
Ettore Di Giacinto
afdc0ebfd7
feat: add --single-active-backend to allow only one backend active at the time ( #925 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-08-19 01:49:33 +02:00
Dave
8cb1061c11
Usage Features ( #863 )
2023-08-18 21:23:14 +02:00
renovate[bot]
ddf9bc2335
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to a630935 ( #898 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-16 22:25:28 +02:00
renovate[bot]
a1afd940e3
fix(deps): update github.com/go-skynet/go-llama.cpp digest to f03869d ( #901 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-16 22:25:14 +02:00
renovate[bot]
8bb76201c0
fix(deps): update github.com/tmc/langchaingo digest to eb0cbd3 ( #902 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-16 22:25:02 +02:00
renovate[bot]
7ffd21dbc8
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 18f25c2 ( #894 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-15 09:25:40 +02:00
renovate[bot]
48b3920656
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 4e55940 ( #893 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-15 09:25:27 +02:00
renovate[bot]
9cc8d90865
fix(deps): update module github.com/sashabaranov/go-openai to v1.14.2 ( #884 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-12 22:41:12 +02:00
renovate[bot]
328289099a
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 4d855af ( #875 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-12 08:58:55 +02:00
renovate[bot]
22ffd5f490
fix(deps): update github.com/tmc/langchaingo digest to fd8b7f0 ( #882 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-12 08:56:15 +02:00
renovate[bot]
c93f57efd6
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 0f2bb50 ( #869 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-08 21:57:16 +02:00
renovate[bot]
08b59b5cc5
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 50cee77 ( #861 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-03 19:08:04 +02:00
renovate[bot]
953e30814a
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to c449b71 ( #858 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-03 00:20:45 +02:00
renovate[bot]
a65344cf25
fix(deps): update github.com/tmc/langchaingo digest to 271e9bd ( #857 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-03 00:20:22 +02:00
renovate[bot]
e663beebf0
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cbdcde8 ( #833 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-08-01 00:47:06 +02:00
renovate[bot]
85d3710924
fix(deps): update github.com/tmc/langchaingo digest to 8f10160 ( #843 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-31 19:15:13 +02:00
renovate[bot]
6151ea1c4d
fix(deps): update github.com/tmc/langchaingo digest to 7df4fe5 ( #826 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-30 09:49:12 +02:00
renovate[bot]
d969025f87
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 8c51308 ( #822 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-30 09:48:52 +02:00
renovate[bot]
3a4675c8c3
fix(deps): update module github.com/rs/zerolog to v1.30.0 ( #836 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-30 09:47:49 +02:00
renovate[bot]
147cae9ed8
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 39acbc8 ( #817 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-27 18:56:59 +02:00
renovate[bot]
c63709014b
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6ba16de ( #820 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-27 18:56:39 +02:00
renovate[bot]
78e36779cf
fix(deps): update module google.golang.org/grpc to v1.57.0 ( #815 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-27 18:41:29 +02:00
renovate[bot]
0af0df7423
fix(deps): update module github.com/sashabaranov/go-openai to v1.14.1 ( #783 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-27 18:40:50 +02:00
renovate[bot]
0883d324d9
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 562d2b5 ( #766 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-26 22:06:05 +02:00
renovate[bot]
77597e6a16
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 9100b2e ( #753 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-26 22:05:55 +02:00
renovate[bot]
eae6b36d03
fix(deps): update github.com/donomii/go-rwkv.cpp digest to c898cd0 ( #748 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-26 22:05:42 +02:00
renovate[bot]
c4bc7c41b1
fix(deps): update github.com/tmc/langchaingo digest to 7d5f9fd ( #768 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-26 22:05:32 +02:00
Ettore Di Giacinto
569c1d1163
feat: add rope settings and negative prompt, drop grammar backend ( #797 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-25 19:05:27 +02:00
Ettore Di Giacinto
3feb632eb4
refactor: rename "llama-master" and "llama" ( #776 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-20 00:36:16 +02:00
Ettore Di Giacinto
6352448b72
feat: add llama-master backend ( #752 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-17 23:58:15 +02:00
renovate[bot]
fb6cce487f
fix(deps): update module github.com/gofiber/fiber/v2 to v2.48.0 ( #757 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-16 22:02:30 +02:00
renovate[bot]
3079cc4167
fix(deps): update github.com/go-skynet/go-bert.cpp digest to 6abe312 ( #756 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-16 22:01:53 +02:00
renovate[bot]
6ec315e540
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6c97625 ( #733 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-15 22:53:41 +02:00
renovate[bot]
cf4e6f909c
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cfd70b6 ( #734 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-15 22:53:28 +02:00
renovate[bot]
b3a99166fd
fix(deps): update github.com/tmc/langchaingo digest to dcf7ecd ( #736 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-15 22:53:18 +02:00
renovate[bot]
107008331e
fix(deps): update github.com/mudler/go-ggllm.cpp digest to 862477d ( #745 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-15 22:53:05 +02:00
renovate[bot]
3c3a9b765a
fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to ffb09d7 ( #744 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-15 16:16:13 +02:00
renovate[bot]
a1bbe75d43
fix(deps): update module github.com/sashabaranov/go-openai to v1.14.0 ( #739 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-15 16:15:17 +02:00
renovate[bot]
572a311639
fix(deps): update module google.golang.org/protobuf to v1.31.0 ( #746 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-15 16:14:49 +02:00
Ettore Di Giacinto
b816009db0
feat: add falcon ggllm via grpc client
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-15 01:19:43 +02:00
renovate[bot]
30e4ddbf10
fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 3fec197 ( #706 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-09 16:52:26 +02:00
renovate[bot]
b0520dcb59
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to d611d10 ( #699 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-09 13:40:23 +02:00
renovate[bot]
f42967ed86
fix(deps): update github.com/go-skynet/go-llama.cpp digest to ffa57fb ( #707 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-09 13:40:14 +02:00
renovate[bot]
966675c8e3
fix(deps): update github.com/tmc/langchaingo digest to a875e6b ( #700 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-09 13:40:02 +02:00
renovate[bot]
f68df1624b
fix(deps): update module github.com/otiai10/openaigo to v1.5.2 ( #731 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-09 13:39:51 +02:00
renovate[bot]
42cade808b
fix(deps): update module github.com/sashabaranov/go-openai to v1.13.0 ( #667 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-07-09 13:39:41 +02:00
