43f0688a95
feat: Upgrade to CUDA 12.5 ( #2601 )
...
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com >
2024-06-19 17:50:49 +02:00
8142bdc48f
⬆️ Update ggerganov/llama.cpp ( #2603 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-19 00:28:50 +00:00
89a11e15e7
fix(single-binary): bundle ld.so ( #2602 )
...
* debug
* fix copy command/silly muscle memory
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* remove tmate
* Debugging
* Start binary with ld.so if present in libdir
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* small refactor
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-18 22:43:43 +02:00
06de542032
feat(talk): display an informative box, better colors ( #2600 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-18 15:10:01 +02:00
ecbb61cbf4
feat(sd-3): add stablediffusion 3 support ( #2591 )
...
* feat(sd-3): add stablediffusion 3 support
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* deps(diffusers): add sentencepiece
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* models(gallery): add stablediffusion-3
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-18 15:09:39 +02:00
7f13e3a783
docs(models): fixup top message
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-18 08:42:30 +02:00
c926469b9c
⬆️ Update ggerganov/llama.cpp ( #2594 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-18 03:06:31 +00:00
c30b57a629
⬆️ Update docs version mudler/LocalAI ( #2593 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-18 01:47:04 +00:00
2f297979a7
⬆️ Update ggerganov/llama.cpp ( #2587 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-17 15:28:19 +00:00
2437a2769d
models(gallery): add gemma-1.1-7b-it ( #2588 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-17 14:13:27 +02:00
b58b7cad94
models(gallery): add samantha-qwen2 ( #2586 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-17 10:08:29 +02:00
68148f2a1a
⬆️ Update ggerganov/llama.cpp ( #2584 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-17 00:18:44 +00:00
4897eb0ba2
ci: pack less libs inside the binary ( #2579 )
...
The binary grew up to 1.8GB quickly - rocm at least raises +800MB by
itself - so we might just want to manage the GPU libs separately.
Adds a comment to list all the libraries found so far that we are
depending on, but will likely follow up in a way to bundle these
separately.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-16 22:10:28 +02:00
1b43966c48
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-16 20:27:37 +02:00
c5f2f11503
models(gallery): add hathor_stable-v0.2-l3-8b ( #2582 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-16 20:24:36 +02:00
895443d1b5
models(gallery): add tess-v2.5-phi-3-medium-128k-14b ( #2581 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-16 20:22:08 +02:00
6a0802e8e6
models(gallery): add dolphin-qwen ( #2580 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-16 20:11:21 +02:00
94cfaad7f4
feat(libpath): refactor and expose functions for external library paths ( #2578 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-16 13:58:28 +02:00
ac4a94dd44
feat(build): bundle libs for arm64 and x86 linux binaries ( #2572 )
...
This PR bundles further libs into the arm64 and x86_64 binaries
This can be improved by a lot - it's far from perfect, however in this PR I wanted to collect the required libs, and give a simple baseline to improve later upon. It is quite challenging to do this exercise with CI only - but it's the fastest way I see now.
I hope that after the list is initially built we can further improve this down the line and remove some of the technical debt left here to speedup things and do not get stuck in the middle of CI cycles.
In this PR:
- The x86_64 binary now bundles hipblas, nvidia and intel libraries too to avoid any dependency to be installed in the host
- Similarly, for the arm64 we now bundle all the required assets
## What's left
We should be also able to cross-compile Nvidia for arm64 - however I didn't succeed so far so I've left that open. Similarly I might have missed some libraries, but we will see with bug reports and testing around with the new binaries. I've tested on my arm64 board and I could finally start things up.
An open point still is shipping libraries for e.g. tts and stablediffusion. this is not done yet, however with the same methodology we should be able to extend support also for these two backends in the binary.
2024-06-16 09:10:44 +02:00
58bf8614d9
⬆️ Update ggerganov/llama.cpp ( #2575 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-15 23:45:10 +00:00
3764e50b35
models(gallery): add firefly-gemma-7b ( #2576 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-15 23:07:20 +02:00
3f464d2d9e
Fix standard image latest Docker tags ( #2574 )
...
- Fix standard image latest Docker tags
Signed-off-by: Nate Harris <nwithan8@users.noreply.github.com >
2024-06-15 22:08:30 +02:00
5116d561e1
⬆️ Update ggerganov/llama.cpp ( #2570 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-14 23:39:20 +00:00
96a7a3b59f
fix(Makefile): enable STATIC on dist ( #2569 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-14 12:28:46 +02:00
112d0ffa45
feat(darwin): embed grpc libs ( #2567 )
...
* debug
* feat(makefile): allow to bundle libs into binary
* ci: bundle protobuf into single-binary
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* ci: tests
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(assets): correctly reference extract folder
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* bundle also abseil
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* bundle more libs
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-14 08:51:25 +02:00
25f45827ab
⬆️ Update ggerganov/whisper.cpp ( #2565 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-14 00:26:51 +00:00
f322f7c62d
⬆️ Update ggerganov/llama.cpp ( #2564 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-13 23:47:50 +00:00
06351cbbb4
feat(binary): support extracted bundled libs on darwin ( #2563 )
...
When offering fallback libs, use the proper env var for darwin
Note: this does not include the libraries itself, but only sets the
proper env var for the libs to be picked up on darwin.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-13 22:59:42 +02:00
8f952d90b0
feat(guesser): identify gemma models ( #2561 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-13 19:12:37 +02:00
7b205510f9
feat(gallery): uniform download from CLI ( #2559 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-13 16:12:46 +02:00
f183fec232
⬆️ Update ggerganov/llama.cpp ( #2554 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-13 08:34:32 +00:00
91f48b2143
docs(gallery): lazy-load images ( #2557 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-13 01:05:24 +02:00
f404580256
docs: bump go version
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-13 00:49:51 +02:00
882556d4db
feat(gallery): show available models in website, allow local-ai models install to install from galleries ( #2555 )
...
* WIP
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* gen a static page instead (we force DNS redirects to it)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(gallery): install models from CLI, unify install
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Uniform graphic of model page
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Makefile: update targets
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Slightly enhance gallery view
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-13 00:47:16 +02:00
f8382adbf7
⬆️ Update ggerganov/llama.cpp ( #2551 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-12 08:54:00 +00:00
80298f94fa
⬆️ Update ggerganov/whisper.cpp ( #2552 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-12 07:39:21 +00:00
0f8b489346
models(gallery): add badger-lambda-llama-3-8b ( #2550 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-11 19:11:42 +02:00
154694462e
models(gallery): add duloxetine ( #2549 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-11 19:06:26 +02:00
347317d5d2
models(gallery): add average_normie_v3.69_8b-iq-imatrix ( #2548 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-11 19:05:27 +02:00
d40722d2fa
models(gallery): add llama-salad-8x8b ( #2547 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-11 18:40:16 +02:00
7b12300f15
models(gallery): add l3-aethora-15b ( #2546 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-11 18:31:13 +02:00
3c50abffdd
models(gallery): add hathor-l3-8b-v.01-iq-imatrix ( #2545 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-11 16:37:27 +02:00
2eb2ed84ab
models(gallery): add llama3-8B-aifeifei-1.2-iq-imatrix ( #2544 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-11 10:54:21 +02:00
5da10fb769
⬆️ Update ggerganov/llama.cpp ( #2540 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-11 00:59:17 +00:00
bec883e3ff
⬆️ Update ggerganov/whisper.cpp ( #2539 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-10 23:32:32 +00:00
14b41be057
feat(detection): detect by template in gguf file, add qwen2, phi, mistral and chatml ( #2536 )
...
feat(detection): detect by template in gguf file, add qwen and chatml
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-10 22:58:04 +02:00
aff2acacf9
Add integrations ( #2535 )
...
* update integrations
* update integrations1
2024-06-10 19:18:47 +02:00
b4d4c0a18f
chore(deps): Update Dockerfile ( #2532 )
...
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com >
2024-06-10 08:40:02 +00:00
3a5f2283ea
⬆️ Update ggerganov/llama.cpp ( #2531 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-09 23:15:59 +00:00
d9109ffafb
feat(defaults): add defaults for Command-R models ( #2529 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-09 20:00:16 +02:00
