a181dd0ebc
refactor: gallery inconsistencies ( #2647 )
...
* refactor(gallery): move under core/
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(unarchive): do not allow symlinks
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 17:32:12 +02:00
69206fcd4b
fix(install.sh): move ARCH detection so it works also for mac ( #2646 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 10:34:35 +02:00
2c94e15746
fix(install.sh): fix version typo ( #2645 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 10:30:17 +02:00
12513ebae0
rf: centralize base64 image handling ( #2595 )
...
contains simple fixes to warnings and errors, removes a broken / outdated test, runs go mod tidy, and as the actual change, centralizes base64 image handling
Signed-off-by: Dave Lee <dave@gray101.com >
2024-06-24 08:34:36 +02:00
4156a4f15f
⬆️ Update ggerganov/llama.cpp ( #2632 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-23 22:21:38 +00:00
491bb4f174
Update hermes-2-pro-mistral.yaml
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-23 15:17:41 +02:00
5866fc8ded
chore: fix go.mod module ( #2635 )
...
Signed-off-by: Sertac Ozercan <sozercan@gmail.com >
2024-06-23 08:24:36 +00:00
eb4cd78ca6
ci: run master jobs on self-hosted
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-23 10:15:53 +02:00
40ce71855a
ci: disable max-parallelism on master
2024-06-22 23:28:09 +02:00
9c0d0afd09
ci: bump parallel jobs ( #2633 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 23:24:46 +02:00
0f9aa1ef91
fix(install.sh): install CUDA toolkit only if CUDA is detected
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:21:59 +02:00
3ee5ceb9fa
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:16:55 +02:00
1bd72a3be5
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:16:27 +02:00
fbd14118bf
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:14:53 +02:00
515d98b978
Update model-gallery.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:10:49 +02:00
789cf6c599
Update model-gallery.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:10:27 +02:00
0bc82d7270
fix(install.sh): properly detect suse distros
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:08:48 +02:00
9a7ad75bff
docs: update to include installer and update advanced YAML options ( #2631 )
...
* docs: update quickstart and advanced sections
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: improvements
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* examples(kubernete): add nvidia example
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:00:38 +02:00
9fb3e4040b
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:29:46 +02:00
070fd1b9da
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:06:09 +02:00
dda5b9f260
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:05:48 +02:00
8d84dd4f88
fix(worker): use dynaload for single binaries ( #2620 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 09:33:18 +02:00
f569237a50
feat(oci): support OCI images and Ollama models ( #2628 )
...
* Support specifying oci:// and ollama:// for model URLs
Fixes: https://github.com/mudler/LocalAI/issues/2527
Fixes: https://github.com/mudler/LocalAI/issues/1028
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Lower watcher warnings
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Allow to install ollama models from CLI
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fixup tests
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Do not keep file ownership
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Skip test on darwin
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 08:17:41 +02:00
e265a618d9
models(gallery): ⬆️ update checksum ( #2630 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-22 04:45:41 +00:00
533343c84f
⬆️ Update ggerganov/llama.cpp ( #2629 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-22 02:28:06 +00:00
260f2e1d94
fix(install.sh): correctly handle systemd service installation ( #2627 )
...
Fixup install.sh systemd service installation
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-21 23:56:06 +02:00
964732590d
models(gallery): add hermes-2-theta-llama-3-70b ( #2626 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-21 19:41:49 +02:00
70a2bfe82e
⬆️ Update ggerganov/llama.cpp ( #2617 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-21 06:41:34 +00:00
ba2d969c44
models(gallery): add qwen2-1.5b-ita ( #2615 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:35:53 +02:00
d3c78cf4d7
models(gallery): add magnum-72b-v1 ( #2614 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:31:23 +02:00
34afd891a6
models(gallery): add llama3-8b-darkidol-1.1-iq-imatrix ( #2613 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:30:47 +02:00
d3137775a1
models(gallery): add llama-3-cursedstock-v1.8-8b-iq-imatrix ( #2612 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:14:48 +02:00
e1772026a1
models(gallery): add llama-3-sec-chat ( #2611 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:14:03 +02:00
d0423254dd
⬆️ Update ggerganov/llama.cpp ( #2606 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-20 00:58:40 +00:00
db0e52ae9d
⬆️ Update docs version mudler/LocalAI ( #2605 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-20 00:05:19 +00:00
4f030f9cd3
models(gallery): ⬆️ update checksum ( #2607 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-19 22:20:17 +02:00
60fb45eb97
models(gallery): add l3-umbral-mind-rp-v1.0-8b-iq-imatrix ( #2608 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-19 22:19:40 +02:00
43f0688a95
feat: Upgrade to CUDA 12.5 ( #2601 )
...
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com >
2024-06-19 17:50:49 +02:00
8142bdc48f
⬆️ Update ggerganov/llama.cpp ( #2603 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-19 00:28:50 +00:00
89a11e15e7
fix(single-binary): bundle ld.so ( #2602 )
...
* debug
* fix copy command/silly muscle memory
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* remove tmate
* Debugging
* Start binary with ld.so if present in libdir
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* small refactor
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-18 22:43:43 +02:00
06de542032
feat(talk): display an informative box, better colors ( #2600 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-18 15:10:01 +02:00
ecbb61cbf4
feat(sd-3): add stablediffusion 3 support ( #2591 )
...
* feat(sd-3): add stablediffusion 3 support
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* deps(diffusers): add sentencepiece
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* models(gallery): add stablediffusion-3
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-18 15:09:39 +02:00
7f13e3a783
docs(models): fixup top message
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-18 08:42:30 +02:00
c926469b9c
⬆️ Update ggerganov/llama.cpp ( #2594 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-18 03:06:31 +00:00
c30b57a629
⬆️ Update docs version mudler/LocalAI ( #2593 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-18 01:47:04 +00:00
2f297979a7
⬆️ Update ggerganov/llama.cpp ( #2587 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-17 15:28:19 +00:00
2437a2769d
models(gallery): add gemma-1.1-7b-it ( #2588 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-17 14:13:27 +02:00
b58b7cad94
models(gallery): add samantha-qwen2 ( #2586 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-17 10:08:29 +02:00
68148f2a1a
⬆️ Update ggerganov/llama.cpp ( #2584 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-17 00:18:44 +00:00
4897eb0ba2
ci: pack less libs inside the binary ( #2579 )
...
The binary grew up to 1.8GB quickly - rocm at least raises +800MB by
itself - so we might just want to manage the GPU libs separately.
Adds a comment to list all the libraries found so far that we are
depending on, but will likely follow up in a way to bundle these
separately.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-16 22:10:28 +02:00
