a8bfb6f9c2
feat(options): add repeat_last_n ( #2660 )
...
feat(options): add repeat_last_n
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-26 14:58:50 +02:00
b783c811db
feat(build): only build llama.cpp relevant targets ( #2659 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-26 14:58:38 +02:00
59af0e77af
feat(ui): allow to select between all the available models in the chat ( #2657 )
...
feat(ui): let the chat to select from all the detected models
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-25 20:22:17 +02:00
5d83c8d3a2
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-25 19:23:58 +02:00
8f968d0341
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-25 19:18:43 +02:00
f93fe30350
ci: vulkan not ready for arm64 yet
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-25 18:11:57 +02:00
784ccf97ba
ci: adjust max-parallel
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-25 15:14:43 +02:00
a0163dafce
feat(swagger): update swagger ( #2651 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-25 10:50:52 +02:00
f072cb3cd0
fix(cli): remove duplicate alias ( #2654 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-25 10:08:13 +02:00
e84b31935c
feat(vulkan): add vulkan support to the llama.cpp backend ( #2648 )
...
feat(vulkan): add vulkan support to llama.cpp
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 20:04:58 +02:00
03b1cf51fd
feat(whisper): add translate option ( #2649 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 19:21:22 +02:00
9e6dec0bc4
fix(install.sh): not all systems have nproc
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 18:21:20 +02:00
04b01cd62c
ci: put a cap on parallel runs
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 18:08:09 +02:00
a181dd0ebc
refactor: gallery inconsistencies ( #2647 )
...
* refactor(gallery): move under core/
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(unarchive): do not allow symlinks
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 17:32:12 +02:00
69206fcd4b
fix(install.sh): move ARCH detection so it works also for mac ( #2646 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 10:34:35 +02:00
2c94e15746
fix(install.sh): fix version typo ( #2645 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-24 10:30:17 +02:00
12513ebae0
rf: centralize base64 image handling ( #2595 )
...
contains simple fixes to warnings and errors, removes a broken / outdated test, runs go mod tidy, and as the actual change, centralizes base64 image handling
Signed-off-by: Dave Lee <dave@gray101.com >
2024-06-24 08:34:36 +02:00
4156a4f15f
⬆️ Update ggerganov/llama.cpp ( #2632 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-23 22:21:38 +00:00
491bb4f174
Update hermes-2-pro-mistral.yaml
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-23 15:17:41 +02:00
5866fc8ded
chore: fix go.mod module ( #2635 )
...
Signed-off-by: Sertac Ozercan <sozercan@gmail.com >
2024-06-23 08:24:36 +00:00
eb4cd78ca6
ci: run master jobs on self-hosted
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-23 10:15:53 +02:00
40ce71855a
ci: disable max-parallelism on master
2024-06-22 23:28:09 +02:00
9c0d0afd09
ci: bump parallel jobs ( #2633 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 23:24:46 +02:00
0f9aa1ef91
fix(install.sh): install CUDA toolkit only if CUDA is detected
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:21:59 +02:00
3ee5ceb9fa
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:16:55 +02:00
1bd72a3be5
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:16:27 +02:00
fbd14118bf
Update kubernetes.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:14:53 +02:00
515d98b978
Update model-gallery.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:10:49 +02:00
789cf6c599
Update model-gallery.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 12:10:27 +02:00
0bc82d7270
fix(install.sh): properly detect suse distros
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:08:48 +02:00
9a7ad75bff
docs: update to include installer and update advanced YAML options ( #2631 )
...
* docs: update quickstart and advanced sections
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: improvements
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* examples(kubernete): add nvidia example
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 12:00:38 +02:00
9fb3e4040b
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:29:46 +02:00
070fd1b9da
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:06:09 +02:00
dda5b9f260
Update distributed_inferencing.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-22 10:05:48 +02:00
8d84dd4f88
fix(worker): use dynaload for single binaries ( #2620 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 09:33:18 +02:00
f569237a50
feat(oci): support OCI images and Ollama models ( #2628 )
...
* Support specifying oci:// and ollama:// for model URLs
Fixes: https://github.com/mudler/LocalAI/issues/2527
Fixes: https://github.com/mudler/LocalAI/issues/1028
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Lower watcher warnings
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Allow to install ollama models from CLI
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fixup tests
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Do not keep file ownership
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Skip test on darwin
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-22 08:17:41 +02:00
e265a618d9
models(gallery): ⬆️ update checksum ( #2630 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-22 04:45:41 +00:00
533343c84f
⬆️ Update ggerganov/llama.cpp ( #2629 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-22 02:28:06 +00:00
260f2e1d94
fix(install.sh): correctly handle systemd service installation ( #2627 )
...
Fixup install.sh systemd service installation
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-21 23:56:06 +02:00
964732590d
models(gallery): add hermes-2-theta-llama-3-70b ( #2626 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-21 19:41:49 +02:00
70a2bfe82e
⬆️ Update ggerganov/llama.cpp ( #2617 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-21 06:41:34 +00:00
ba2d969c44
models(gallery): add qwen2-1.5b-ita ( #2615 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:35:53 +02:00
d3c78cf4d7
models(gallery): add magnum-72b-v1 ( #2614 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:31:23 +02:00
34afd891a6
models(gallery): add llama3-8b-darkidol-1.1-iq-imatrix ( #2613 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:30:47 +02:00
d3137775a1
models(gallery): add llama-3-cursedstock-v1.8-8b-iq-imatrix ( #2612 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:14:48 +02:00
e1772026a1
models(gallery): add llama-3-sec-chat ( #2611 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-20 20:14:03 +02:00
d0423254dd
⬆️ Update ggerganov/llama.cpp ( #2606 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-20 00:58:40 +00:00
db0e52ae9d
⬆️ Update docs version mudler/LocalAI ( #2605 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-20 00:05:19 +00:00
4f030f9cd3
models(gallery): ⬆️ update checksum ( #2607 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-19 22:20:17 +02:00
60fb45eb97
models(gallery): add l3-umbral-mind-rp-v1.0-8b-iq-imatrix ( #2608 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-19 22:19:40 +02:00
