ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-18 20:27:57 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
1,927 Commits 43 Branches 108 Tags 45 MiB
7b1e792732
Commit Graph

1927 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ettore Di Giacinto
7b1e792732
deps(llama.cpp): bump to latest, update build variables (#2669) 
* arrow_up: Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* deps(llama.cpp): update build variables to follow upstream

Update build recipes with https://github.com/ggerganov/llama.cpp/pull/8006

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable shared libs by default in llama.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable shared libs in llama.cpp Makefile

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable metal embedding for now, until it is tested

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(mac): explicitly enable metal

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* debug

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix typo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-27 23:10:04 +02:00
Ettore Di Giacinto
30b883affe
models(gallery): add gemma2-9b-it and gemma2-27b-it (#2670) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-27 23:08:22 +02:00
Tachi Koma
20ec4d0342
telegram-bot example: Update LocalAI version (fixes #2638) (#2640) 
* Update LocalAI version for telegram-bot example (fixes #2638)

* Update examples/telegram-bot/docker-compose.yml

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-27 14:35:50 +02:00
Ettore Di Giacinto
a9f8460086
fix: typo in gallery model 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-27 08:54:13 +02:00
LocalAI [bot]
98b3b2b1ab
feat(swagger): update swagger (#2666) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-26 23:12:53 +00:00
Ettore Di Giacinto
e8bc0a789b
models(gallery): add arcee-spark (#2665) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-26 20:06:40 +02:00
Ettore Di Giacinto
2b6a2c7dde
models(gallery): add einstein v7 qwen2 (#2664) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-26 17:52:52 +02:00
Ettore Di Giacinto
c8c8238f9d
models(gallery): add dark-idol-1.2 (#2663) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-26 17:52:17 +02:00
Ettore Di Giacinto
3eaf59021c
feat(grammar): expose properties_order (#2662) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-26 14:59:02 +02:00
Ettore Di Giacinto
a8bfb6f9c2
feat(options): add repeat_last_n (#2660) 
feat(options): add repeat_last_n

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-26 14:58:50 +02:00
Ettore Di Giacinto
b783c811db
feat(build): only build llama.cpp relevant targets (#2659) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-26 14:58:38 +02:00
Ettore Di Giacinto
59af0e77af
feat(ui): allow to select between all the available models in the chat (#2657) 
feat(ui): let the chat to select from all the detected models

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-25 20:22:17 +02:00
Ettore Di Giacinto
5d83c8d3a2
Update quickstart.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-25 19:23:58 +02:00
Ettore Di Giacinto
8f968d0341
Update quickstart.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-25 19:18:43 +02:00
Ettore Di Giacinto
f93fe30350
ci: vulkan not ready for arm64 yet 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-25 18:11:57 +02:00
Ettore Di Giacinto
784ccf97ba
ci: adjust max-parallel 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-25 15:14:43 +02:00
LocalAI [bot]
a0163dafce
feat(swagger): update swagger (#2651) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-25 10:50:52 +02:00
Ettore Di Giacinto
f072cb3cd0
fix(cli): remove duplicate alias (#2654) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-25 10:08:13 +02:00
Ettore Di Giacinto
e84b31935c
feat(vulkan): add vulkan support to the llama.cpp backend (#2648) 
feat(vulkan): add vulkan support to llama.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 20:04:58 +02:00
Ettore Di Giacinto
03b1cf51fd
feat(whisper): add translate option (#2649) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 19:21:22 +02:00
Ettore Di Giacinto
9e6dec0bc4 fix(install.sh): not all systems have nproc 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 18:21:20 +02:00
Ettore Di Giacinto
04b01cd62c ci: put a cap on parallel runs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 18:08:09 +02:00
Ettore Di Giacinto
a181dd0ebc
refactor: gallery inconsistencies (#2647) 
* refactor(gallery): move under core/

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(unarchive): do not allow symlinks

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 17:32:12 +02:00
Ettore Di Giacinto
69206fcd4b
fix(install.sh): move ARCH detection so it works also for mac (#2646) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 10:34:35 +02:00
Ettore Di Giacinto
2c94e15746
fix(install.sh): fix version typo (#2645) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 10:30:17 +02:00
Dave
12513ebae0
rf: centralize base64 image handling (#2595) 
contains simple fixes to warnings and errors, removes a broken / outdated test, runs go mod tidy, and as the actual change, centralizes base64 image handling

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-06-24 08:34:36 +02:00
LocalAI [bot]
4156a4f15f
⬆️ Update ggerganov/llama.cpp (#2632) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-23 22:21:38 +00:00
Ettore Di Giacinto
491bb4f174
Update hermes-2-pro-mistral.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-23 15:17:41 +02:00
Sertaç Özercan
5866fc8ded
chore: fix go.mod module (#2635) 
Signed-off-by: Sertac Ozercan <sozercan@gmail.com>
 2024-06-23 08:24:36 +00:00
Ettore Di Giacinto
eb4cd78ca6 ci: run master jobs on self-hosted 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-23 10:15:53 +02:00
Ettore Di Giacinto
40ce71855a ci: disable max-parallelism on master 2024-06-22 23:28:09 +02:00
Ettore Di Giacinto
9c0d0afd09
ci: bump parallel jobs (#2633) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 23:24:46 +02:00
Ettore Di Giacinto
0f9aa1ef91 fix(install.sh): install CUDA toolkit only if CUDA is detected 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 12:21:59 +02:00
Ettore Di Giacinto
3ee5ceb9fa
Update kubernetes.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:16:55 +02:00
Ettore Di Giacinto
1bd72a3be5
Update kubernetes.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:16:27 +02:00
Ettore Di Giacinto
fbd14118bf
Update kubernetes.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:14:53 +02:00
Ettore Di Giacinto
515d98b978
Update model-gallery.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:10:49 +02:00
Ettore Di Giacinto
789cf6c599
Update model-gallery.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:10:27 +02:00
Ettore Di Giacinto
0bc82d7270 fix(install.sh): properly detect suse distros 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 12:08:48 +02:00
Ettore Di Giacinto
9a7ad75bff
docs: update to include installer and update advanced YAML options (#2631) 
* docs: update quickstart and advanced sections

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs: improvements

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* examples(kubernete): add nvidia example

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 12:00:38 +02:00
Ettore Di Giacinto
9fb3e4040b
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 10:29:46 +02:00
Ettore Di Giacinto
070fd1b9da
Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 10:06:09 +02:00
Ettore Di Giacinto
dda5b9f260
Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 10:05:48 +02:00
Ettore Di Giacinto
8d84dd4f88
fix(worker): use dynaload for single binaries (#2620) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 09:33:18 +02:00
Ettore Di Giacinto
f569237a50
feat(oci): support OCI images and Ollama models (#2628) 
* Support specifying oci:// and ollama:// for model URLs

Fixes: https://github.com/mudler/LocalAI/issues/2527
Fixes: https://github.com/mudler/LocalAI/issues/1028

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Lower watcher warnings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Allow to install ollama models from CLI

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixup tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Do not keep file ownership

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Skip test on darwin

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 08:17:41 +02:00
LocalAI [bot]
e265a618d9
models(gallery): ⬆️ update checksum (#2630) 
⬆️ Checksum updates in gallery/index.yaml

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-22 04:45:41 +00:00
LocalAI [bot]
533343c84f
⬆️ Update ggerganov/llama.cpp (#2629) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-22 02:28:06 +00:00
Ettore Di Giacinto
260f2e1d94
fix(install.sh): correctly handle systemd service installation (#2627) 
Fixup install.sh systemd service installation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-21 23:56:06 +02:00
Ettore Di Giacinto
964732590d
models(gallery): add hermes-2-theta-llama-3-70b (#2626) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-21 19:41:49 +02:00
LocalAI [bot]
70a2bfe82e
⬆️ Update ggerganov/llama.cpp (#2617) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-21 06:41:34 +00:00