ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-01-29 23:54:03 +00:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity
3,246 Commits 47 Branches 109 Tags 91 MiB
Commit Graph

264 Commits

Author SHA1 Message Date
dependabot[bot]
ce035416aa
build(deps): bump docker/build-push-action from 5 to 6 (#2592) 
Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 5 to 6.
- [Release notes](https://github.com/docker/build-push-action/releases)
- [Commits](https://github.com/docker/build-push-action/compare/v5...v6)

---
updated-dependencies:
- dependency-name: docker/build-push-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-07-13 21:08:59 +00:00
Ettore Di Giacinto
4bc92d448c
ci: let the docs autobumper follow convcommits 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-13 22:53:56 +02:00
Ettore Di Giacinto
9c0df648a6
ci: let the bot follow up convcommits style 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-13 22:53:29 +02:00
dependabot[bot]
1ad84ec396
chore(deps): Bump dependabot/fetch-metadata from 2.1.0 to 2.2.0 (#2791) 
Bumps [dependabot/fetch-metadata](https://github.com/dependabot/fetch-metadata) from 2.1.0 to 2.2.0.
- [Release notes](https://github.com/dependabot/fetch-metadata/releases)
- [Commits](https://github.com/dependabot/fetch-metadata/compare/v2.1.0...v2.2.0)

---
updated-dependencies:
- dependency-name: dependabot/fetch-metadata
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-07-12 22:50:59 +00:00
Rene Leonhardt
fc87507012
chore(deps): Update Dependencies (#2538) 
* chore(deps): Update dependencies

Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>

* chore(deps): Upgrade github.com/imdario/mergo to dario.cat/mergo

Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>

* remove version identifiers for MeloTTS

Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>

---------

Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>
Signed-off-by: Dave <dave@gray101.com>
Co-authored-by: Dave <dave@gray101.com>
 2024-07-12 19:54:08 +00:00
Ettore Di Giacinto
68e15e71be
ci: drop description linting 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-12 18:23:13 +02:00
Ettore Di Giacinto
41bce28d5f
ci: add workflow to check PR style 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-12 10:01:27 +02:00
Ettore Di Giacinto
dcbdc12cc9
Update bump_deps.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-11 22:59:02 +02:00
Ettore Di Giacinto
03efa26ff5
ci: Do not test the full matrix on PRs (#2771) 
* ci: Do not test the full matrix on PR

Hipblas and sycl take long time to build from scratch as for now. Until
we find a way to speedup image building we are going to test these only
on master, and not for every open PR.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* ci: do not run release workflow twice

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-11 19:08:39 +02:00
Dave
fd0bc21c3e
fix abseil test issue [attempt 3] (#2769) 
* use a sed hack to jam a missing line in place for grpc's abseil version.

Signed-off-by: Dave Lee <dave@gray101.com>

---------

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-07-11 01:40:54 +00:00
Ettore Di Giacinto
28c6daf916
ci(deps): add libgmock-dev (#2761) 
* Revert "ci(grpc): disable ABSEIL tests (#2759)"

This reverts commit cbb93bd8ec54305648cfd944d49e09fd9c1a2501.

* Revert "fix: arm builds via disabling abseil tests (#2758)"

This reverts commit 8d046de287eaf85f8b80816175363fbbcacfd73a.

* Revert "ci(arm64): fix gRPC build by adding googletest to CMakefile (#2754)"

This reverts commit 401ee553f428c03a3a2650e2c8b34b23c1ca6854.

* ci(gmock): install libgmock-dev

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-10 15:23:23 +02:00
Ettore Di Giacinto
cbb93bd8ec
ci(grpc): disable ABSEIL tests (#2759) 
* ci(grpc): disable ABSEIL tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* debug

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-10 13:15:33 +02:00
Dave
8d046de287
fix: arm builds via disabling abseil tests (#2758) 
fix: disable abseil tests

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-07-10 08:43:27 +02:00
Ettore Di Giacinto
2845baecd5
fix(cuda): downgrade default version from 12.5 to 12.4 (#2707) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-09 23:13:29 +02:00
Ettore Di Giacinto
401ee553f4
ci(arm64): fix gRPC build by adding googletest to CMakefile (#2754) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-09 19:47:14 +02:00
Ettore Di Giacinto
c184f23621
models(gallery): add llama-3_8b_unaligned_alpha_rp_soup-i1 (#2734) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-06 15:31:00 +02:00
Ettore Di Giacinto
683c306f90
ci(Makefile): adds tts in binary releases (#2695) 
* ci(Makefile): run tts and stablediffusion in dist

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* re-add macos-13

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* rely on detection

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* move logic to a script

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* missing some libs still

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-05 23:19:24 +02:00
Ettore Di Giacinto
5c135d0dec ci: change action to send twitter notification 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 18:50:51 +02:00
Ettore Di Giacinto
ff19b22d72 ci: change action to send twitter notification 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 18:28:46 +02:00
Ettore Di Giacinto
83576d7f57 ci: change action to send twitter notification 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 18:04:56 +02:00
Ettore Di Giacinto
9aec1b3a61 ci: try to add twitter notifications for new models 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 17:51:00 +02:00
Ettore Di Giacinto
6f5b6711ea
ci(notify-models): Specify the bot identity 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-04 12:02:04 +02:00
Ettore Di Giacinto
a637ee2278 ci: use different channel for release notifications, enhance prompt 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 09:22:31 +02:00
Ettore Di Giacinto
b10441a41c
ci: add pipelines for discord notifications (#2703) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 09:15:29 +02:00
Ettore Di Giacinto
466eb82845
ci: add latest tag for vulkan images 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-28 09:04:33 +02:00
Ettore Di Giacinto
7b1e792732
deps(llama.cpp): bump to latest, update build variables (#2669) 
* arrow_up: Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* deps(llama.cpp): update build variables to follow upstream

Update build recipes with https://github.com/ggerganov/llama.cpp/pull/8006

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable shared libs by default in llama.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable shared libs in llama.cpp Makefile

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable metal embedding for now, until it is tested

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(mac): explicitly enable metal

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* debug

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix typo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-27 23:10:04 +02:00
Ettore Di Giacinto
f93fe30350
ci: vulkan not ready for arm64 yet 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-25 18:11:57 +02:00
Ettore Di Giacinto
784ccf97ba
ci: adjust max-parallel 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-25 15:14:43 +02:00
Ettore Di Giacinto
e84b31935c
feat(vulkan): add vulkan support to the llama.cpp backend (#2648) 
feat(vulkan): add vulkan support to llama.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 20:04:58 +02:00
Ettore Di Giacinto
04b01cd62c ci: put a cap on parallel runs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 18:08:09 +02:00
Ettore Di Giacinto
eb4cd78ca6 ci: run master jobs on self-hosted 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-23 10:15:53 +02:00
Ettore Di Giacinto
40ce71855a ci: disable max-parallelism on master 2024-06-22 23:28:09 +02:00
Ettore Di Giacinto
9c0d0afd09
ci: bump parallel jobs (#2633) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 23:24:46 +02:00
Rene Leonhardt
43f0688a95
feat: Upgrade to CUDA 12.5 (#2601) 
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>
 2024-06-19 17:50:49 +02:00
Ettore Di Giacinto
89a11e15e7
fix(single-binary): bundle ld.so (#2602) 
* debug

* fix copy command/silly muscle memory

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* remove tmate

* Debugging

* Start binary with ld.so if present in libdir

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* small refactor

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-18 22:43:43 +02:00
Ettore Di Giacinto
4897eb0ba2
ci: pack less libs inside the binary (#2579) 
The binary grew up to 1.8GB quickly - rocm at least raises +800MB by
itself - so we might just want to manage the GPU libs separately.

Adds a comment to list all the libraries found so far that we are
depending on, but will likely follow up in a way to bundle these
separately.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-16 22:10:28 +02:00
Ettore Di Giacinto
ac4a94dd44
feat(build): bundle libs for arm64 and x86 linux binaries (#2572) 
This PR bundles further libs into the arm64 and x86_64 binaries

This can be improved by a lot - it's far from perfect, however in this PR I wanted to collect the required libs, and give a simple baseline to improve later upon. It is quite challenging to do this exercise with CI only - but it's the fastest way I see now. 

I hope that after the list is initially built we can further improve this down the line and remove some of the technical debt left here to speedup things and do not get stuck in the middle of CI cycles.

In this PR:

- The x86_64 binary now bundles hipblas, nvidia and intel libraries too to avoid any dependency to be installed in the host
- Similarly, for the arm64 we now bundle all the required assets

## What's left

We should be also able to cross-compile Nvidia for arm64 - however I didn't succeed so far so I've left that open. Similarly I might have missed some libraries, but we will see with bug reports and testing around with the new binaries. I've tested on my arm64 board and I could finally start things up.

An open point still is shipping libraries for e.g. tts and stablediffusion. this is not done yet, however with the same methodology we should be able to extend support also for these two backends in the binary.
 2024-06-16 09:10:44 +02:00
Ettore Di Giacinto
112d0ffa45
feat(darwin): embed grpc libs (#2567) 
* debug

* feat(makefile): allow to bundle libs into binary

* ci: bundle protobuf into single-binary

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* ci: tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(assets): correctly reference extract folder

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* bundle also abseil

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* bundle more libs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-14 08:51:25 +02:00
Ettore Di Giacinto
6c087ae743
feat(arm64): enable single-binary builds (#2490) 
* ci: try to build for arm64

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Allow to skip hipblas on make dist

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* use arm64 cross compiler

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* correctly target go arm64

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* create a separate target

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* cross-compile grpc

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add Protobuf include dirs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* temp disable CUDA build

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* aarch64 builds: Reduce backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Even less backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Even less backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(startup): allow to load libs from extracted assets

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* makefile: set arch

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-09 15:11:37 +02:00
Dave
219078a5e0
test: e2e /reranker endpoint (#2211) 
Create a simple e2e test for the /reranker api \\ go mod tidy

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-06-07 18:45:52 +00:00
Dave
d38e9090df
experiment: -j4 for build-linux: (#2514) 
experiment: set -j4 to see if things go faster, while we wait for a proper fix from mudler

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-06-07 11:22:28 +02:00
Ettore Di Giacinto
b049805c9b
ci: run release build on self-hosted runners (#2505) 2024-06-06 22:16:34 -04:00
Ettore Di Giacinto
596cf76135
build(intel): bundle intel variants in single-binary (#2494) 
* wip: try to build also intel variants

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add dependencies

* Select automatically intel backend

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-06 08:40:51 +02:00
Ettore Di Giacinto
17cf6c4a4d
feat(amdgpu): try to build in single binary (#2485) 
* feat(amdgpu): try to build in single binary

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Release space from worker

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-05 08:44:15 +02:00
Ettore Di Giacinto
c603b95ac7
ci: pin build-time protoc (#2461) 
ci: pin protoc

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-01 18:59:15 +02:00
Ettore Di Giacinto
10c64dbb55
models(gallery): add mopeymule (#2449) 
* models(gallery): add mopeymule

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* ci: try to fix workflow

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-31 18:08:39 +02:00
Ettore Di Giacinto
2bbc52fcc8
feat(build): add arm64 core containers (#2421) 
ci: add arm64 container images

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-28 10:34:59 +02:00
Ettore Di Giacinto
d075dc44dd
ci: push test images when building PRs (#2424) 
ci: try to push image

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-27 22:07:35 +02:00
Ettore Di Giacinto
be8ffbdfcf
ci(grpc-cache): also arm64 (#2423) 
grpc-cache: also arm64

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-27 17:23:34 +02:00
Sertaç Özercan
29615576fb
ci: fix sd release (#2400) 
Signed-off-by: Sertac Ozercan <sozercan@gmail.com>
 2024-05-25 09:33:50 +02:00