4022 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ettore Di Giacinto	4d44ebc2f2	chore(deps): bump grpcio to 1.70.0 (#4682) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-24 10:18:22 +01:00
Gianluca Boiano	9a1182fa01	chore(model gallery): add flux.1, stablediffusion and whisper icons (#4680) ... Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-24 08:29:02 +01:00
Gianluca Boiano	66e9ef3f33	chore(model gallery): add DeepSeek R1 14b, 32b and 70b (#4679) ... Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-24 08:28:44 +01:00
Ettore Di Giacinto	8282414583	chore(downloader): support hf.co and hf:// URIs (#4677) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-24 08:27:22 +01:00
Gianluca Boiano	d1d7ce83d4	chore(model gallery): add MiniCPM-o-2.6-7.6b (#4676) ... Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-24 08:27:02 +01:00
Ettore Di Giacinto	5177837ab0	chore: detect and enable avx512 builds (#4675) ... chore(avx512): add support Fixes https://github.com/mudler/LocalAI/issues/4662 Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-24 08:26:44 +01:00
Ettore Di Giacinto	f9e368b7c4	chore(refactor): group cpu cap detection (#4674) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-23 16:35:44 +01:00
Ettore Di Giacinto	eef80b9880	chore(ci): cleanup tests ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-23 10:02:57 +01:00
Ettore Di Giacinto	073eaec729	chore(openvoice): drop backend (#4673) ... The project (MeloTTS) has been quite since long, newer backends are much performant and better quality overall. Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-23 10:00:36 +01:00
Ettore Di Giacinto	318225f631	chore(parler-tts): drop backend (#4672) ... We support at this point more extensive backends that are SOTA and support also voice cloning, and many other features. This backend is superseded and also poses significant maintenance burden as there is an open issue https://github.com/mudler/LocalAI/issues/3941 which is still open as it deps are pinning old versions of grpc. Closes https://github.com/mudler/LocalAI/issues/3941 Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-23 09:46:16 +01:00
Ettore Di Giacinto	89429a439b	feat(transformers): add support to Mamba (#4669) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-23 09:30:47 +01:00
LocalAI [bot]	200fe358f0	chore: ⬆️ Update ggerganov/llama.cpp to 6152129d05870cb38162c422c6ba80434e021e9f (#4668) ... ⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-23 08:06:43 +01:00
Ettore Di Giacinto	e426ab7c23	feat(faster-whisper): add backend (#4666) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-23 08:06:18 +01:00
LocalAI [bot]	715071b68d	feat(swagger): update swagger (#4667) ... Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-22 21:51:38 +01:00
Peter Cover	a05737c7e4	chore: fix some function names in comment (#4665) ... Signed-off-by: petercover <raowanxiang@outlook.com>	2025-01-22 19:35:53 +01:00
Richard Palethorpe	e8eb0b2c50	fix(stores): Stores fixes and testing (#4663) ... * fix(stores): Actually check a vector is a unit vector/normalized Instead of just summing the components to see if they equal 1.0, take the actual magnitude/p-norm of the vector and check that is approximately 1.0. Note that this shouldn't change the order of results except in edge cases if I am too lax with the precision of the equality comparison. However it should improve performance for normalized vectors which were being misclassified. Signed-off-by: Richard Palethorpe <io@richiejp.com> * fix(stores): Add tests for known results and triangle inequality This adds some more tests to check the cosine similarity function has some expected mathematical properties. Signed-off-by: Richard Palethorpe <io@richiejp.com> --------- Signed-off-by: Richard Palethorpe <io@richiejp.com>	2025-01-22 19:35:05 +01:00
Ettore Di Giacinto	e15d29aba2	chore(stablediffusion-ncn): drop in favor of ggml implementation (#4652) ... * chore(stablediffusion-ncn): drop in favor of ggml implementation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(ci): drop stablediffusion build Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(tests): add Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(tests): try to fixup current tests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Try to fix tests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Tests improvements Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(tests): use quality to specify step Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(tests): switch to sd-1.5 also increase prep time for downloading models Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-22 19:34:16 +01:00
Ettore Di Giacinto	10675ac28e	Update README.md ... Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>	2025-01-22 18:07:30 +01:00
Ettore Di Giacinto	0ec25b8b07	chore(model gallery): add sd-1.5-ggml and sd-3.5-medium-ggml (#4664) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-22 16:37:20 +01:00
LocalAI [bot]	e81ceff681	chore: ⬆️ Update ggerganov/llama.cpp to 6171c9d25820ccf676b243c172868819d882848f (#4661) ... ⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-21 22:04:29 +00:00
Ettore Di Giacinto	6831719e1e	chore(model gallery): add deepseek-r1-distill-qwen-7b (#4660) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-21 15:09:36 +01:00
Gianluca Boiano	b264a91b3f	chore(model gallery): add Deepseek-R1-Distill models (#4646) ... * chore(model gallery): add Deepseek-R1-Distill-Llama-8b Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): add Deepseek-R1-Distill-Qwen-1.5b Signed-off-by: Gianluca Boiano <morf3089@gmail.com> --------- Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-21 10:37:05 +01:00
LocalAI [bot]	1a08948e63	chore: ⬆️ Update ggerganov/llama.cpp to aea8ddd5165d525a449e2fc3839db77a71f4a318 (#4657) ... ⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-21 08:37:13 +01:00
dependabot[bot]	14a1e02f44	chore(deps): Bump docs/themes/hugo-theme-relearn from 80e448e to 8dad5ee (#4656) ... chore(deps): Bump docs/themes/hugo-theme-relearn Bumps [docs/themes/hugo-theme-relearn](https://github.com/McShelby/hugo-theme-relearn) from `80e448e` to `8dad5ee`. - [Release notes](https://github.com/McShelby/hugo-theme-relearn/releases) - [Commits](80e448e5bd...8dad5ee419) --- updated-dependencies: - dependency-name: docs/themes/hugo-theme-relearn dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-01-20 23:33:40 +00:00
Ettore Di Giacinto	2f09aa1b85	chore(model gallery): add sd-3.5-large-ggml (#4647) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-20 19:04:23 +01:00
Gianluca Boiano	a396040886	chore(model gallery): remove dead icons and update LLAVA and DeepSeek ones (#4645) ... * chore(model gallery): update icons and add LLAVA ones Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): fix all complains related to yamllint Signed-off-by: Gianluca Boiano <morf3089@gmail.com> --------- Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-20 16:13:19 +01:00
Ettore Di Giacinto	aeb1dca52e	chore(model gallery): add l3.3-prikol-70b-v0.2 (#4643) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-20 11:03:35 +01:00
Ettore Di Giacinto	83a8d90c52	chore(model gallery): add l3.3-70b-magnum-v4-se (#4642) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-20 10:50:29 +01:00
Ettore Di Giacinto	adebd557ce	chore(model gallery): add wayfarer-12b (#4641) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-20 10:45:10 +01:00
Gianluca Boiano	0c0e015b38	chore(model gallery): update icons and add missing ones (#4639) ... * chore(model gallery): uniform github URLs for icons Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): add icons to phi models Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): add icons to QwenLM models Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): update icon for Arcee org Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): update icon for Meta org Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): update icon url for OpenCoder org Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): add icon for RWKV org Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): add icon for IBM-granite org Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): add icon for OpenBMB org Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): add icon for KatanemoLabs org Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): update icon for Meta-Llama-3.1-8B-Instruct-abliterated Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): update icon for hermes-3-llama-3.1-8b-lorablated Signed-off-by: Gianluca Boiano <morf3089@gmail.com> * chore(model gallery): add icon for Google org Signed-off-by: Gianluca Boiano <morf3089@gmail.com> --------- Signed-off-by: Gianluca Boiano <morf3089@gmail.com> Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>	2025-01-20 10:40:46 +01:00
Gianluca Boiano	390bb3f58b	fix(model gallery): minicpm-v-2.6 is based on qwen2 (#4638) ... Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-20 10:35:05 +01:00
Gianluca Boiano	30739d94a4	chore(model gallery): add InternLM3-8b-Q4_K_M (#4637) ... chore(model gallery): add InternLM3-8b-Q4_K_M Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-20 10:34:19 +01:00
LocalAI [bot]	83e2dd5dff	chore: ⬆️ Update ggerganov/llama.cpp to 92bc493917d43b83e592349e138b54c90b1c3ea7 (#4640) ... ⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-19 22:34:32 +00:00
Ettore Di Giacinto	f496d0113b	chore(deps): pin numba ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-19 09:07:56 +01:00
LocalAI [bot]	a752183fb5	chore: ⬆️ Update ggerganov/llama.cpp to a1649cc13f89946322358f92ea268ae1b7b5096c (#4635) ... ⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-19 08:38:33 +01:00
LocalAI [bot]	296b97925f	chore: ⬆️ Update leejet/stable-diffusion.cpp to 5eb15ef4d022bef4a391de4f5f6556e81fbb5024 (#4636) ... ⬆️ Update leejet/stable-diffusion.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-18 22:21:27 +00:00
Gianluca Boiano	d0cc3047dc	chore(model gallery): add MiniCPM-V-2.6-8b-q4_K_M (#4633) ... Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-18 18:36:05 +01:00
Gianluca Boiano	032a33de49	chore: remove deprecated tinydream backend (#4631) ... Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-18 18:35:30 +01:00
Ettore Di Giacinto	1e9bf19c8d	feat(transformers): merge sentencetransformers backend (#4624) ... * merge sentencetransformers Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Add alias to silently redirect sentencetransformers to transformers Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Add alias also for transformers-musicgen Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Drop from makefile Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Move tests from sentencetransformers Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Remove sentencetransformers Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Remove tests from CI (part of transformers) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Do not always try to load the tokenizer Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Adapt tests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Fix typo Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Tiny adjustments Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-18 18:30:30 +01:00
Gianluca Boiano	4bd8434ae0	fix(docs): add missing -core suffix to sycl images (#4630) ... Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-01-18 15:47:49 +01:00
Ettore Di Giacinto	958f6eb722	chore(llama.cpp): update dependency (#4628) ... Update to '3edfa7d3753c29e44b964c0ff424d2ea8d5fdee6' and adapt to upstream changes Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-18 11:55:13 +01:00
mintyleaf	96306a39a0	chore(docs): extra-Usage and Machine-Tag docs (#4627) ... Rename LocalAI-Extra-Usage -> Extra-Usage, add MACHINE_TAG as cli flag option, add docs about extra-usage and machine-tag Signed-off-by: mintyleaf <mintyleafdev@gmail.com>	2025-01-18 08:58:38 +01:00
LocalAI [bot]	895cd7c76a	feat(swagger): update swagger (#4625) ... Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-18 08:57:49 +01:00
dependabot[bot]	cbdbe59f16	chore(deps): Bump scipy from 1.14.0 to 1.15.1 in /backend/python/transformers (#4621) ... chore(deps): Bump scipy in /backend/python/transformers Bumps [scipy](https://github.com/scipy/scipy) from 1.14.0 to 1.15.1. - [Release notes](https://github.com/scipy/scipy/releases) - [Commits](https://github.com/scipy/scipy/compare/v1.14.0...v1.15.1) --- updated-dependencies: - dependency-name: scipy dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-01-17 22:14:11 +00:00
Ettore Di Giacinto	ee7904f170	feat(transformers): add support to OuteTTS (#4622) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-17 19:33:25 +01:00
Ettore Di Giacinto	a761e01944	chore: alias transformers-musicgen to transformers (#4623) ... chore: alias transformers-muscigen to transformers Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-17 18:16:17 +01:00
mintyleaf	96f8ec0402	feat: add machine tag and inference timings (#4577) ... * Add machine tag option, add extraUsage option, grpc-server -> proto -> endpoint extraUsage data is broken for now Signed-off-by: mintyleaf <mintyleafdev@gmail.com> * remove redurant timing fields, fix not working timings output Signed-off-by: mintyleaf <mintyleafdev@gmail.com> * use middleware for Machine-Tag only if tag is specified Signed-off-by: mintyleaf <mintyleafdev@gmail.com> --------- Signed-off-by: mintyleaf <mintyleafdev@gmail.com>	2025-01-17 17:05:58 +01:00
Ettore Di Giacinto	8027fdf1c7	feat(transformers): merge musicgen functionalities to a single backend (#4620) ... * feat(transformers): merge musicgen functionalities to a single backend So we optimize space Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * specify type in tests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Some adaptations for the MusicgenForConditionalGeneration type Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-17 17:01:16 +01:00
Ettore Di Giacinto	212c8e1a6d	Update README.md ... Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>	2025-01-17 15:11:10 +01:00
LocalAI [bot]	78533d7230	chore: ⬆️ Update ggerganov/llama.cpp to 4dbc8b9cb71876e005724f4e8f73a3544646bcf5 (#4618) ... ⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-01-17 10:25:04 +01:00