58662db48e
models(gallery): add calme-2.2-qwen2.5-72b-i1 ( #3691 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-30 17:11:54 +02:00
078942fc9f
chore(deps): bump grpcio to 1.66.2 ( #3690 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-30 09:09:51 +02:00
6dfee99575
chore: ⬆️ Update ggerganov/llama.cpp to c919d5db39c8a7fcb64737f008e4b105ee0acd20 ( #3686 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-30 09:09:18 +02:00
ad62156d54
models(gallery): add replete-llm-v2.5-qwen-7b ( #3689 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-29 22:47:26 +02:00
1689740269
models(gallery): add replete-llm-v2.5-qwen-14b ( #3688 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-29 20:39:39 +02:00
50a3b54e34
feat(api): add correlationID to Track Chat requests ( #3668 )
...
* Add CorrelationID to chat request
Signed-off-by: Siddharth More <siddimore@gmail.com >
* remove get_token_metrics
Signed-off-by: Siddharth More <siddimore@gmail.com >
* Add CorrelationID to proto
Signed-off-by: Siddharth More <siddimore@gmail.com >
* fix correlation method name
Signed-off-by: Siddharth More <siddimore@gmail.com >
* Update core/http/endpoints/openai/chat.go
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Signed-off-by: Siddharth More <siddimore@gmail.com >
* Update core/http/endpoints/openai/chat.go
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Signed-off-by: Siddharth More <siddimore@gmail.com >
---------
Signed-off-by: Siddharth More <siddimore@gmail.com >
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-28 17:23:56 +02:00
e94a50e9db
chore: ⬆️ Update ggerganov/whisper.cpp to 8feb375fbdf0277ad36958c218c6bf48fa0ba75a ( #3680 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-28 08:02:19 +00:00
4e0f3cc980
chore: ⬆️ Update ggerganov/llama.cpp to b5de3b74a595cbfefab7eeb5a567425c6a9690cf ( #3681 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-27 22:42:59 +00:00
2a8cbad122
models(gallery): add bigqwen2.5-52b-instruct ( #3679 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-27 13:03:41 +02:00
453c45d022
models(gallery): add magnusintellectus-12b-v1-i1 ( #3678 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-27 12:21:04 +02:00
4550abbfce
chore(model-gallery): ⬆️ update checksum ( #3675 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-27 08:54:36 +02:00
f2ba1cfb01
chore: ⬆️ Update ggerganov/llama.cpp to 95bc82fbc0df6d48cf66c857a4dda3d044f45ca2 ( #3674 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-26 21:41:45 +00:00
8c4196faf3
chore: ⬆️ Update ggerganov/whisper.cpp to 69339af2d104802f3f201fd419163defba52890e ( #3666 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-26 15:58:17 +02:00
b0f4556c0f
chore: ⬆️ Update ggerganov/llama.cpp to ea9c32be71b91b42ecc538bd902e93cbb5fb36cb ( #3667 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-26 12:52:26 +00:00
fa5c98549a
chore(refactor): track grpcProcess in the model structure ( #3663 )
...
* chore(refactor): track grpcProcess in the model structure
This avoids to have to handle in two parts the data relative to the same
model. It makes it easier to track and use mutex with.
This also fixes races conditions while accessing to the model.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* chore(tests): run protogen-go before starting aio tests
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* chore(tests): install protoc in aio tests
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-26 12:44:55 +02:00
3d12d2037c
models(gallery): add llama-3.2 3B and 1B ( #3671 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-26 11:19:26 +02:00
d6522e69ca
feat(swagger): update swagger ( #3664 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-26 10:57:40 +02:00
ef1507d000
docs: ⬆️ update docs version mudler/LocalAI ( #3665 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-26 10:50:20 +02:00
a3d69872e3
feat(api): list loaded models in /system ( #3661 )
...
feat(api): list loaded models in /system
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-25 18:00:23 +02:00
33b2d38dd0
chore(deps): Bump chromadb from 0.5.5 to 0.5.7 in /examples/langchain-chroma ( #3640 )
...
chore(deps): Bump chromadb in /examples/langchain-chroma
Bumps [chromadb](https://github.com/chroma-core/chroma ) from 0.5.5 to 0.5.7.
- [Release notes](https://github.com/chroma-core/chroma/releases )
- [Changelog](https://github.com/chroma-core/chroma/blob/main/RELEASE_PROCESS.md )
- [Commits](https://github.com/chroma-core/chroma/compare/0.5.5...0.5.7 )
---
updated-dependencies:
- dependency-name: chromadb
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-25 12:44:32 +02:00
74408bdc77
chore: ⬆️ Update ggerganov/whisper.cpp to 0d2e2aed80109e8696791083bde3b58e190b7812 ( #3658 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
Co-authored-by: Dave <dave@gray101.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-25 08:54:37 +00:00
8c4f720fb5
chore(deps): Bump llama-index from 0.11.9 to 0.11.12 in /examples/chainlit ( #3642 )
...
chore(deps): Bump llama-index in /examples/chainlit
Bumps [llama-index](https://github.com/run-llama/llama_index ) from 0.11.9 to 0.11.12.
- [Release notes](https://github.com/run-llama/llama_index/releases )
- [Changelog](https://github.com/run-llama/llama_index/blob/main/CHANGELOG.md )
- [Commits](https://github.com/run-llama/llama_index/compare/v0.11.9...v0.11.12 )
---
updated-dependencies:
- dependency-name: llama-index
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-25 08:48:13 +02:00
8002ad27cb
chore(deps): Bump openai from 1.45.1 to 1.47.1 in /examples/langchain-chroma ( #3641 )
...
chore(deps): Bump openai in /examples/langchain-chroma
Bumps [openai](https://github.com/openai/openai-python ) from 1.45.1 to 1.47.1.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.45.1...v1.47.1 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-25 08:47:57 +02:00
1b8a77433a
chore(deps): Bump llama-index from 0.11.7 to 0.11.12 in /examples/langchain-chroma ( #3639 )
...
chore(deps): Bump llama-index in /examples/langchain-chroma
Bumps [llama-index](https://github.com/run-llama/llama_index ) from 0.11.7 to 0.11.12.
- [Release notes](https://github.com/run-llama/llama_index/releases )
- [Changelog](https://github.com/run-llama/llama_index/blob/main/CHANGELOG.md )
- [Commits](https://github.com/run-llama/llama_index/compare/v0.11.7...v0.11.12 )
---
updated-dependencies:
- dependency-name: llama-index
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-25 08:47:33 +02:00
a370a11115
docs: ⬆️ update docs version mudler/LocalAI ( #3657 )
...
⬆️ Update docs version mudler/LocalAI
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-25 08:47:03 +02:00
aa87eff283
chore: ⬆️ Update ggerganov/llama.cpp to 70392f1f81470607ba3afef04aa56c9f65587664 ( #3659 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
Co-authored-by: Dave <dave@gray101.com >
2024-09-25 04:51:20 +00:00
0d784f46e5
chore(deps): Bump openai from 1.45.1 to 1.47.1 in /examples/functions ( #3645 )
...
Bumps [openai](https://github.com/openai/openai-python ) from 1.45.1 to 1.47.1.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.45.1...v1.47.1 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-25 01:15:53 +00:00
c54cfd3609
chore(deps): Bump pydantic from 2.8.2 to 2.9.2 in /examples/langchain/langchainpy-localai-example ( #3648 )
...
chore(deps): Bump pydantic
Bumps [pydantic](https://github.com/pydantic/pydantic ) from 2.8.2 to 2.9.2.
- [Release notes](https://github.com/pydantic/pydantic/releases )
- [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md )
- [Commits](https://github.com/pydantic/pydantic/compare/v2.8.2...v2.9.2 )
---
updated-dependencies:
- dependency-name: pydantic
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-24 22:59:11 +00:00
6555994060
chore(deps): Bump sentence-transformers from 3.1.0 to 3.1.1 in /backend/python/sentencetransformers ( #3651 )
...
chore(deps): Bump sentence-transformers
Bumps [sentence-transformers](https://github.com/UKPLab/sentence-transformers ) from 3.1.0 to 3.1.1.
- [Release notes](https://github.com/UKPLab/sentence-transformers/releases )
- [Commits](https://github.com/UKPLab/sentence-transformers/compare/v3.1.0...v3.1.1 )
---
updated-dependencies:
- dependency-name: sentence-transformers
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-24 21:22:08 +00:00
0893d3cbbe
fix(health): do not require auth for /healthz and /readyz ( #3656 )
...
* fix(health): do not require auth for /healthz and /readyz
Fixes : #3655
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Comment so I don’t forget
Adding a reminder here...
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: Dave <dave@gray101.com >
2024-09-24 18:25:59 +00:00
90cacb9692
test: preliminary tests and merge fix for authv2 ( #3584 )
...
* add api key to existing app tests, add preliminary auth test
Signed-off-by: Dave Lee <dave@gray101.com >
* small fix, run test
Signed-off-by: Dave Lee <dave@gray101.com >
* status on non-opaque
Signed-off-by: Dave Lee <dave@gray101.com >
* tweak auth error
Signed-off-by: Dave Lee <dave@gray101.com >
* exp
Signed-off-by: Dave Lee <dave@gray101.com >
* quick fix on real laptop
Signed-off-by: Dave Lee <dave@gray101.com >
* add downloader version that allows providing an auth header
Signed-off-by: Dave Lee <dave@gray101.com >
* stash some devcontainer fixes during testing
Signed-off-by: Dave Lee <dave@gray101.com >
* s2
Signed-off-by: Dave Lee <dave@gray101.com >
* s
Signed-off-by: Dave Lee <dave@gray101.com >
* done with experiment
Signed-off-by: Dave Lee <dave@gray101.com >
* done with experiment
Signed-off-by: Dave Lee <dave@gray101.com >
* after merge fix
Signed-off-by: Dave Lee <dave@gray101.com >
* rename and fix
Signed-off-by: Dave Lee <dave@gray101.com >
---------
Signed-off-by: Dave Lee <dave@gray101.com >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-24 09:32:48 +02:00
69d2902b0a
chore: ⬆️ Update ggerganov/llama.cpp to f0c7b5edf82aa200656fd88c11ae3a805d7130bf ( #3653 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-24 09:31:28 +02:00
c1752cbb83
chore(deps): Bump sqlalchemy from 2.0.32 to 2.0.35 in /examples/langchain/langchainpy-localai-example ( #3649 )
...
chore(deps): Bump sqlalchemy
Bumps [sqlalchemy](https://github.com/sqlalchemy/sqlalchemy ) from 2.0.32 to 2.0.35.
- [Release notes](https://github.com/sqlalchemy/sqlalchemy/releases )
- [Changelog](https://github.com/sqlalchemy/sqlalchemy/blob/main/CHANGES.rst )
- [Commits](https://github.com/sqlalchemy/sqlalchemy/commits )
---
updated-dependencies:
- dependency-name: sqlalchemy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-24 04:30:05 +00:00
b8e129f2a6
chore(deps): Bump idna from 3.8 to 3.10 in /examples/langchain/langchainpy-localai-example ( #3644 )
...
chore(deps): Bump idna
Bumps [idna](https://github.com/kjd/idna ) from 3.8 to 3.10.
- [Release notes](https://github.com/kjd/idna/releases )
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst )
- [Commits](https://github.com/kjd/idna/compare/v3.8...v3.10 )
---
updated-dependencies:
- dependency-name: idna
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-24 02:53:35 +00:00
cc6fac1688
chore(deps): Bump urllib3 from 2.2.2 to 2.2.3 in /examples/langchain/langchainpy-localai-example ( #3646 )
...
chore(deps): Bump urllib3
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.2.2 to 2.2.3.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.2.2...2.2.3 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-24 01:16:39 +00:00
043cb94436
chore(deps): Bump yarl from 1.11.0 to 1.11.1 in /examples/langchain/langchainpy-localai-example ( #3643 )
...
chore(deps): Bump yarl
Bumps [yarl](https://github.com/aio-libs/yarl ) from 1.11.0 to 1.11.1.
- [Release notes](https://github.com/aio-libs/yarl/releases )
- [Changelog](https://github.com/aio-libs/yarl/blob/master/CHANGES.rst )
- [Commits](https://github.com/aio-libs/yarl/compare/v1.11.0...v1.11.1 )
---
updated-dependencies:
- dependency-name: yarl
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 21:23:21 +00:00
bbdf78615e
models(gallery): add acolyte-22b-i1 ( #3636 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-23 19:24:14 +02:00
e332ff8066
models(gallery): add gemma-2-2b-arliai-rpmax-v1.1 ( #3635 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-23 19:16:41 +02:00
26d99ed1c7
models(gallery): add gemma-2-9b-arliai-rpmax-v1.1 ( #3634 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-23 19:12:54 +02:00
1da8d8b9db
models(gallery): add nightygurps-14b-v1.1 ( #3633 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-23 19:09:51 +02:00
bf8f8671d1
chore(ci): adjust parallelism
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-23 19:04:36 +02:00
51cba89682
fix(hipblas): do not push all variants to hipblas builds ( #3630 )
...
Like with CUDA builds, we don't need all the variants when we are
compiling against the accelerated variants - in this way we save space
and we avoid to exceed embedFS golang size limits.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-23 11:49:07 +02:00
3e8e71f8b6
fix(ci): fixup checksum scanning pipeline ( #3631 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-23 10:56:10 +02:00
4edd8c80b4
chore: ⬆️ Update ggerganov/llama.cpp to c35e586ea57221844442c65a1172498c54971cb0 ( #3629 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-22 21:41:34 +00:00
fd70a22196
chore(ci): adjust parallel jobs
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-22 15:21:16 +02:00
56f4deb938
chore(ci): split hipblas jobs
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-22 15:19:38 +02:00
9bd7f3f995
feat(coqui): switch to maintained community fork ( #3625 )
...
Fixes: https://github.com/mudler/LocalAI/issues/2513
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-09-22 10:04:20 +02:00
ee21b00a8d
feat: auto load into memory on startup ( #3627 )
...
Signed-off-by: Sertac Ozercan <sozercan@gmail.com >
2024-09-22 10:03:30 +02:00
1f43678d53
chore: ⬆️ Update ggerganov/llama.cpp to d09770cae71b416c032ec143dda530f7413c4038 ( #3626 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-09-21 22:03:23 +00:00
20c0e128c0
fix(sycl): downgrade pypinyin
...
melotts requires pypinyin 0.50
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-09-21 21:52:12 +02:00
