62a02cd1fe
deps(conda): use transformers environment with autogptq ( #1555 )
2024-01-06 15:30:53 +01:00
949da7792d
deps(conda): use transformers-env with vllm,exllama(2) ( #1554 )
...
* deps(conda): use transformers with vllm
* join vllm, exllama, exllama2, split petals
2024-01-06 13:32:28 +01:00
ce724a7e55
docs: improve getting started ( #1553 )
...
* docs: improve getting started
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* cleanups
* Use dockerhub links
* Shrink command to minimum
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-01-06 01:04:14 +01:00
0a06c80801
⬆️ Update ggerganov/llama.cpp ( #1547 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2024-01-05 23:27:51 +01:00
edc55ade61
⬆️ Update docs version mudler/LocalAI ( #1546 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2024-01-05 23:27:30 +01:00
09e5d9007b
feat: embedded model configurations, add popular model examples, refactoring ( #1532 )
...
* move downloader out
* separate startup functions for preloading configuration files
* docs: add popular model examples
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* shorteners
* Add llava
* Add mistral-openorca
* Better link to build section
* docs: update
* fixup
* Drop code dups
* Minor fixups
* Apply suggestions from code review
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* ci: try to cache gRPC build during tests
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* ci: do not build all images for tests, just necessary
* ci: cache gRPC also in release pipeline
* fixes
* Update model_preload_test.go
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-01-05 23:16:33 +01:00
db926896bd
Revert "[Refactor]: Core/API Split" ( #1550 )
...
Revert "[Refactor]: Core/API Split (#1506 )"
This reverts commit ab7b4d5ee9
2024-01-05 18:04:46 +01:00
ab7b4d5ee9
[Refactor]: Core/API Split ( #1506 )
...
Refactors api folder to core, creates firm split between backend code and api frontend.
2024-01-05 15:34:56 +01:00
bcf02449b3
ci(dockerhub): push images also to dockerhub ( #1542 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-01-04 08:32:29 +01:00
d48faf35ab
⬆️ Update ggerganov/llama.cpp ( #1544 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2024-01-04 00:08:03 +01:00
583bd28a5c
fix(diffusers): add omegaconf dependency ( #1540 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-01-04 00:06:41 +01:00
7e1d8c489b
⬆️ Update ggerganov/llama.cpp ( #1533 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2024-01-03 08:43:35 +01:00
de28867374
⬆️ Update ggerganov/llama.cpp ( #1531 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2024-01-02 00:28:22 +00:00
a1aa6cb7c2
fix(entrypoint): cd to backend dir before start ( #1530 )
...
Certain backends as vall-e-x are not meant to be used as a library, so
we want to start the process in the same folder where the backend and
all the assets are fixes #1394
2024-01-01 22:02:48 +01:00
85e2767dca
feat: add trimsuffix ( #1528 )
2024-01-01 14:39:42 +01:00
fd48cb6506
deps(llama.cpp): update and sync grpc server ( #1527 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-01-01 14:39:31 +01:00
522659eb59
feat(prepare): allow to specify additional files to download ( #1526 )
2024-01-01 14:39:13 +01:00
f068efe509
docs(phi-2): add example ( #1525 )
2024-01-01 10:51:47 +01:00
726fe416bb
docs: update hot topics
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-01-01 10:41:39 +01:00
66fa4f1767
feat: share models by url ( #1522 )
...
* feat: allow to pass by models via args
* expose it also as an env/arg
* docs: enhancements to build/requirements
* do not display status always
* print download status
* not all mesages are debug
2024-01-01 10:31:03 +01:00
d6565f3b99
Update _index.en.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-31 10:58:22 +01:00
27686ff20b
⬆️ Update ggerganov/llama.cpp ( #1518 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-31 00:19:08 +00:00
a8b865022f
⬆️ Update docs version mudler/LocalAI ( #1517 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-30 23:50:24 +00:00
c1888a8062
feat(preload): prepare models in galleries ( #1515 )
...
Previously if applying models from the gallery API, we didn't actually
allowed remote URLs as models as nothing was actually downloading the
models referenced in the configuration file. Now we call Preload after
we have all the models loaded in memory.
2023-12-30 18:55:18 +01:00
a95bb0521d
fix(download): correctly check for not found error ( #1514 )
2023-12-30 15:36:46 +01:00
e2311a145c
Fix: Set proper Homebrew install location for x86 Macs ( #1510 )
...
* set proper Homebrew install location for x86 Macs
* fix: remove prior conditional that my logic replaces
2023-12-30 12:37:26 +01:00
d4e0bab6be
Update version.json (2.3.0) ( #1511 )
...
Update version.json
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
2023-12-30 10:19:46 +01:00
5b0dc20e4c
⬆️ Update ggerganov/llama.cpp ( #1509 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-30 09:19:07 +00:00
9723c3c21d
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-28 23:06:40 +01:00
9dc32275ad
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-28 23:03:44 +01:00
611c11f57b
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-28 23:03:10 +01:00
763d1f524a
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-28 23:01:52 +01:00
6428003c3b
⬆️ Update ggerganov/llama.cpp ( #1503 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-28 22:44:50 +01:00
2eac4f93bb
⬆️ Update ggerganov/llama.cpp ( #1501 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-28 00:51:29 +00:00
24adf9cbcb
remove default to stablediffusion ( #1500 )
2023-12-27 23:16:49 +00:00
c45f581c47
⬆️ Update ggerganov/llama.cpp ( #1496 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-26 19:15:58 -05:00
ae0c48e6bd
ci(apple): speedups ( #1471 )
...
* ci(apple): install grpc from brew
* ci(apple): use brew deps also on release
* ci(linux): install grpc from package manager
* ci: set concurrency
* Revert "ci(linux): install grpc from package manager"
This reverts commit 004e3e308e
2023-12-26 19:19:37 +01:00
4ca649154d
⬆️ Update ggerganov/llama.cpp ( #1495 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-26 17:53:59 +00:00
66dd387858
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-12-25 09:04:35 +01:00
9789f5a96a
⬆️ Update ggerganov/llama.cpp ( #1492 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-25 02:43:35 -05:00
cae7b197ec
feat: add tiny dream stable diffusion support ( #1283 )
...
Signed-off-by: Gianluca Boiano <morf3089@gmail.com >
2023-12-24 19:27:24 +00:00
f7621b2c6c
feat: partial download ( #1486 )
...
* add .partial download
* fix Stat check
* review partial download
2023-12-24 19:39:33 +01:00
95eb72bfd3
feat: add 🐸 coqui ( #1489 )
...
* feat: add coqui
* docs: update news
2023-12-24 19:38:54 +01:00
7e2d101a46
fix: guidance_scale not work in sd ( #1488 )
...
Signed-off-by: hibobmaster <32976627+hibobmaster@users.noreply.github.com >
2023-12-24 19:24:52 +01:00
6597881854
fix: exllama2 backend ( #1484 )
...
Signed-off-by: Sertac Ozercan <sozercan@gmail.com >
2023-12-24 08:32:12 +00:00
eaa899df63
⬆️ Update ggerganov/whisper.cpp ( #1483 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-24 02:53:29 -05:00
16ed0bd0c5
⬆️ Update ggerganov/llama.cpp ( #1482 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-24 02:53:12 -05:00
939187a129
env(conda): use transformers for vall-e-x ( #1481 )
2023-12-23 14:31:34 -05:00
4b520c3343
docs: add langchain4j integration ( #1476 )
...
* docs: add langchain4j integration
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* Update docs/content/integrations/langchain4j.md
Co-authored-by: LangChain4j <langchain4j@gmail.com >
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
* Update langchain4j.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com >
Co-authored-by: LangChain4j <langchain4j@gmail.com >
2023-12-23 09:13:56 +00:00
51215d480a
⬆️ Update ggerganov/whisper.cpp ( #1480 )
...
Signed-off-by: GitHub <noreply@github.com >
Co-authored-by: mudler <mudler@users.noreply.github.com >
2023-12-23 09:11:40 +00:00
