ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-19 04:37:53 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
1,366 Commits 43 Branches 108 Tags 45 MiB
cc3d601836
Commit Graph

1366 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
LocalAI [bot]
fc8423392f
⬆️ Update ggerganov/llama.cpp (#1688) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-02-09 00:02:23 +01:00
Ettore Di Giacinto
f1f6035967
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-08 20:39:00 +01:00
Ettore Di Giacinto
ddd21f1644
feat: Use ubuntu as base for container images, drop deprecated ggml-transformers backends (#1689) 
* cleanup backends

* switch image to ubuntu 22.04

* adapt commands for ubuntu

* transformers cleanup

* no contrib on ubuntu

* Change test model to gguf

* ci: disable bark tests (too cpu-intensive)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* cleanup

* refinements

* use intel base image

* Makefile: Add docker targets

* Change test model

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-02-08 20:12:51 +01:00
Ettore Di Giacinto
d0a6a35b55
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-07 09:40:31 +01:00
Ettore Di Giacinto
e0632f2ce2
fix(llama.cpp): downgrade to fix sycl build 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-07 00:16:52 +01:00
Ettore Di Giacinto
37e6974afe
ci: fix extra(bark) tests 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-06 20:49:28 +01:00
Ettore Di Giacinto
e23e490455
Revert "fix(Dockerfile): sycl dependencies" (#1687) 
Revert "fix(Dockerfile): sycl dependencies (#1686)"

This reverts commit f76bb8954b.
 2024-02-06 20:48:29 +01:00
Ettore Di Giacinto
f76bb8954b
fix(Dockerfile): sycl dependencies (#1686) 
* fix(Dockerfile): sycl dependencies

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(ci): cleanup before running bark test

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-02-06 19:42:52 +01:00
Ettore Di Giacinto
d168c7c9dc
ci: cleanup worker before run (#1685) 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-06 19:42:27 +01:00
Ettore Di Giacinto
fd9d060c94
ci: fix sycl image suffix 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-06 15:52:21 +01:00
LocalAI [bot]
d8b17795d7
⬆️ Update ggerganov/llama.cpp (#1683) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-02-06 09:26:01 +01:00
Ettore Di Giacinto
ea7b33b0d2
Update integrations.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-05 15:59:31 +01:00
LocalAI [bot]
8ace0a9ba7
⬆️ Update ggerganov/llama.cpp (#1681) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-02-04 21:59:14 +00:00
Ettore Di Giacinto
98ad93d53e
Drop ggml-based gpt2 and starcoder (supported by llama.cpp) (#1679) 
* Drop ggml-based gpt2 and starcoder (supported by llama.cpp)

* Update compatibility table
 2024-02-04 13:15:51 +01:00
LocalAI [bot]
38e4ec0b2a
⬆️ Update ggerganov/llama.cpp (#1678) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-02-04 00:55:12 +01:00
Nicolas Vermande
f083a901fe
Fix HTTP links in README.md (#1677) 
Signed-off-by: Nicolas Vermande <vfiftyfive@gmail.com>
 2024-02-04 00:54:49 +01:00
Ettore Di Giacinto
df13ba655c
Drop old falcon backend (deprecated) (#1675) 
Drop old falcon backend
 2024-02-03 13:01:13 +01:00
LocalAI [bot]
7678b25755
⬆️ Update ggerganov/llama.cpp (#1673) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-02-02 21:46:26 +00:00
LocalAI [bot]
c87ca4f320
⬆️ Update ggerganov/llama.cpp (#1669) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-02-02 19:14:03 +01:00
Ivan Smirnov
3c24a70a1b
fix (docs): fixed broken links github/ -> github.com/ (#1672) 
fix broken links
 2024-02-02 18:18:03 +01:00
Richard Palethorpe
e46db63e06
feat(mamba): Add bagel-dpo-2.8b (#1671) 
Adds the Mamba-slimpj model fine-tuned with bagel.
https://huggingface.co/jondurbin/bagel-dpo-2.8b-v0.2

Signed-off-by: Richard Palethorpe <io@richiejp.com>
 2024-02-02 18:17:44 +01:00
Ettore Di Giacinto
1c57f8d077
feat(sycl): Add support for Intel GPUs with sycl (#1647) (#1660) 
* feat(sycl): Add sycl support (#1647)

* onekit: install without prompts

* set cmake args only in grpc-server

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* cleanup

* fixup sycl source env

* Cleanup docs

* ci: runs on self-hosted

* fix typo

* bump llama.cpp

* llama.cpp: update server

* adapt to upstream changes

* adapt to upstream changes

* docs: add sycl

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-02-01 19:21:52 +01:00
LocalAI [bot]
16cebf0390
⬆️ Update ggerganov/llama.cpp (#1665) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-30 23:38:05 +00:00
Ettore Di Giacinto
555bc02665
Update codellama-7b.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-01-30 11:36:20 +01:00
LocalAI [bot]
c1bae1ee81
⬆️ Update ggerganov/llama.cpp (#1656) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-30 00:43:36 +01:00
LocalAI [bot]
f2ed3df3da
⬆️ Update docs version mudler/LocalAI (#1661) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-30 00:43:18 +01:00
LocalAI [bot]
abd678e147
⬆️ Update ggerganov/llama.cpp (#1655) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-28 09:24:44 +01:00
Ettore Di Giacinto
6ac5d814fb
feat(startup): fetch model definition remotely (#1654) 2024-01-28 00:14:16 +01:00
LocalAI [bot]
f928899338
⬆️ Update ggerganov/llama.cpp (#1652) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-27 00:13:38 +01:00
Ettore Di Giacinto
5a6fd98839
fix(paths): automatically create paths (#1650) 
Especially useful when running inside a container.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-01-27 00:13:19 +01:00
Ettore Di Giacinto
072f71dfb7
Update codellama-7b.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-01-26 18:35:33 +01:00
Ettore Di Giacinto
670cee8274
Update transformers-tinyllama.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-01-26 18:29:38 +01:00
Ettore Di Giacinto
9f1be45552
Update quickstart.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-01-26 17:55:20 +01:00
Ettore Di Giacinto
f1846ae5ac
Update phi-2.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-01-26 16:22:54 +01:00
LocalAI [bot]
ac19998e5e
⬆️ Update ggerganov/llama.cpp (#1644) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-26 00:13:39 +01:00
Ettore Di Giacinto
cb7512734d
transformers: correctly load automodels (#1643) 
* backends(transformers): use AutoModel with LLM types

* examples: animagine-xl

* Add codellama examples
 2024-01-26 00:13:21 +01:00
LocalAI [bot]
3733250b3c
⬆️ Update ggerganov/llama.cpp (#1642) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-24 22:51:59 +01:00
LocalAI [bot]
da3cd8993d
⬆️ Update docs version mudler/LocalAI (#1631) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-24 19:50:33 +01:00
LocalAI [bot]
7690caf020
⬆️ Update ggerganov/llama.cpp (#1632) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-23 23:07:51 +01:00
Ettore Di Giacinto
5e335eaead
feat(transformers): support also text generation (#1630) 
* feat(transformers): support also text generation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* embedded: set seed -1

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-01-23 23:07:31 +01:00
coyzeng
d5d82ba344
feat(grpc): backend SPI pluggable in embedding mode (#1621) 
* run server

* grpc backend embedded support

* backend providable
 2024-01-23 08:56:36 +01:00
LocalAI [bot]
efe2883c5d
⬆️ Update ggerganov/llama.cpp (#1626) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-22 23:22:01 +01:00
LocalAI [bot]
47237c7c3c
⬆️ Update ggerganov/llama.cpp (#1623) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-22 08:54:06 +01:00
Ettore Di Giacinto
697c769b64
fix(llama.cpp): enable cont batching when parallel is set (#1622) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-01-21 14:59:48 +01:00
Ettore Di Giacinto
94261b1717
Update gpt-vision.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-01-21 10:07:30 +01:00
Sebastian
eaf85a30f9
fix(llama.cpp): Enable parallel requests (#1616) 
integrate changes from llama.cpp

Signed-off-by: Sebastian <tauven@gmail.com>
 2024-01-21 09:56:14 +01:00
LocalAI [bot]
6a88b030ea
⬆️ Update ggerganov/llama.cpp (#1620) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-20 23:34:46 +01:00
LocalAI [bot]
f538416fb3
⬆️ Update docs version mudler/LocalAI (#1619) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-01-20 21:37:02 +00:00
Ettore Di Giacinto
06cd9ef98d
feat(extra-backends): Improvements, adding mamba example (#1618) 
* feat(extra-backends): Improvements

vllm: add max_tokens, wire up stream event
mamba: fixups, adding examples for mamba-chat

* examples(mamba-chat): add

* docs: update
 2024-01-20 17:56:08 +01:00
James Braza
f3d71f8819
Modernized LlamaIndex integration (#1613) 
Updated LlamaIndex example
 2024-01-20 10:06:32 +01:00