ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-21 05:33:09 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
1,985 Commits 43 Branches 108 Tags 46 MiB
deb5311373
Commit Graph

1985 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ettore Di Giacinto
bdd6769b2d
feat(default): use number of physical cores as default (#2483) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-04 15:23:29 +02:00
Ettore Di Giacinto
1ffee9989f
README: update sponsors list (#2476) 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-04 15:23:00 +02:00
Dave
34ab442ce9
toil: bump grpc version (#2480) 
bump the grpc package version

---------

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-06-04 08:39:19 +02:00
LocalAI [bot]
67aa31faad
⬆️ Update ggerganov/llama.cpp (#2477) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-03 23:09:24 +00:00
fakezeta
6ef78ef7f6
bugfix: CUDA acceleration not working (#2475) 
* bugfix: CUDA acceleration not working

CUDA not working after #2286.
Refactored the code to be more polish

* Update requirements.txt

Missing imports

Signed-off-by: fakezeta <fakezeta@gmail.com>

* Update requirements.txt

Signed-off-by: fakezeta <fakezeta@gmail.com>

---------

Signed-off-by: fakezeta <fakezeta@gmail.com>
 2024-06-03 22:41:42 +02:00
Ettore Di Giacinto
daa7544d9c
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-03 19:55:01 +02:00
Ettore Di Giacinto
34527737bb
feat(webui): enhance card visibility (#2473) 
Do not let the description text to clutter, also highlight the model
names

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-03 17:07:26 +02:00
Ettore Di Giacinto
148adebe16
docs: fix p2p commands (#2472) 
Also change icons on GPT vision page

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-03 16:58:53 +02:00
Ettore Di Giacinto
bae2a649fd
models(gallery): add new poppy porpoise versions (#2471) 
models(gallery): add new poppy purpoise versions

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-03 15:44:52 +02:00
Ettore Di Giacinto
90945ebab3
models(gallery): add fimbulvetr iqmatrix version (#2470) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-03 15:44:27 +02:00
fakezeta
4a239a4bff
feat(transformers): various enhancements to the transformers backend (#2468) 
update transformers

*Handle Temperature = 0 as greedy search
*Handle custom works as stop words
*Implement KV cache
*Phi 3 no more requires trust_remote_code: true
 2024-06-03 08:52:55 +02:00
LocalAI [bot]
5ddaa19914
⬆️ Update ggerganov/llama.cpp (#2467) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-02 21:34:29 +00:00
Ettore Di Giacinto
77d752a481
fix(gemma): correctly format the template 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-02 10:51:58 +02:00
Ettore Di Giacinto
29ff51c12a
Update gemma stopwords 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-02 01:26:41 +02:00
Ettore Di Giacinto
c0744899c9
models(gallery): add gemma-2b (#2466) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-02 01:15:06 +02:00
LocalAI [bot]
c9092ad39c
models(gallery): ⬆️ update checksum (#2463) 
⬆️ Checksum updates in gallery/index.yaml

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-01 23:13:02 +00:00
LocalAI [bot]
b588cae70e
⬆️ Update ggerganov/llama.cpp (#2465) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-01 22:31:32 +00:00
LocalAI [bot]
fb0f188c93
feat(swagger): update swagger (#2464) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-01 22:04:01 +00:00
Chakib Benziane
b99182c8d4
TTS API improvements (#2308) 
* update doc on COQUI_LANGUAGE env variable

Signed-off-by: blob42 <contact@blob42.xyz>

* return errors from tts gRPC backend

Signed-off-by: blob42 <contact@blob42.xyz>

* handle speaker_id and language in coqui TTS backend

Signed-off-by: blob42 <contact@blob42.xyz>

* TTS endpoint: add optional language paramter

Signed-off-by: blob42 <contact@blob42.xyz>

* tts fix: empty language string breaks non-multilingual models

Signed-off-by: blob42 <contact@blob42.xyz>

* allow tts param definition in config file

- consolidate TTS options under `tts` config entry

Signed-off-by: blob42 <contact@blob42.xyz>

* tts: update doc

Signed-off-by: blob42 <contact@blob42.xyz>

---------

Signed-off-by: blob42 <contact@blob42.xyz>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-01 18:26:27 +00:00
Ettore Di Giacinto
95c65d67f5
models(gallery): add all whisper variants (#2462) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-01 20:04:03 +02:00
Ettore Di Giacinto
c603b95ac7
ci: pin build-time protoc (#2461) 
ci: pin protoc

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-01 18:59:15 +02:00
Ettore Di Giacinto
13cfa6de0a
models(gallery): add Neural SOVLish Devil (#2460) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-01 12:54:58 +02:00
Ettore Di Giacinto
0560c6fd57
models(gallery): add poppy porpoise 1.0 (#2459) 
modekls(gallery): add poppy porpoise 1.0

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-01 12:54:37 +02:00
Ettore Di Giacinto
f24dddae42
models(gallery): add ultron (#2456) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-01 00:09:51 +02:00
LocalAI [bot]
06b461b061
⬆️ Update ggerganov/llama.cpp (#2453) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-01 00:09:26 +02:00
Ettore Di Giacinto
e50a7ba879
models(gallery): add llama3-11b (#2455) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-01 00:03:57 +02:00
Ettore Di Giacinto
3b2bce1fc9
models(gallery): add anjir (#2454) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-01 00:03:46 +02:00
LocalAI [bot]
3fe7e9f678
⬆️ Update ggerganov/whisper.cpp (#2452) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-31 21:59:48 +00:00
LocalAI [bot]
654b661688
models(gallery): ⬆️ update checksum (#2451) 
⬆️ Checksum updates in gallery/index.yaml

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-31 21:58:54 +00:00
Ettore Di Giacinto
7f387fb238
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-31 22:59:51 +02:00
Ettore Di Giacinto
5d31e5269d
feat(functions): allow response_regex to be a list (#2447) 
feat(functions): allow regex match to be a list

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-31 22:52:02 +02:00
Ettore Di Giacinto
ff8a6962cd
build(Makefile): add back single target to build native llama-cpp (#2448) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-31 18:35:33 +02:00
Ettore Di Giacinto
10c64dbb55
models(gallery): add mopeymule (#2449) 
* models(gallery): add mopeymule

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* ci: try to fix workflow

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-31 18:08:39 +02:00
Ettore Di Giacinto
3f7212c660
feat(functions): better free string matching, allow to expect strings after JSON (#2445) 
Allow now any non-character, both as suffix and prefix when mixed grammars are enabled

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-31 09:36:27 +02:00
LocalAI [bot]
5dc6bace49
⬆️ Update ggerganov/whisper.cpp (#2443) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-30 22:18:55 +00:00
LocalAI [bot]
3cd5918ae6
⬆️ Update ggerganov/llama.cpp (#2444) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-30 22:09:42 +00:00
Ettore Di Giacinto
5b75bf16c7
models(gallery): add Codestral (#2442) 
models(gallery): add Coderstral

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-30 18:50:26 +02:00
LocalAI [bot]
0c40f545d4
feat(swagger): update swagger (#2436) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-30 08:11:05 +00:00
LocalAI [bot]
b2fc92daa7
⬆️ Update ggerganov/whisper.cpp (#2438) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-30 06:07:28 +00:00
LocalAI [bot]
0787797961
⬆️ Update ggerganov/llama.cpp (#2437) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-29 23:15:36 +00:00
Ettore Di Giacinto
2ba9e27bcf
models(gallery): add neuraldaredevil (#2439) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-30 00:15:52 +02:00
Prajwal S Nayak
4d98dd9ce7
feat(image): support response_type in the OpenAI API request (#2347) 
* Change response_format type to string to match OpenAI Spec

Signed-off-by: prajwal <prajwalnayak7@gmail.com>

* updated response_type type to interface

Signed-off-by: prajwal <prajwalnayak7@gmail.com>

* feat: correctly parse generic struct

Signed-off-by: mudler <mudler@localai.io>

* add tests

Signed-off-by: mudler <mudler@localai.io>

---------

Signed-off-by: prajwal <prajwalnayak7@gmail.com>
Signed-off-by: mudler <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Co-authored-by: mudler <mudler@localai.io>
 2024-05-29 14:40:54 +02:00
LocalAI [bot]
087bceccac
⬆️ Update ggerganov/llama.cpp (#2433) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-28 21:55:03 +00:00
Ettore Di Giacinto
7064697ce5
models(gallery): add halu (#2434) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-28 23:13:50 +02:00
Ettore Di Giacinto
0b99be73b3
models(gallery): add una-thepitbull (#2435) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-28 23:13:28 +02:00
Ettore Di Giacinto
669cd06dd9
feat(functions): allow parallel calls with mixed/no grammars (#2432) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-28 21:06:09 +02:00
Ettore Di Giacinto
2bbc52fcc8
feat(build): add arm64 core containers (#2421) 
ci: add arm64 container images

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-28 10:34:59 +02:00
LocalAI [bot]
577888f3c0
⬆️ Update ggerganov/llama.cpp (#2428) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-27 22:02:49 +00:00
LocalAI [bot]
1c80f628ff
⬆️ Update ggerganov/whisper.cpp (#2427) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-27 21:28:36 +00:00
Ettore Di Giacinto
10430a00bd
feat(hipblas): extend default hipblas GPU_TARGETS (#2426) 
Makefile: extend default hipblas GPU_TARGETS

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-27 22:35:11 +02:00