0f9b58f2cf
⬆️ Update ggerganov/llama.cpp ( #2508 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-06 23:48:17 +00:00
0f134d557e
⬆️ Update ggerganov/whisper.cpp ( #2507 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-06 23:21:25 +00:00
2676e127ae
models(gallery): add llama3-8b-feifei-1.0-iq-imatrix ( #2511 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-07 00:17:59 +02:00
270d4f8413
models(gallery): add rawr_llama3_8b-iq-imatrix ( #2510 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-07 00:12:11 +02:00
2d79cee8cb
models(gallery): add llama3-8B-aifeifei-1.0-iq-imatrix ( #2509 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-07 00:07:20 +02:00
4c9623f50d
deps(whisper): update, add libcufft-dev ( #2501 )
...
* arrow_up: Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* fix(build): add libcufft-dev
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-06 08:41:04 +02:00
596cf76135
build(intel): bundle intel variants in single-binary ( #2494 )
...
* wip: try to build also intel variants
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Add dependencies
* Select automatically intel backend
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-06 08:40:51 +02:00
a293aa1b79
⬆️ Update ggerganov/llama.cpp ( #2493 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-06 00:02:51 +00:00
c4eb02c80f
models(gallery): add l3-8b-stheno-v3.2-iq-imatrix ( #2500 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-05 23:46:59 +02:00
9c9198ff08
models(gallery): add Llama-3-Yggdrasil-2.0-8B ( #2499 )
...
models(gallery): add Llama-3-Yggdrasil-2.0-8B-GGUF
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-05 23:42:23 +02:00
83c79d5453
models(gallery): add llama-3-instruct-8b-SimPO-ExPO ( #2498 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-05 23:37:59 +02:00
88fd000065
models(gallery): add phi-3-4x4b ( #2497 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-05 23:29:15 +02:00
956d652314
models(gallery): add nyun ( #2496 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-05 23:22:58 +02:00
9ce2b4d71f
models(gallery): add dolphin-2.9.2-phi-3-Medium-abliterated ( #2495 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-05 23:14:43 +02:00
4e974cb4fc
models(gallery): add dolphin-2.9.2-Phi-3-Medium ( #2492 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-05 19:17:20 +02:00
d072835796
feat:OpaqueErrors to hide error information ( #2486 )
...
* adds a new configuration option to hide all error message information from http requests
---------
Signed-off-by: Dave Lee <dave@gray101.com >
2024-06-05 08:45:24 +02:00
17cf6c4a4d
feat(amdgpu): try to build in single binary ( #2485 )
...
* feat(amdgpu): try to build in single binary
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Release space from worker
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-05 08:44:15 +02:00
fab3e711ff
⬆️ Update ggerganov/llama.cpp ( #2487 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-04 23:11:28 +00:00
4e1463fec2
feat: fiber CSRF ( #2482 )
...
new config option - enables or disables the fiber csrf middleware
Signed-off-by: Dave Lee <dave@gray101.com >
2024-06-04 19:43:46 +00:00
2fc6fe806b
fix: pkg/downloader should respect basePath for file:// urls ( #2481 )
...
* pass basePath down to pkg/downloader
Signed-off-by: Dave Lee <dave@gray101.com >
* enforce
Signed-off-by: Dave Lee <dave@gray101.com >
---------
Signed-off-by: Dave Lee <dave@gray101.com >
2024-06-04 14:32:47 +00:00
bdd6769b2d
feat(default): use number of physical cores as default ( #2483 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-04 15:23:29 +02:00
1ffee9989f
README: update sponsors list ( #2476 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-04 15:23:00 +02:00
34ab442ce9
toil: bump grpc version ( #2480 )
...
bump the grpc package version
---------
Signed-off-by: Dave Lee <dave@gray101.com >
2024-06-04 08:39:19 +02:00
67aa31faad
⬆️ Update ggerganov/llama.cpp ( #2477 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-03 23:09:24 +00:00
6ef78ef7f6
bugfix: CUDA acceleration not working ( #2475 )
...
* bugfix: CUDA acceleration not working
CUDA not working after #2286 .
Refactored the code to be more polish
* Update requirements.txt
Missing imports
Signed-off-by: fakezeta <fakezeta@gmail.com >
* Update requirements.txt
Signed-off-by: fakezeta <fakezeta@gmail.com >
---------
Signed-off-by: fakezeta <fakezeta@gmail.com >
2024-06-03 22:41:42 +02:00
daa7544d9c
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-03 19:55:01 +02:00
34527737bb
feat(webui): enhance card visibility ( #2473 )
...
Do not let the description text to clutter, also highlight the model
names
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-03 17:07:26 +02:00
148adebe16
docs: fix p2p commands ( #2472 )
...
Also change icons on GPT vision page
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-03 16:58:53 +02:00
bae2a649fd
models(gallery): add new poppy porpoise versions ( #2471 )
...
models(gallery): add new poppy purpoise versions
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-03 15:44:52 +02:00
90945ebab3
models(gallery): add fimbulvetr iqmatrix version ( #2470 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-03 15:44:27 +02:00
4a239a4bff
feat(transformers): various enhancements to the transformers backend ( #2468 )
...
update transformers
*Handle Temperature = 0 as greedy search
*Handle custom works as stop words
*Implement KV cache
*Phi 3 no more requires trust_remote_code: true
2024-06-03 08:52:55 +02:00
5ddaa19914
⬆️ Update ggerganov/llama.cpp ( #2467 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-02 21:34:29 +00:00
77d752a481
fix(gemma): correctly format the template
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-02 10:51:58 +02:00
29ff51c12a
Update gemma stopwords
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-02 01:26:41 +02:00
c0744899c9
models(gallery): add gemma-2b ( #2466 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-02 01:15:06 +02:00
c9092ad39c
models(gallery): ⬆️ update checksum ( #2463 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-01 23:13:02 +00:00
b588cae70e
⬆️ Update ggerganov/llama.cpp ( #2465 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-01 22:31:32 +00:00
fb0f188c93
feat(swagger): update swagger ( #2464 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-01 22:04:01 +00:00
b99182c8d4
TTS API improvements ( #2308 )
...
* update doc on COQUI_LANGUAGE env variable
Signed-off-by: blob42 <contact@blob42.xyz >
* return errors from tts gRPC backend
Signed-off-by: blob42 <contact@blob42.xyz >
* handle speaker_id and language in coqui TTS backend
Signed-off-by: blob42 <contact@blob42.xyz >
* TTS endpoint: add optional language paramter
Signed-off-by: blob42 <contact@blob42.xyz >
* tts fix: empty language string breaks non-multilingual models
Signed-off-by: blob42 <contact@blob42.xyz >
* allow tts param definition in config file
- consolidate TTS options under `tts` config entry
Signed-off-by: blob42 <contact@blob42.xyz >
* tts: update doc
Signed-off-by: blob42 <contact@blob42.xyz >
---------
Signed-off-by: blob42 <contact@blob42.xyz >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-06-01 18:26:27 +00:00
95c65d67f5
models(gallery): add all whisper variants ( #2462 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 20:04:03 +02:00
c603b95ac7
ci: pin build-time protoc ( #2461 )
...
ci: pin protoc
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 18:59:15 +02:00
13cfa6de0a
models(gallery): add Neural SOVLish Devil ( #2460 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 12:54:58 +02:00
0560c6fd57
models(gallery): add poppy porpoise 1.0 ( #2459 )
...
modekls(gallery): add poppy porpoise 1.0
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 12:54:37 +02:00
f24dddae42
models(gallery): add ultron ( #2456 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 00:09:51 +02:00
06b461b061
⬆️ Update ggerganov/llama.cpp ( #2453 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-01 00:09:26 +02:00
e50a7ba879
models(gallery): add llama3-11b ( #2455 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 00:03:57 +02:00
3b2bce1fc9
models(gallery): add anjir ( #2454 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-06-01 00:03:46 +02:00
3fe7e9f678
⬆️ Update ggerganov/whisper.cpp ( #2452 )
...
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-05-31 21:59:48 +00:00
654b661688
models(gallery): ⬆️ update checksum ( #2451 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-05-31 21:58:54 +00:00
7f387fb238
Update README.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-31 22:59:51 +02:00
