LocalAI/core/cli
Ettore Di Giacinto 02de274e00
feat(federated): allow to pickup a specific worker, improve loadbalancing (#3243)
* feat(explorer): allow to specify a worker target

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(explorer): correctly load balance requests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(explorer): mark load balanced by default

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix: make sure to delete tunnels that might not exist anymore

If a worker goes off and on might change tunnel address, and we want to
load balance only on the active tunnels.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-08-13 16:17:18 +02:00
..
context feat(llama.cpp): Totally decentralized, private, distributed, p2p inference (#2343) 2024-05-20 19:17:59 +02:00
worker feat(p2p): add network explorer and community pools (#3125) 2024-08-09 20:12:01 +02:00
cli.go feat(p2p): add network explorer and community pools (#3125) 2024-08-09 20:12:01 +02:00
explorer.go feat(explorer): make possible to run sync in a separate process (#3224) 2024-08-12 19:25:44 +02:00
federated.go feat(federated): allow to pickup a specific worker, improve loadbalancing (#3243) 2024-08-13 16:17:18 +02:00
models.go fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
run.go feat(p2p): add network explorer and community pools (#3125) 2024-08-09 20:12:01 +02:00
transcript.go fix(cli): remove duplicate alias (#2654) 2024-06-25 10:08:13 +02:00
tts.go chore: fix go.mod module (#2635) 2024-06-23 08:24:36 +00:00
util.go fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00