LocalAI/core
Ettore Di Giacinto 02de274e00
feat(federated): allow to pickup a specific worker, improve loadbalancing (#3243)
* feat(explorer): allow to specify a worker target

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(explorer): correctly load balance requests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(explorer): mark load balanced by default

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix: make sure to delete tunnels that might not exist anymore

If a worker goes off and on might change tunnel address, and we want to
load balance only on the active tunnels.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-08-13 16:17:18 +02:00
..
backend feat(llama.cpp): support embeddings endpoints (#2871) 2024-07-15 22:54:16 +02:00
cli feat(federated): allow to pickup a specific worker, improve loadbalancing (#3243) 2024-08-13 16:17:18 +02:00
clients feat(store): add Golang client (#1977) 2024-04-16 15:54:14 +02:00
config feat(p2p): allow to run multiple clusters in the same p2p network (#3128) 2024-08-07 23:35:44 +02:00
dependencies_manager fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
explorer feat(explorer): make possible to run sync in a separate process (#3224) 2024-08-12 19:25:44 +02:00
gallery fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
http feat(explorer): make possible to run sync in a separate process (#3224) 2024-08-12 19:25:44 +02:00
p2p feat(federated): allow to pickup a specific worker, improve loadbalancing (#3243) 2024-08-13 16:17:18 +02:00
schema feat(openai): add json_schema format type and strict mode (#3193) 2024-08-07 15:27:02 -04:00
services feat(model-list): be consistent, skip known files from listing (#2760) 2024-07-10 15:28:39 +02:00
startup chore: drop gpt4all.cpp (#3106) 2024-08-07 23:35:55 +02:00
application.go feat(model-list): be consistent, skip known files from listing (#2760) 2024-07-10 15:28:39 +02:00