LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2025-01-31 00:24:54 +00:00

History

Ettore Di Giacinto 02de274e00

feat(federated): allow to pickup a specific worker, improve loadbalancing (#3243 )

* feat(explorer): allow to specify a worker target

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(explorer): correctly load balance requests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(explorer): mark load balanced by default

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix: make sure to delete tunnels that might not exist anymore

If a worker goes off and on might change tunnel address, and we want to
load balance only on the active tunnels.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-08-13 16:17:18 +02:00

backend

feat(llama.cpp): support embeddings endpoints (#2871 )

2024-07-15 22:54:16 +02:00

cli

feat(federated): allow to pickup a specific worker, improve loadbalancing (#3243 )

2024-08-13 16:17:18 +02:00

clients

feat(store): add Golang client (#1977 )

2024-04-16 15:54:14 +02:00

config

feat(p2p): allow to run multiple clusters in the same p2p network (#3128 )