8 Commits

Author	SHA1	Message	Date
Ettore Di Giacinto	2669f4738a	fix(p2p): re-use p2p host when running federated mode (#3341) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-08-20 20:14:17 +02:00
Ettore Di Giacinto	6d350ccce0	feat(federation): do not allocate local services for load balancing (#3337) ... * refactor: extract proxy into functions * feat(federation): do not allocate services, directly connect with libp2p Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-08-20 14:45:36 +02:00
Ettore Di Giacinto	27b03a52f3	fix(p2p): allocate tunnels only when needed (#3259) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-08-17 15:03:55 +02:00
Ettore Di Giacinto	7278bf3de8	chore: allow to disable gallery endpoints, improve p2p connection handling (#3256) ... * Add more debug messages Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat: allow to disable gallery endpoints Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * improve p2p messaging Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * improve error handling Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Make sure to close the listening socket when context is exhausted Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-08-17 08:28:52 +02:00
Ettore Di Giacinto	3457acc48b	chore(explorer): add join instructions (#3255) ... * feat(explorer): give CLI instructions to join federated clusters Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * debug message Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-08-16 19:34:36 +02:00
Ettore Di Giacinto	02de274e00	feat(federated): allow to pickup a specific worker, improve loadbalancing (#3243) ... * feat(explorer): allow to specify a worker target Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(explorer): correctly load balance requests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(explorer): mark load balanced by default Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix: make sure to delete tunnels that might not exist anymore If a worker goes off and on might change tunnel address, and we want to load balance only on the active tunnels. Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-08-13 16:17:18 +02:00
Ettore Di Giacinto	252961751c	feat(federation): add load balanced option (#2915) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-07-18 23:18:53 +02:00
Ettore Di Giacinto	24a8eebcef	refactor: move federated server logic to its own service (#2914) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-07-18 19:15:15 +02:00