LocalAI uses P2P technologies to enable distribution of work between peers. It is possible to share an instance with Federation and/or split the weights of a model across peers (only available with llama.cpp models). You can now share computational resources between your devices or your friends!
+
+
+
+ Network token
+
+
+ {{.P2PToken}}
+ The network token can be used to either share the instance or join a federation or a worker network. Below you will find a few examples on how to start a new instance or a worker with the token and you will be able to see the available workers and federated nodes.
+
+
{{ if and .IsP2PEnabled (eq .P2PToken "") }}
@@ -50,7 +59,6 @@
Start a federated instance
-
@@ -62,22 +70,25 @@
-
-
+
-
-
To start a new instance to share:
-
+
+ To start a new instance to share:
+
+
+
# Start a new instance to share with --federated and a TOKEN
export TOKEN="{{.P2PToken}}"
local-ai run --federated --p2p
Note: If you don't have a token do not specify it and use the generated one that you can find in this page.