The Serval Project's core daemon that implements Distributed Numbering Architecture (DNA), MDP, VoMP, Rhizome, MeshMS, etc.
Go to file
Andrew Bettison bacba19dc1 Refactor manifest: specific setter functions
Replace generic rhizome_manifest_set() and rhizome_manifest_set_ll()
with per-field setter functions, eg, rhizome_manifest_set_filesize().
Struct rhizome_manifest elements for all known fields, to replace the
use of rhizome_manifest_get() and rhizome_manifest_get_ll() everywhere:
sender, recipient, service, name, date, bundle_key.

Add boolean validity flags for binary blob types, to avoid having to compare
with many bytes of all-zero to detect presence, eg, has_sender, has_recipient,
has_author, has_bundle_key.  These maintained by the setter functions.

Rename existing manifest struct elements to be the same as their field
names: fileLength -> filesize, journalTail -> tail.

More use of unsigned int, size_t and uint64_t for payload sizes, offsets, byte
counts, etc. especially in rhizome_store.c and meshms.c.  More uniform use of
size_t to dimension memory buffers.  Fix some printf(3) style format strings
for 64-bit correctness on 32-bit systems.  Use new constant RHIZOME_SIZE_UNSET
instead of -1 to indicate unknown dimension, and explicitly assert its absence
before comparisons and arithmetic, for safety.

Replace some 'int' loop variables with 'unsigned' where appropriate.

Fix bugs discovered in MeshMS bundle private/public key generation and
bundle secret key handling for export/extract commands.

Instrument the first MeshMS test case to aid debugging.

New debug config flag: debug.manifest logs all modifications to all manifest
fields by setter functions.

Rename debug config flag: debug.rhizome_bind -> debug.rhizome_sql_bind.
2013-11-04 19:17:49 +10:30
asterisk_include Added support for batmand.peers file for reliable peer querying. 2011-03-21 13:08:35 +10:30
Debian/etc Improve Debian init.d script and default file 2013-01-24 13:24:11 +10:30
doc Minimal doc/OpenBTS.md points to app_servaldna repo 2013-05-30 15:52:37 +09:30
fec-3.0.1 Use heartbeat packets to control serial buffering 2013-09-20 14:41:50 +09:30
java/org/servalproject/servald Fix JNI argv parsing: throw exception on NULL 2013-02-15 19:33:12 +10:30
m4 Artefacts created by libtoolize -c -i 2012-09-12 15:21:50 +09:30
nacl cleaned up NaCl build to just compile using make. #17 2012-10-18 17:26:52 +10:30
openwrt/packages/serval-dna Updated build files for openwrt (now all live in openwrt/). #26 2012-10-29 07:38:16 +10:30
sqlite-amalgamation-3070900 Reduce use of stderr in many places 2012-08-01 17:54:02 +09:30
tests Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
utilities Fix Markdown formatting 2013-02-22 00:05:34 -08:00
win32 Allow clients to request variables for all records by passing empty did. 2011-04-27 12:17:26 +09:30
.dir-locals.el Add file to set emacs variables to match the prevailing style. 2012-07-29 13:52:46 +09:30
.gitignore Build fakeradio with other test binaries 2013-08-19 13:56:19 +09:30
aclocal.m4 Merge branch 'master' of github.com:servalproject/serval-dna 2012-04-23 20:41:52 +09:30
Android.mk Issue #20: merge branch 'sockets' into 'development' 2013-09-19 04:30:14 +09:30
check-in-out-return.c created tool for automatically finding IN()s without matching 2013-02-20 16:18:56 +10:30
cli.c Move cli global state into a structure and pass it around 2013-07-03 16:51:27 +09:30
cli.h Clean up string formatting for 64bit compilation 2013-07-15 09:59:24 +09:30
commandline.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
conf_om.c Improve "config dump" command 2013-02-28 15:18:48 +10:30
conf_parse.c Silence clang warnings 2013-04-11 13:46:09 +09:30
conf_schema.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
conf_schema.h Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
conf.c Issue #11: replace long long with int64_t 2013-10-07 05:54:46 +10:30
conf.h Rewrite HTTP server 2013-10-25 00:19:37 +10:30
config_test.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
config.guess Artefacts created by libtoolize -c -i 2012-09-12 15:21:50 +09:30
config.sub Artefacts created by libtoolize -c -i 2012-09-12 15:21:50 +09:30
configure.in Issue #20: Make abstract sockets work 2013-09-19 17:26:06 +09:30
constants.h Rewrite HTTP server 2013-10-25 00:19:37 +10:30
crc32.c Use correct variable size for crc's 2013-02-20 15:36:26 +10:30
crypto.c Send 3-way request to stop routing an identity 2013-10-14 14:40:19 +10:30
crypto.h Add API to generate public key from private key 2013-07-25 14:40:59 +09:30
dataformats.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
directory_client.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
directory_service.c New header file "fdqueue.h" 2013-10-25 00:20:53 +10:30
dna_helper.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
encode.c Put back a pile of files needed for building on osx, and also required 2012-03-15 10:57:38 +10:30
fakeradio.c New header file "fdqueue.h" 2013-10-25 00:20:53 +10:30
fdqueue.c New header file "fdqueue.h" 2013-10-25 00:20:53 +10:30
fdqueue.h New header file "fdqueue.h" 2013-10-25 00:20:53 +10:30
fifo.c Add PA setup and FIFO code (still not plumbed into the main program) 2012-04-23 16:32:47 +09:30
fifo.h Add PA setup and FIFO code (still not plumbed into the main program) 2012-04-23 16:32:47 +09:30
golay.c Add golay [12,24] FEC routines 2013-09-20 14:41:50 +09:30
golay.h Add golay [12,24] FEC routines 2013-09-20 14:41:50 +09:30
headerfiles.mk New header file "fdqueue.h" 2013-10-25 00:20:53 +10:30
http_server.c Fix subtle MIME parsing bug 2013-10-28 17:50:49 +10:30
http_server.h Fix bugs in new HTTP server MIME body parsing code 2013-10-28 12:08:57 +10:30
install-sh Artefacts created by libtoolize -c -i 2012-09-12 15:21:50 +09:30
INSTALL.md Clean up a few details in INSTALL and README 2013-05-29 14:15:40 +09:30
instance.c Improve Serval instance path operations 2013-09-19 17:19:37 +09:30
jni.c Imported ref10/ implementation of crypto_sign from supercop-20120525 2012-10-18 17:26:48 +10:30
keyring.c Add 'strlen' argument to strn_fromprint() 2013-10-25 00:19:58 +10:30
log.c Use consistent integer types and formats 2013-09-09 12:09:40 +09:30
log.h Make logging D and T macros into expressions 2013-10-25 17:38:28 +10:30
lsif.c Implement flow of mavlink packets over serial connections 2013-09-10 13:07:52 +09:30
ltmain.sh Artefacts created by libtoolize -c -i 2012-09-12 15:21:50 +09:30
macconfig Fixed broadcast address discovery to work on Mac. 2011-08-08 16:11:05 +09:30
main.c Move cli global state into a structure and pass it around 2013-07-03 16:51:27 +09:30
Makefile.dbg Move debug options to Makefile.dbg so we don't have to re-run configure. 2012-07-29 14:55:10 +09:30
Makefile.in Issue #20: Make abstract sockets work 2013-09-19 17:26:06 +09:30
mavlink.c Issue #11: use socklen_t instead of int where appropriate 2013-10-08 14:11:00 +10:30
mdp_client.c mdp_port_t 2013-10-09 19:22:51 +10:30
mdp_client.h mdp_port_t 2013-10-09 19:22:51 +10:30
mem.c Add erealloc() function to mem.h, mem.c 2013-04-30 17:26:27 +09:30
mem.h Add erealloc() function to mem.h, mem.c 2013-04-30 17:26:27 +09:30
meshms.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
meshpotato_build Assorted unknown changes. Updated Makefile.in etc to properly build serval.c for building asterisk module. 2011-06-15 13:52:30 +09:30
monitor-cli.c New header file "fdqueue.h" 2013-10-25 00:20:53 +10:30
monitor-client.c Remove MDP and Monitor socket names from config 2013-09-25 16:56:06 +09:30
monitor-client.h Reuse command line parsing framework with monitor interface 2012-09-25 13:31:34 +09:30
monitor.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
mpbuild Added mesh potato build script. 2011-08-10 15:39:40 +02:00
net.c Add writev_all() function 2013-10-12 03:54:18 +10:30
net.h Add writev_all() function 2013-10-12 03:54:18 +10:30
nonce.c Move cli global state into a structure and pass it around 2013-07-03 16:51:27 +09:30
os.c urandombytes() size_t instead of unsigned long long 2013-10-07 04:47:23 +10:30
os.h Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
overlay_address.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
overlay_address.h Use sid_t everywhere 2013-10-09 18:54:21 +10:30
overlay_buffer.c Improved debug to help diagnose MDP failures on Android 2013-10-07 04:47:13 +10:30
overlay_buffer.h Simplify mavlink link frame creation 2013-09-11 17:15:43 +09:30
overlay_interface.c Fix printf formats for 64bit compilation 2013-10-09 10:31:52 +10:30
overlay_link.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
overlay_mdp_services.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
overlay_mdp.c Send 3-way request to stop routing an identity 2013-10-14 14:40:19 +10:30
overlay_olsr.c Major refactor to packet queuing and delivery in preparation for unicast link tracking. 2013-08-09 09:37:08 +09:30
overlay_packet.h Adjust retransmission delay based on measured RTT 2013-08-29 15:28:20 +09:30
overlay_packetformats.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
overlay_packetradio.c Send the next packet via stream interface ASAP 2013-09-12 16:14:01 +09:30
overlay_payload.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
overlay_queue.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
overlay.c Rewrite HTTP server 2013-10-25 00:19:37 +10:30
pa_phone.c Refactor: rename some cli.h structs 2013-02-13 17:43:24 +10:30
performance_timing.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
randombytes.c More consistent use of sleep_ms 2013-08-27 15:14:17 +09:30
README.md Clean up a few details in INSTALL and README 2013-05-29 14:15:40 +09:30
rhizome_bundle.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rhizome_crypto.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rhizome_database.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rhizome_direct_http.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rhizome_direct.c Use size_t in Rhizome store functions 2013-10-25 00:20:53 +10:30
rhizome_fetch.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rhizome_http.c Fix bugs in new HTTP server MIME body parsing code 2013-10-28 12:08:57 +10:30
rhizome_packetformats.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rhizome_store.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rhizome_sync.c Rewrite HTTP server 2013-10-25 00:19:37 +10:30
rhizome.c Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rhizome.h Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
rotbuf.c Fix bug in rotbuf_next_chunk() when rotation == 0 2013-05-15 16:46:39 +09:30
rotbuf.h Fix rotbuf_advance(), add rotbuf_remain() 2013-04-30 17:28:32 +09:30
route_link.c Fix empty if test typo 2013-10-21 13:23:02 +10:30
serval_packetvisualise.c mdp_port_t 2013-10-09 19:22:51 +10:30
serval.h Refactor manifest: specific setter functions 2013-11-04 19:17:49 +10:30
servalwrap.c Fix android commandline interface 2013-07-09 16:46:16 +09:30
server.c Improve logic and logging in server_pid() 2013-10-07 04:47:23 +10:30
sha2.c Initial stab at porting to Solaris. 2012-09-05 20:42:50 +09:30
sha2.h Substantial preparatory work towards Rhizome/MeshMS store-and-forward 2011-12-13 19:34:12 +10:30
sighandlers.c more work on dna helper interface. 2012-06-21 16:35:28 +09:30
slip.c Issue #11: replace long long with int64_t 2013-10-07 05:54:46 +10:30
socket.c Fix bugs in new local socket naming code 2013-09-25 16:56:06 +09:30
sourcefiles.mk Rewrite HTTP server 2013-10-25 00:19:37 +10:30
srandomdev.c Fix warnings from gcc 4.6.3 2013-03-18 16:48:15 +10:30
str.c Add str_tolower_inplace() function 2013-10-25 00:20:53 +10:30
str.h Add alloca_strdup() macro 2013-10-25 00:20:53 +10:30
strbuf_helpers.c Fix bugs in new HTTP server MIME body parsing code 2013-10-28 12:08:57 +10:30
strbuf_helpers.h Fix bugs in new HTTP server MIME body parsing code 2013-10-28 12:08:57 +10:30
strbuf.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
strbuf.h Use sid_t everywhere 2013-10-09 18:54:21 +10:30
strlcpy.c Fix issues arising from new strlcpy.c 2012-08-14 11:23:27 +09:30
strlcpy.h Fix build when strlcpy is present 2013-01-11 14:43:37 +10:30
testconfig.sh.in Trival test of dna JNI command line entry point 2012-04-23 18:25:26 +09:30
testdefs_rhizome.sh Improve Rhizome testdefs: add rhizome_list_unpack() 2013-11-04 17:40:02 +10:30
testdefs.sh Improve test defs: setup_jq() 2013-10-14 16:50:02 +10:30
testframework.sh Cosmetic changes to test framework 2013-11-04 17:40:02 +10:30
testnacl.c Added test code for NaCl. 2011-10-25 13:39:14 +10:30
tfw_createfile.c Fix string format warning 2013-08-19 13:54:19 +09:30
version_servald.c Servald version string from git describe 2013-03-12 14:03:33 +10:30
version_string.sh build when not in git repostory. 2013-10-20 14:59:00 -07:00
vomp_console.c New header file "fdqueue.h" 2013-10-25 00:20:53 +10:30
vomp.c Use sid_t everywhere 2013-10-09 18:54:21 +10:30
xprintf.c Add XPRINT strbuf adapter 2013-03-25 12:02:48 +10:30
xprintf.h Resurrect packet visualisation 2013-09-02 14:55:02 +09:30

Serval DNA

Serval Project, May 2013

This repository contains the source code for the “core” Serval components implemented in GNU C:

  • The Distributed Numbering Architecture (DNA) is the key innovation that makes mesh telephony viable in the absence of any infrastructure, eg, in the aftermath of a natural disaster or in remote locations. It is a protocol carried over MDP (see below) that allows any device to ask its neighboring devices for a phone number (DID). Such a request will propagate through the mesh, and any device may respond with the identity (SID) of a subscriber who has “claimed” that DID.

  • The Serval Keyring is a flat file containing all the user identities on a single device. Each identity is a set of elliptic curve secret cryptographic keys that belong to a single “mesh subscriber”, indexed by the subscriber's 256-bit public key, called a SID. Each identity in the keyring is locked by its own user-chosen password (called a PIN in the code and documentation), using elliptic curve cryptography to protect locked entries from theft or tampering, and steganography to allow the user to plausibly deny the existence of any locked identity.

  • The Mesh Datagram Protocol (MDP) is Serval's own layer 3 protocol designed for secure mesh networking. It is completely independent of Internet protocols such as IP and UDP, but for the time being is implemented as an “overlay” network based on UDP/IP because that is the interface that Linux and other operating systems provide for sending data over WiFi. However, MDP could easily be implemented directly over a layer 2 data link such as WiFi or Ethernet MAC. MDP uses subscribers' public keys (SID) as source and destination addresses, and has a 32-bit port number analogous to the 16-bit port number used in TCP/IP.

  • The Voice over Mesh Protocol (VoMP) is Serval's own call negotiation and two-way audio streaming protocol used to implement mesh voice calls. It is analogous to SIP/RTS, which is the dominant protocol used to implement Voice over Internet Protocol, but VoMP is designed for the variable and unstable conditions of wireless mesh networks. VoMP's session state model and signalling can handle packet loss, mid-call re-routing and re-connection where SIP would fail. VoMP's audio streaming can encapsulate many codecs and even DTMF (dialpad button) signalling.

  • The Rhizome content distribution service is a storage engine implemented using SQLite and a content-exchange protocol based on MDP and HTTP for the pervasive dissemination of content like images, videos, documents, software upgrades, etc. Each piece of content in Rhizome is called a “bundle”, which has two parts: a manifest that describes the content, and the payload, which is the content itself. Each bundle has its own unique cryptographic identifier that allows any recipient to verify that it has not been tampered with.

  • The MeshMS messaging service is implemented using Rhizome as its transport, with each thread represented as a pair of bundles, one for each direction. At present, the MeshMS logic is implemented in Java within the Serval Mesh Android app, but is planned to be re-implemented in C as part of Serval DNA (see issue #28).

  • Serval Infrastructure services may optionally be deployed on any devices in the mesh to expose external services to mesh subscribers and vice versa (eg, VoIP gateways, SMS satellite links, packetised web), and to overcome scalability limitations of a perfectly decentralised mesh (eg, central telephone directory).

Most of these services are performed by a daemon process called servald. Serval Infrastructure is implemented by a separate daemon called directory_service.

Serval DNA is free software produced by the Serval Project and many contributors. It is licensed to the public under the GNU General Public License version 2. All source code is freely available from the Serval Project's serval-dna Git repository on GitHub.

The copyright in most of the source code in Serval DNA is held by Serval Project Inc., a not-for-profit association incorporated in the state of South Australia in the Commonwealth of Australia for the purpose of developing the Serval mesh software.

The Serval Project will accept contributions from individual developers who have agreed to the Serval Project Developer Agreement - Individual, and from organisations that have agreed to the Serval Project Developer Agreement - Entity.

Download, build and test

Instructions for downloading, building and testing Serval DNA are in INSTALL.md. (If that link is does not work, try INSTALL.md.)

Configure

See doc/Servald-Configuration (alternative link [doc/Servald-Configuration] (/servalproject/serval-dna/blob/master/doc/Servald-Configuration.md)).

More information

The servald executable is a multi-purpose program designed to be invoked directly from the command line and also via JNI from within a Java program. The following command will print a summary of all the operations that servald offers:

$ servald help

Some operations are self-contained, some start and stop the servald daemon process, some communicate with the servald daemon as an MDP client, and others via a two-way pipe called the monitor interface.

For more documentation, see: