Jeremy Lakeman
73786bcb5d
Refactor all rhizome reading and writing
...
- The API in rhizome_store.c is used for all reading and writing
- external storage is now usable for all transport options
2013-02-20 16:18:59 +10:30
gardners
5a3dec28d9
make rhizome over mdp idle timeout configurable at runtime.
2013-02-20 16:18:57 +10:30
gardners
a23612428b
make rhizome over mdp block size configurable.
...
1K seems too big to be reliable on our prototype UHF radio links,
as CRCs fail almost all the time. #48
2013-02-20 16:18:57 +10:30
gardners
2252fdcaa7
created tool for automatically finding IN()s without matching
...
OUT()s or where return() is used instead of RETURN().
Added OUT() to end of all functions using IN() that lacked it to
make it easier to statically analyse this invariant.
Fixed several return instead of RETURNs detected through use of
this tool. #49
2013-02-20 16:18:56 +10:30
gardners
641d749ab4
Create files for large rhizome bundles
...
- configurable size threashold
2013-02-20 15:36:32 +10:30
gardners
0ac403717d
improve rhizome mdp re-request timeout handling so that it doesn't
...
do amazingly bad things on low-bandwidth packet radio links.
2013-02-20 15:36:31 +10:30
gardners
34bf9127a1
make rhizome transfer timeouts consistent.
2013-02-20 15:36:31 +10:30
gardners
f465f3a9ee
Add lots of profiling to assist in debugging
...
- made some debug output conditional.
- make it possible to debug slip decoding without getting swamped by other output.
- Improve reporting of unnamed schedule() calls.
- always collect performance statistics, and report on any excess
use (>1sec in every 3), even if debug.timing is not enabled.
- include file size information in Rhizome transfer messages.
- reduce output when debug.rhizome_rx is set.
2013-02-20 15:36:30 +10:30
gardners
e551017896
push profiling down deeper into rhizome_fetch_poll()'s children.
2013-02-20 15:36:29 +10:30
gardners
17ea1b69b3
don't look at all BARs if we are too slow.
2013-02-20 15:36:29 +10:30
gardners
f114e6d19e
add progress data for each rhizome transfer.
2013-02-20 15:36:28 +10:30
gardners
3bd4c49af5
add more info to /rssi http page.
2013-02-20 15:36:27 +10:30
Jeremy Lakeman
ca5eb7d8bb
Reinstate simple slip code, improve debug messages
2013-02-20 15:36:27 +10:30
Jeremy Lakeman
e4d6520c46
Don't request manifests that are already in the fetch queue
2013-02-20 15:36:25 +10:30
Jeremy Lakeman
6d9bbe2e2c
Refactor interface handling to separate encapsulation from stream type
2013-02-20 15:36:23 +10:30
Jeremy Lakeman
ba1800012e
Only advertise BAR's on an alarm
...
- we no longer hit the database for every outgoing packet, attempting to announce bundles
- we no longer advertise manifests periodically
- when an interesting bar arrives, we ask for the manifest to be announced, which uses the existing packet format
2013-02-20 15:36:23 +10:30
Jeremy Lakeman
84ad4debfa
Throttle serial radio devices when tx buffer is in use
2013-02-20 15:36:22 +10:30
Jeremy Lakeman
2967d1e00f
Don't check for duplicates if an existing id has been supplied
2013-01-03 11:18:30 +10:30
Jeremy Lakeman
a492c05d64
Re-add database cleanup
2012-12-31 15:09:12 +10:30
Jeremy Lakeman
3f45623d04
New stress test, rhizome add while transferring
2012-12-27 16:51:31 +10:30
Jeremy Lakeman
0f81c1f641
Minor code cleanup
2012-12-14 17:07:28 +10:30
Jeremy Lakeman
4264dec978
Reduce logging
2012-12-12 13:18:19 +10:30
Jeremy Lakeman
1a26a3e452
Reduce log spam
2012-12-12 10:02:43 +10:30
Andrew Bettison
5985df751d
Overhaul debug flags
...
Replace debugflags_t and DEBUG_XXX bit masks with config schema "debug.xxx"
entries.
No more support for "debug.all".
2012-12-11 15:59:46 +10:30
Jeremy Lakeman
4b73e42bed
Merge remote-tracking branch 'origin/master' into rhizomeovermdp
...
Conflicts:
rhizome_fetch.c
2012-12-06 13:27:04 +10:30
Jeremy Lakeman
59babd75a2
Fix SEGV if connect fails immediately
2012-12-06 10:35:20 +10:30
gardners
e8cfac1462
don't try mdp fall back when performing an http rhizome direct transfer.
2012-12-06 09:42:27 +10:30
gardners
e2cf0ff506
fixed bug with rhizome direct sync manifest fetching.
2012-12-06 09:31:41 +10:30
gardners
5416e4baca
fixed bugs that were preventing writing to database blob from
...
buffer. Increased maximum buffer size to useful size.
2012-12-04 17:26:47 +10:30
gardners
39f99da3f2
fixing various bugs with rhizome streaming to database.
2012-12-04 17:18:31 +10:30
Jeremy Lakeman
6a5efcc445
Remove buggy debug code
2012-12-04 16:50:27 +10:30
gardners
f827c7c1c8
fixed various problems following split of files into fileblobs
2012-12-04 16:47:45 +10:30
Jeremy Lakeman
33e44ed6be
Don't unwatch if the file descriptor is already closed
2012-12-04 16:30:01 +10:30
gardners
6dfe654ab0
adjusted tuning of Rhizome over MDP to use 32x1KB packets for
...
better throughput. Still sub-optimal for wired ethernet type
interfaces, but should be ok for WiFi where max broadcast throughput
is 100kb/sec.
2012-12-04 16:19:22 +10:30
Jeremy Lakeman
bd83c192bb
Use consistent length constant
2012-12-04 16:18:51 +10:30
gardners
fc0c134cbf
added speed indication on completion of rhizome transfer.
...
split files table into files and fileblobs to avoid pathological
delays when updating datavalid flag in files table (sqlite copies
the whole table row, including possibly large blob).
2012-12-04 16:03:56 +10:30
gardners
23cace8455
removed writing temporary file for debugging.
2012-12-04 13:49:47 +10:30
gardners
2e4e111764
fixed bug that prevented remaining rhizome tests from passing.
2012-12-04 08:50:00 +10:30
gardners
a7e09aac2c
fixed scheduling bug that stopped rhizomeprotocol tests 1 and 3.
2012-12-04 08:30:58 +10:30
gardners
254b0a4fd6
fixed problem with rhizome over http (alarm without callback
...
specified).
2012-12-04 07:12:03 +10:30
gardners
fcd5142aaf
fixed bug with streaming to database of rhizome fetches.
2012-12-04 06:56:10 +10:30
gardners
abcac03981
work on tracking down hash calculation bug for files > one
...
window long.
2012-12-04 06:26:44 +10:30
gardners
43316ade3a
added buffer when streaming to database so that we don't waste
...
most of our time opening and closing blobs, and don't have to keep
the blob open all the time.
2012-12-03 21:47:02 +10:30
gardners
de7a4ce2e3
fixed bugs with rhizome streaming direct to database.
...
that now works, but rhizome direct pull now fails.
2012-12-03 20:51:14 +10:30
gardners
e108fe0822
fixed bug in handling of sqlite3_blob_write(). Still more to fix.
2012-12-03 17:10:39 +10:30
gardners
5d24ba7db9
first cut at progressive hashing and checking of hash when streaming
...
file into database via rhizome.
2012-12-03 17:05:12 +10:30
gardners
e08593b466
stream manifest to buffer, and files to blob in database instead
...
of via files.
NOT COMPLETE - needs to calculate progressive hash and decide
if file is ok at end of import.
2012-12-03 16:52:08 +10:30
gardners
7ec695c940
feedback from code review by Jeremy.
...
Some preparation for out-of-order handling.
Consolidated redundantly redundant fields in fetch slot structure.
Probably fixed spurious alarm bug.
2012-12-03 11:50:35 +10:30
gardners
115736f0a4
cleaned out excess debugging messages and upped block size from
...
200 bytes to 1KB to greatly improve throughput. Will eventually
want to make block size selection be based on network interface.
2012-12-01 10:52:08 +10:30
gardners
b7ae55c143
receiving multiple bundles via rhizome over mdp works now, although
...
there is a bug with alarms being called on fetch slots after they
complete, even though they apparently get unscheduled.
2012-12-01 10:47:19 +10:30
