Commit Graph

15241 Commits

Author SHA1 Message Date
Brian Warner
c868f77c71 encode_new.py: recent Foolscap accepts 'None' as a constraint 2007-01-16 19:56:30 -07:00
Brian Warner
3fb37ae246 webish: more verifierid-to-uri transition 2007-01-16 19:55:53 -07:00
Brian Warner
43f32e8c9b vdrive/webish: finish verifierid/uri transition 2007-01-16 19:43:13 -07:00
Brian Warner
453f0b47e4 upload: fix typo in debug messages 2007-01-16 19:42:28 -07:00
Brian Warner
ccdc2622d4 upload: rearrange peer-selection code to be more readable, and fix a silly bug 2007-01-16 19:35:12 -07:00
Brian Warner
460ed84562 oops, fix that NotEnoughPeersError instrumentation 2007-01-16 19:07:23 -07:00
Brian Warner
fed539a16d add better error reporting to NotEnoughPeersError 2007-01-16 18:47:52 -07:00
Brian Warner
8d4d2c82c4 change upload to push 2 shares instead of 3
Now that peers can talk to themselves, the 5-node system test won't fail
just because one of the shares was hosted on the downloader (and thus
inaccessible until recently). The 3-share push was there to avoid this
problem.
2007-01-16 15:15:26 -07:00
Brian Warner
56cf2dbd7e now that foolscap-0.0.7 accepts connect-to-self, allow peers to know about themselves. We now require foolscap-0.0.7 2007-01-16 15:12:49 -07:00
Brian Warner
2150ac0e53 hush pyflakes warnings 2007-01-15 21:31:10 -07:00
Brian Warner
3209fd5e09 rearrange encode/upload, add URIs, switch to ReplicatingEncoder
Added metadata to the bucket store, which is used to hold the share number
(but the bucket doesn't know that, it just gets a string).

Modified the codec interfaces a bit.

Try to pass around URIs to/from download/upload instead of verifierids.
URI format is still in flux.

Change the current (primitive) file encoder to use a ReplicatingEncoder
because it provides ICodecEncoder. We will be moving to the (less primitive)
file encoder (currently in allmydata.encode_new) eventually, but for now
this change lets us test out PyRS or zooko's upcoming C-based RS codec in
something larger than a single unit test. This primitive file encoder only
uses a single segment, and has no merkle trees.

Also added allmydata.util.deferredutil for a DeferredList wrapper that
errbacks (but only when all component Deferreds have fired) if there were
any errors, which unfortunately is not a behavior available from the standard
DeferredList.
2007-01-15 21:22:22 -07:00
Brian Warner
78a9e815c5 add simple metadata (a single string) to the storage protocol 2007-01-15 14:01:22 -07:00
Brian Warner
e29032bc36 change IEncoder to ICodecEncoder, to match the previous change 2007-01-11 20:57:14 -07:00
Brian Warner
417c17755b use the word 'codec' for erasure coding, for now. 'encode' is used for file-level segmentation/hashing 2007-01-11 20:51:27 -07:00
Brian Warner
a65608fec1 sendOnly: oops, I keep forgetting that you can't really use f.trap in a lambda, because it returns the failure it trapped 2007-01-09 21:13:05 -07:00
Brian Warner
ceda350892 test_system.py: exercise queen.Roster._lost_node too 2007-01-09 19:40:36 -07:00
Brian Warner
aad0a9dfac workqueue: more tests 2007-01-09 01:58:50 -07:00
Brian Warner
d61c0a6ef6 workqueue: more tests, coverage now at 63.4%, yay 2007-01-09 01:36:12 -07:00
Brian Warner
b641f6cbc7 workqueue: more improvements, more tests 2007-01-08 22:29:42 -07:00
Brian Warner
b9edb02820 workqueue: start adding tests 2007-01-08 21:29:33 -07:00
Brian Warner
aefe54574f figleaf.el: when converting to the elisp-readable format, use our in-tree version of figleaf rather than one found on the system. Also change the keybinding to toggle annotations to C-cC-a, which is easier to type 2007-01-08 21:29:03 -07:00
Brian Warner
4311b68420 figleaf: delete coverage file (.figleaf) before each test run, otherwise I suspect coverage data will accumulate from one test run to the next 2007-01-08 21:28:08 -07:00
Brian Warner
2567a26519 rename the new filetable code to 'filetree', since robk astutely pointed out that 'table' is misleading and implies a flat list of files in a single directory 2007-01-08 16:29:14 -07:00
Brian Warner
322b6738f0 figleaf.el: add some emacs22 comments 2007-01-07 13:10:15 -07:00
Brian Warner
4ea70b2524 Makefile: add a default target to just build the tree 2007-01-07 13:09:37 -07:00
Brian Warner
5a34753cdb fix pyflakes warning in debugshell, by providing a dummy value for 'app' that will be overwritten when the manhole connection is established 2007-01-05 21:15:59 -07:00
Brian Warner
9382d61208 use absolute import of 'allmydata.Crypto' rather than a relative import of just 'Crypto', to make it clear that we're using our own form rather than relying upon the system version 2007-01-05 21:12:26 -07:00
Brian Warner
94b1840295 workqueue: fix pyflakes warnings, code is still quite incomplete 2007-01-05 21:11:19 -07:00
Brian Warner
3252f2c317 debian: give incrementing version numbers to .deb packages, using timestamps 2007-01-05 20:06:51 -07:00
Brian Warner
2566452091 test_encode_share.py: fix some pyflakes warnings 2007-01-05 18:53:22 -07:00
Brian Warner
4ba6f47d2c add some (disabled) encoder benchmarking code 2007-01-05 18:46:03 -07:00
Brian Warner
cf04073e98 change Encoder to use py_ecc, now that it works 2007-01-05 18:12:45 -07:00
Brian Warner
42c0d2e336 disable figleaf tracing during py_ecc, since it takes *forever*, especially on the slow buildslave 2007-01-05 18:12:04 -07:00
Brian Warner
3d3a7a5b8d encode.py: add some timing comments 2007-01-05 00:48:42 -07:00
Brian Warner
409d92e746 only run a single (short) py_ecc test on slave3, since it is so slow the tests timeout 2007-01-05 00:42:52 -07:00
Brian Warner
e1c6ee9dcf encoding: fix the last py_ecc problem, tests pass now 2007-01-05 00:06:42 -07:00
Brian Warner
436409fa4d change encode_new to use IEncoder 2007-01-04 23:51:35 -07:00
Brian Warner
c91d14dca8 fix our use of py_ecc (set log2FieldSize=8 explicitly) 2007-01-04 23:50:21 -07:00
Brian Warner
f31fc06d89 establish IEncoder/IDecoder, create suitable interfaces for both the simple replicating encoder and the py_ecc one, add a (failing) unit test for it 2007-01-04 21:52:51 -07:00
Brian Warner
6d1ba16ef3 figleaf.el: announce annotation/deannotation 2007-01-04 21:52:40 -07:00
Brian Warner
fa11c3f722 more pyflakes cleanups 2007-01-04 18:06:20 -07:00
Brian Warner
6587645f76 fix pyflakes warnings in figleaf 2007-01-04 18:04:43 -07:00
Zooko O'Whielacronx
5ad6c43622 add padding to segments and convert type from string to list of integers before passing to py_ecc
But then I get an error that I don't understand about ECC math...
2007-01-04 17:58:14 -07:00
Brian Warner
7b2268ab39 improve figleaf: fix some line-numbering bugs, add an alphabetically-sorted index HTML page 2007-01-04 01:26:43 -07:00
Brian Warner
0fd032956d more figleaf emacs work: enable the minor mode, then type C-cA to toggle annotations 2007-01-04 01:25:36 -07:00
Brian Warner
8a78065f16 modify figleaf2html to show module names instead of .py filenames, also add a --root argument to restrict coverage to a specific parent directory 2007-01-03 22:23:25 -07:00
Brian Warner
e8ee3365ef move figleaf2html and figleaf_htmlizer.py into our tree, for easier customization 2007-01-03 22:06:51 -07:00
Brian Warner
f97eec893e figleaf: move a copy into allmydata.util.figleaf, update Makefile/trial stuff 2007-01-03 21:38:29 -07:00
Brian Warner
e68118736c add some experimental emacs test-coverage-annotation tools, still in development 2007-01-01 23:48:42 -07:00
Brian Warner
e600571f82 checkpoint work-in-progress for WorkQueue, a disk-persistent list of work to be done 2007-01-01 23:47:16 -07:00