Commit Graph

77 Commits

Author SHA1 Message Date
Brian Warner
76e28b3484 comment out some verbose log messages, add commented-out new ones 2007-04-17 20:25:52 -07:00
Brian Warner
2e15c9aed2 system_test: exercise multiple segments 2007-04-17 13:40:47 -07:00
Brian Warner
ff8cb4d32e encode: make MAX_SEGMENT_SIZE controllable, to support tests which force the use of multiple segments. Also, remove not-very-useful upload-side debug messages 2007-04-16 19:29:57 -07:00
Brian Warner
97a40bf20f encode/upload: add more logging, to understand the test failure on a slow buildslave 2007-04-06 15:45:45 -07:00
Brian Warner
919ca3e902 rename encode_new.py to encode.py, now that there isn't an old one anymore 2007-04-05 21:17:42 -07:00
Brian Warner
466bb46abe handle foolscap's annoying tendency to turn everything into a sets.Set, which are not interoperable with 2.4's builtin 'set' type 2007-03-30 16:55:04 -07:00
Brian Warner
7cd9ef3bbf finish making the new encoder/decoder/upload/download work 2007-03-30 16:50:50 -07:00
Zooko O'Whielacronx
3d694a90f3 add unit tests and fix bugs in upload 2007-03-30 14:54:33 -07:00
Brian Warner
f5a49aa7ee upload: change _compute_uri a bit, get infile in a different way 2007-03-30 12:30:14 -07:00
Brian Warner
9a2e0cf28e switch upload to use encode_new, fix a few things (but not nearly all of them) 2007-03-30 11:53:03 -07:00
Zooko O'Whielacronx
f4a718c5b6 finish storage server and write new download 2007-03-30 10:52:19 -07:00
Zooko O'Whielacronx
17299fc96e new upload and storage server 2007-03-29 20:19:52 -07:00
Zooko O'Whielacronx
81c8cb6d6a switch to pyfec 2007-03-28 00:05:16 -07:00
Zooko O'Whielacronx
e4463056f3 fix test_codec and test_upload to handle current API 2007-03-27 22:57:15 -07:00
Zooko O'Whielacronx
dd4ad3d542 use pyfec instead of py_ecc for erasure coding and update API to codec 2007-02-01 16:07:00 -07:00
Brian Warner
430b3a03fc move upload/download interfaces to allmydata.interfaces, let SubTreeMaker assert IDownloader-ness of its 'downloader' argument 2007-01-21 15:01:34 -07:00
Brian Warner
b61a4ff371 more filetree, it's actually starting to make sense now 2007-01-20 14:41:51 -07:00
Brian Warner
ff6b09d973 snapshot filetree work: it's getting close 2007-01-19 02:23:03 -07:00
Brian Warner
4101bcf218 update URI format, include codec name 2007-01-16 21:29:59 -07:00
Brian Warner
453f0b47e4 upload: fix typo in debug messages 2007-01-16 19:42:28 -07:00
Brian Warner
ccdc2622d4 upload: rearrange peer-selection code to be more readable, and fix a silly bug 2007-01-16 19:35:12 -07:00
Brian Warner
460ed84562 oops, fix that NotEnoughPeersError instrumentation 2007-01-16 19:07:23 -07:00
Brian Warner
fed539a16d add better error reporting to NotEnoughPeersError 2007-01-16 18:47:52 -07:00
Brian Warner
8d4d2c82c4 change upload to push 2 shares instead of 3
Now that peers can talk to themselves, the 5-node system test won't fail
just because one of the shares was hosted on the downloader (and thus
inaccessible until recently). The 3-share push was there to avoid this
problem.
2007-01-16 15:15:26 -07:00
Brian Warner
3209fd5e09 rearrange encode/upload, add URIs, switch to ReplicatingEncoder
Added metadata to the bucket store, which is used to hold the share number
(but the bucket doesn't know that, it just gets a string).

Modified the codec interfaces a bit.

Try to pass around URIs to/from download/upload instead of verifierids.
URI format is still in flux.

Change the current (primitive) file encoder to use a ReplicatingEncoder
because it provides ICodecEncoder. We will be moving to the (less primitive)
file encoder (currently in allmydata.encode_new) eventually, but for now
this change lets us test out PyRS or zooko's upcoming C-based RS codec in
something larger than a single unit test. This primitive file encoder only
uses a single segment, and has no merkle trees.

Also added allmydata.util.deferredutil for a DeferredList wrapper that
errbacks (but only when all component Deferreds have fired) if there were
any errors, which unfortunately is not a behavior available from the standard
DeferredList.
2007-01-15 21:22:22 -07:00
Brian Warner
417c17755b use the word 'codec' for erasure coding, for now. 'encode' is used for file-level segmentation/hashing 2007-01-11 20:51:27 -07:00
Brian Warner
3490378551 move all packages into src/, fix allmydata.Crypto build. Now you must perform a 'setup.py build' before using anything, and you must add the build directory (build/lib.linux-i686-2.4) to your PYTHONPATH before doing anything 2006-12-14 03:39:50 -07:00