Brian Warner
4b2298937b
use real encryption, generate/store/verify verifierid and fileid
2007-04-25 17:53:10 -07:00
Brian Warner
76e28b3484
comment out some verbose log messages, add commented-out new ones
2007-04-17 20:25:52 -07:00
Brian Warner
2e15c9aed2
system_test: exercise multiple segments
2007-04-17 13:40:47 -07:00
Brian Warner
ff8cb4d32e
encode: make MAX_SEGMENT_SIZE controllable, to support tests which force the use of multiple segments. Also, remove not-very-useful upload-side debug messages
2007-04-16 19:29:57 -07:00
Brian Warner
97a40bf20f
encode/upload: add more logging, to understand the test failure on a slow buildslave
2007-04-06 15:45:45 -07:00
Brian Warner
919ca3e902
rename encode_new.py to encode.py, now that there isn't an old one anymore
2007-04-05 21:17:42 -07:00
Brian Warner
466bb46abe
handle foolscap's annoying tendency to turn everything into a sets.Set, which are not interoperable with 2.4's builtin 'set' type
2007-03-30 16:55:04 -07:00
Brian Warner
7cd9ef3bbf
finish making the new encoder/decoder/upload/download work
2007-03-30 16:50:50 -07:00
Zooko O'Whielacronx
3d694a90f3
add unit tests and fix bugs in upload
2007-03-30 14:54:33 -07:00
Brian Warner
f5a49aa7ee
upload: change _compute_uri a bit, get infile in a different way
2007-03-30 12:30:14 -07:00
Brian Warner
9a2e0cf28e
switch upload to use encode_new, fix a few things (but not nearly all of them)
2007-03-30 11:53:03 -07:00
Zooko O'Whielacronx
f4a718c5b6
finish storage server and write new download
2007-03-30 10:52:19 -07:00
Zooko O'Whielacronx
17299fc96e
new upload and storage server
2007-03-29 20:19:52 -07:00
Zooko O'Whielacronx
81c8cb6d6a
switch to pyfec
2007-03-28 00:05:16 -07:00
Zooko O'Whielacronx
e4463056f3
fix test_codec and test_upload to handle current API
2007-03-27 22:57:15 -07:00
Zooko O'Whielacronx
dd4ad3d542
use pyfec instead of py_ecc for erasure coding and update API to codec
2007-02-01 16:07:00 -07:00
Brian Warner
430b3a03fc
move upload/download interfaces to allmydata.interfaces, let SubTreeMaker assert IDownloader-ness of its 'downloader' argument
2007-01-21 15:01:34 -07:00
Brian Warner
b61a4ff371
more filetree, it's actually starting to make sense now
2007-01-20 14:41:51 -07:00
Brian Warner
ff6b09d973
snapshot filetree work: it's getting close
2007-01-19 02:23:03 -07:00
Brian Warner
4101bcf218
update URI format, include codec name
2007-01-16 21:29:59 -07:00
Brian Warner
453f0b47e4
upload: fix typo in debug messages
2007-01-16 19:42:28 -07:00
Brian Warner
ccdc2622d4
upload: rearrange peer-selection code to be more readable, and fix a silly bug
2007-01-16 19:35:12 -07:00
Brian Warner
460ed84562
oops, fix that NotEnoughPeersError instrumentation
2007-01-16 19:07:23 -07:00
Brian Warner
fed539a16d
add better error reporting to NotEnoughPeersError
2007-01-16 18:47:52 -07:00
Brian Warner
8d4d2c82c4
change upload to push 2 shares instead of 3
...
Now that peers can talk to themselves, the 5-node system test won't fail
just because one of the shares was hosted on the downloader (and thus
inaccessible until recently). The 3-share push was there to avoid this
problem.
2007-01-16 15:15:26 -07:00
Brian Warner
3209fd5e09
rearrange encode/upload, add URIs, switch to ReplicatingEncoder
...
Added metadata to the bucket store, which is used to hold the share number
(but the bucket doesn't know that, it just gets a string).
Modified the codec interfaces a bit.
Try to pass around URIs to/from download/upload instead of verifierids.
URI format is still in flux.
Change the current (primitive) file encoder to use a ReplicatingEncoder
because it provides ICodecEncoder. We will be moving to the (less primitive)
file encoder (currently in allmydata.encode_new) eventually, but for now
this change lets us test out PyRS or zooko's upcoming C-based RS codec in
something larger than a single unit test. This primitive file encoder only
uses a single segment, and has no merkle trees.
Also added allmydata.util.deferredutil for a DeferredList wrapper that
errbacks (but only when all component Deferreds have fired) if there were
any errors, which unfortunately is not a behavior available from the standard
DeferredList.
2007-01-15 21:22:22 -07:00
Brian Warner
417c17755b
use the word 'codec' for erasure coding, for now. 'encode' is used for file-level segmentation/hashing
2007-01-11 20:51:27 -07:00
Brian Warner
3490378551
move all packages into src/, fix allmydata.Crypto build. Now you must perform a 'setup.py build' before using anything, and you must add the build directory (build/lib.linux-i686-2.4) to your PYTHONPATH before doing anything
2006-12-14 03:39:50 -07:00
