Brian Warner
2f5fb51848
download: validate handling of missing sharehashes too
2007-04-16 17:15:44 -07:00
Brian Warner
a5a30d6bee
iputil.py: remove unused import
2007-04-16 17:08:00 -07:00
Brian Warner
42179e5ae2
download: verify that bad blocks or hashes are caught by the download process
2007-04-16 16:30:21 -07:00
Zooko O'Whielacronx
5b3e923093
storageserver: ignore files in verifierdir whose filenames aren't of the right form for shares
2007-04-18 07:41:56 -07:00
Zooko O'Whielacronx
f4de079ba0
pyutil: iputil: fix netbsd, irix, sunos
2007-04-18 07:40:26 -07:00
Brian Warner
281a0d376c
test_system: bump up timeout again, the new extra download forms take more time on poor overloaded slave1
2007-04-16 15:53:25 -07:00
Brian Warner
88a7fdcaab
test_iputil: improve error message
2007-04-16 15:05:25 -07:00
Brian Warner
2fef5dac1f
download: log more information when hashtree checks fail
2007-04-16 13:08:19 -07:00
Brian Warner
7dabb68a51
download: improve test coverage on our IDownloadTarget classes, make FileHandle return the filehandle when its done so that it is easier to close
2007-04-16 13:07:36 -07:00
Brian Warner
1a6da72861
don't include test code itself in the test-coverage numbers
2007-04-16 12:32:45 -07:00
Brian Warner
2d832efa64
fec: add test for mathutil
2007-04-16 12:01:58 -07:00
Brian Warner
8e9d090bdb
fec: remove unused mathutil.linear_fit_slope
2007-04-16 11:51:36 -07:00
Brian Warner
8aa2694595
fec.util.mathutil.permute: fix docstring
2007-04-16 11:51:04 -07:00
Brian Warner
652e8a735f
interfaces: use explicit TupleOf and ChoiceOf constraints, since the upcoming version of Foolscap changes the meaning of bare tuples (from ChoiceOf to TupleOf)
2007-04-13 19:04:38 -07:00
Brian Warner
03fbee6ade
encode.py: remove an unused import
2007-04-12 20:09:32 -07:00
Brian Warner
0ecb26ec44
test_hashtree.py: get full coverage for hashtree.py
2007-04-12 19:58:13 -07:00
Brian Warner
30133a7cdf
hash trees: further cleanup, to make sure we're validating the right thing
...
hashtree.py: improve the methods available for finding out which hash nodes
are needed. Change set_hashes() to require that every hash provided can
be validated up to the root.
download.py: validate from the top down, including the URI-derived roothash
in the share hash tree, and stashing the thus-validated share hash for use
in the block hash tree.
2007-04-12 19:41:48 -07:00
Brian Warner
d351cd7674
download: always validate the blockhash, and don't let the bucket trick us into not validating hashes
2007-04-12 15:18:46 -07:00
Brian Warner
2e314ad47f
hashtree.py: reindent from 2-spaces to 4-spaces. No functional changes.
2007-04-12 14:24:11 -07:00
Brian Warner
d8215e0c6f
rename chunk.py to hashtree.py
2007-04-12 13:13:25 -07:00
Brian Warner
8f58b30db9
verify hash chains on incoming blocks
...
Implement enough of chunk.IncompleteHashTree to be usable.
Rearrange download: all block/hash requests now go through
a ValidatedBucket instance, which is responsible for retrieving
and verifying hashes before providing validated data. Download
was changed to use ValidatedBuckets everywhere instead of
unwrapped RIBucketReader references.
2007-04-12 13:07:40 -07:00
Zooko O'Whielacronx
234951041f
oops -- the previous commit of iputil wasn't the right version
...
Too bad synchronizing pyutil and allmydata.util includes a manual step.
2007-04-16 15:12:01 -07:00
Zooko O'Whielacronx
ac4d23d336
port iputil to Windows (and Irix, and NetBSD, and Solaris 2, ...)
2007-04-16 14:59:13 -07:00
Zooko O'Whielacronx
0f54468f66
pyfec: bump version number to 1.0.0a1-2-STABLE
2007-04-15 12:08:12 -07:00
Zooko O'Whielacronx
278f9ad5c9
pyfec: add mention of sha256sum to README
2007-04-15 12:07:35 -07:00
Zooko O'Whielacronx
b4e25737ff
pyfec: bump the performance measurement bragging up higher in the README
2007-04-14 18:03:54 -07:00
Zooko O'Whielacronx
625f230954
pyfec: bump version number to 1.0.0a1-1-STABLE
2007-04-14 17:50:40 -07:00
Zooko O'Whielacronx
2d9f728e27
pyfec: add -f option to fec, add more user-friendly handling of filesystem errors and user errors
2007-04-14 17:48:32 -07:00
Zooko O'Whielacronx
502c979307
pyfec: add bragging about how fec is way faster than "par2"
2007-04-14 17:47:48 -07:00
Zooko O'Whielacronx
049d8d1576
pyfec: more progress indicators, handling of already-existent outfile
2007-04-14 16:00:59 -07:00
Zooko O'Whielacronx
554be1ba6a
pyfec: argparse: add a feature of exclusivecreate to the argparse FileType
2007-04-14 16:00:33 -07:00
Zooko O'Whielacronx
c5c7605d54
pyfec: argparse: simplify
2007-04-14 15:43:41 -07:00
Zooko O'Whielacronx
7bc14c45ee
pyfec: fix up docs, version numbers, bump version to 1.0.0a1-0-STABLE
2007-04-14 12:54:51 -07:00
Zooko O'Whielacronx
f9b0ea3416
pyfec: update README and bump version number to 0.9.9-0-STABLE
2007-04-14 12:02:18 -07:00
Zooko O'Whielacronx
ee66b02989
pyfec: add bin/fec and bin/unfec, do better handling and reporting of various errors
2007-04-14 12:00:10 -07:00
Zooko O'Whielacronx
7c3b35d286
pyfec: new filefec with compressed metadata, better error handling, much better unit tests
2007-04-14 11:19:24 -07:00
Zooko O'Whielacronx
2bd0a2c3a1
pyfec: import a copy of the argparse module
2007-04-14 11:05:54 -07:00
Zooko O'Whielacronx
7aba6f1dd7
pyfec: import a copy of mathutil.py from the pyutil library
2007-04-14 10:54:43 -07:00
Zooko O'Whielacronx
2d858d8a6d
pyfec: import a copy of fileutil.py from the pyutil library
2007-04-14 10:54:02 -07:00
Zooko O'Whielacronx
89f036c012
pyfec: add easyfec.Decoder(), which is easier to use than fec.Decoder()
2007-04-14 10:52:45 -07:00
Zooko O'Whielacronx
50353b982b
pyfec: tighten internal datatype from int to short and undo attempt to make it unsigned (Python doesn't do unsigned short)
2007-04-14 10:51:48 -07:00
Zooko O'Whielacronx
3a2056a16f
give it a version number -- v0.9
...
I intend to bump it to 1.0 after adding the cmdline tools.
2007-04-11 10:49:33 -07:00
Zooko O'Whielacronx
8a86d3edc3
import Version from pyutil
2007-04-11 10:48:44 -07:00
Zooko O'Whielacronx
c8b1eec75a
merge changes and fix wrong type -- k and m need more than 8 bits (because they are the count rather than the index, i.e. they are 1-indexed)
2007-04-11 10:34:27 -07:00
Zooko O'Whielacronx
1b23579715
pyfec: make unit test failures print out a few useful bytes instead of kibibytes
2007-01-31 19:02:57 -07:00
Zooko O'Whielacronx
18de69456c
pyfec: add variant of randomized test which happens to match the interface to benchutil
2007-01-31 22:55:28 -07:00
Zooko O'Whielacronx
367faeef6a
pyfec: make randomized unit tests more comprehensive
2007-01-31 19:02:24 -07:00
Zooko O'Whielacronx
7b9630d59c
pyfec: tighten internal C types
2007-01-31 13:55:31 -07:00
Zooko O'Whielacronx
10530a25bc
pyfec: fix precondition checks on k and m to actually check the value before coercing it into a smaller type (oops)
2007-01-31 19:01:40 -07:00
Zooko O'Whielacronx
9c50c156dd
pyfec: loosen preconditions -- you can have up to 256 total shares, not up to 255 total shares
2007-01-31 16:53:16 -07:00
