Brian Warner
d0ce8694c1
add upload-status objects, to track upload progress
2008-02-12 15:36:05 -07:00
Brian Warner
873dee53e9
test_system: remove the hackish debug_interrupt= attribute magic used to exercise interrupted-upload resumption, instead just make the Uploadable bounce the helper halfway through the upload
2008-02-07 20:15:37 -07:00
Brian Warner
3bd79917b2
test_system.py: remove that ugly debug_stash_RemoteencryptedUploadable hack, now that UploadResults give us a better approach
2008-02-07 17:27:30 -07:00
Brian Warner
c7b10f4498
upload: if we lose the helper, go back to doing direct-to-server uploads instead of causing all subsequent uploads to fail
2008-02-07 17:26:59 -07:00
Brian Warner
b2d31f0a8a
upload.EncryptAnUploadable: use 50KiB read chunks (instead of 50KB), to match the chunksize requested by the upload helper
2008-02-07 17:10:13 -07:00
Brian Warner
da9610e90a
change encryption-key hash to include encoding parameters. This is a minor compatibility break: CHK files encoded (with convergence) before and after this will have different keys and ciphertexts. Also switched to SHA-256d for both the data-to-key hash and the key-to-storageindex hash
2008-02-06 19:50:47 -07:00
Brian Warner
81c5ceae16
upload: rework passing of default encoding parameters: move more responsibility into BaseUploadable
2008-02-06 18:39:03 -07:00
Brian Warner
75e4332462
offloaded: oops, need more tricks to make the unit tests pass
2008-02-06 17:51:11 -07:00
Brian Warner
a2cace9cfb
helper: return full uri-extension data to the client, so it can compare encoding parameters
2008-02-06 17:30:58 -07:00
Brian Warner
652d50d7e0
UploadResults: add more helper timing stats (ciphertext fetch times)
2008-02-06 02:12:35 -07:00
Brian Warner
124fb5ecdf
add upload-results timing info for helper uploads. This changes the Helper protocol, and introduces a compatibility break
2008-02-06 01:52:25 -07:00
Brian Warner
93d45abb02
add upload timings and rates to the POST /uri?t=upload results page
2008-02-06 00:41:51 -07:00
Brian Warner
66f33ee504
upload: return an UploadResults instance (with .uri) instead of just a URI
2008-02-05 21:01:38 -07:00
Brian Warner
d98fde952c
introducer: remove remaining bits of 'push-to-myself' flags. The uploading/downloading node is no longer special.
2008-02-05 14:16:01 -07:00
Brian Warner
daecca6589
big introducer refactoring: separate publish+subscribe. Addresses #271 .
2008-02-05 13:05:13 -07:00
Zooko O'Whielacronx
1d1628e525
rename storage_index_chk_hash() to storage_index_hash() and add TODO about how our use of it now includes keys that are not CHKs
2008-02-01 12:27:37 -07:00
Brian Warner
909d848071
remove upload.upload_(data,filename,filehandle) convenience functions
2008-01-30 19:03:19 -07:00
Brian Warner
44ff4c6605
upload: Data should use convergence by default
2008-01-30 19:02:56 -07:00
Zooko O'Whielacronx
ca971559e6
make content-hash-key encryption a parameter of uploading
...
fixes #293
2008-01-30 12:24:50 -07:00
Brian Warner
c2c922b5e9
upload: add log message when AssistedUploader is done
2008-01-29 17:38:12 -07:00
Brian Warner
c6c5a37d3f
upload: fix 'skipping_ahead' log message
2008-01-28 19:13:36 -07:00
Brian Warner
8063aa8b86
WriteBucketProxy: improve __repr__
2008-01-28 18:53:51 -07:00
Brian Warner
aa3b509323
upload.py: the 'skipping encryption' message was emitted exactly backwards
2008-01-28 18:38:38 -07:00
Brian Warner
8485ff53fc
display the Helper FURL and our connection status on the welcome page. Closes #285 .
2008-01-28 13:56:22 -07:00
Brian Warner
09a99ce822
offloaded upload: avoid tail-recursion problem that would break large files
2008-01-24 21:51:34 -07:00
Brian Warner
46fe024612
offloaded uploader: don't use a huge amount of memory when skipping over previously-uploaded data
2008-01-24 17:25:33 -07:00
Brian Warner
e9307d3fda
offloaded: close the local filehandle after encoding is done, otherwise windows fails
2008-01-17 01:52:33 -07:00
Brian Warner
6b08c28f5d
upload.py: make it easier to have an IUploadable that overrides encoding parameters: just set an attribute instead of subclassing
2008-01-17 01:17:42 -07:00
Brian Warner
812383a369
offloaded: upload.py: handle forward skips, to allow resumed uploads to send less than all the data. We still read all the data (to hash it, 'paranoid mode'), but we don't send it over the wire
2008-01-17 01:16:56 -07:00
Brian Warner
c597e67c2b
offloaded: improve logging across the board
2008-01-17 01:11:35 -07:00
Brian Warner
51321944f0
megapatch: overhaul encoding_parameters handling: now it comes from the Uploadable, or the Client. Removed options= too. Also move helper towards resumability.
2008-01-16 03:03:35 -07:00
Brian Warner
a6ca98ac53
upload: add Encoder.abort(), to abandon the upload in progress. Add some debug hooks to enable unit tests.
2008-01-14 21:22:55 -07:00
Brian Warner
60090fb9f2
upload: improve logging
2008-01-14 21:19:20 -07:00
Brian Warner
e65967da49
upload: pass options through to the encoder
2008-01-14 21:17:32 -07:00
Brian Warner
7ac2b94aba
remove wait_for_numpeers and the when_enough_peers call in mutable.Publish
2008-01-14 14:55:59 -07:00
Brian Warner
964edadf44
offloaded: add a system test, make it pass. files are now being uploaded through the helper.
2008-01-11 05:42:55 -07:00
Brian Warner
6ac01fde4c
offloaded: more test coverage on client side, change interfaces a bit
2008-01-11 04:53:37 -07:00
Brian Warner
e825406fc2
offloaded: move interfaces to interfaces.py, start implementing backend
2008-01-09 21:25:47 -07:00
Brian Warner
d2f4aff9c2
upload.py: start removing wait_for_numpeers code
2008-01-09 21:25:18 -07:00
Brian Warner
da7778774b
offloaded: basic test for client-side of AssistedUploader
2008-01-09 20:25:50 -07:00
Brian Warner
ea24864544
offloaded: more code, fix pyflakes problems, change IEncryptedUploader a bit
2008-01-09 17:58:47 -07:00
Brian Warner
db71bdae9c
offloaded: early code: most of client-side, defined the RemoteInterfaces
2008-01-08 21:18:54 -07:00
Zooko O'Whielacronx
05b04d2b90
fix representation of node ids in PeerTracker objects
2007-12-19 17:55:28 -07:00
Brian Warner
0bf5a762a9
use AES from pycryptopp instead of pycrypto, also truncate the keys slightly differently
2007-12-03 17:27:46 -07:00
Brian Warner
33a5f8ba6b
more hierarchical logging: download/upload/encode
2007-11-19 19:33:41 -07:00
Zooko O'Whielacronx
59d6c3c822
decentralized directories: integration and testing
...
* use new decentralized directories everywhere instead of old centralized directories
* provide UI to them through the web server
* provide UI to them through the CLI
* update unit tests to simulate decentralized mutable directories in order to test other components that rely on them
* remove the notion of a "vdrive server" and a client thereof
* remove the notion of a "public vdrive", which was a directory that was centrally published/subscribed automatically by the tahoe node (you can accomplish this manually by making a directory and posting the URL to it on your web site, for example)
* add a notion of "wait_for_numpeers" when you need to publish data to peers, which is how many peers should be attached before you start. The default is 1.
* add __repr__ for filesystem nodes (note: these reprs contain a few bits of the secret key!)
* fix a few bugs where we used to equate "mutable" with "not read-only". Nowadays all directories are mutable, but some might be read-only (to you).
* fix a few bugs where code wasn't aware of the new general-purpose metadata dict the comes with each filesystem edge
* sundry fixes to unit tests to adjust to the new directories, e.g. don't assume that every share on disk belongs to a chk file.
2007-12-03 14:52:42 -07:00
Brian Warner
828e2734e6
trailing-whitespace eradication, no functional changes
2007-11-01 15:22:47 -07:00
Brian Warner
9c9a793540
upload.py: fix signature of NonConvergentUploadMixin.get_encryption_key
2007-09-18 23:38:11 -07:00
Brian Warner
808f851589
upload: make peer-selection a bit more uniform. Closes #132 .
2007-09-16 17:08:34 -07:00
Brian Warner
24e6ccddce
peer-selection: if we must loop, send a minimal number of queries (by asking for more than one share per peer on the second pass)
2007-09-16 01:53:00 -07:00
