Commit Graph

1025 Commits

Author SHA1 Message Date
Brian Warner
7bb9307871 encode: actually define the UploadAborted exception 2008-01-14 21:27:02 -07:00
Brian Warner
821521cc3e test_storage: fix pyflakes warnings 2008-01-14 21:26:48 -07:00
Brian Warner
9f0ee4b758 test_system: fix pyflakes warnings 2008-01-14 21:26:28 -07:00
Brian Warner
168a8c3b73 offloaded: improve logging, pass through options, get ready for testing interrupted uploads. test_system: add (disabled) interrupted-upload test 2008-01-14 21:24:26 -07:00
Brian Warner
a6ca98ac53 upload: add Encoder.abort(), to abandon the upload in progress. Add some debug hooks to enable unit tests. 2008-01-14 21:22:55 -07:00
Brian Warner
60090fb9f2 upload: improve logging 2008-01-14 21:19:20 -07:00
Brian Warner
e65967da49 upload: pass options through to the encoder 2008-01-14 21:17:32 -07:00
Brian Warner
cb76ed36f9 logging: enable flogging in more places, replace Node.log with flogging 2008-01-14 21:16:58 -07:00
Brian Warner
f664dcb489 testutil.py: hush the new (more strict) pyflakes 2008-01-14 18:27:55 -07:00
Brian Warner
c24a1bbaaa iputil.py: hush the new (more strict) pyflakes 2008-01-14 18:27:43 -07:00
robk-tahoe
d87a80dca6 added is_uri() function to allmydata.uri 2008-01-10 20:43:42 -07:00
Brian Warner
7ac2b94aba remove wait_for_numpeers and the when_enough_peers call in mutable.Publish 2008-01-14 14:55:59 -07:00
Brian Warner
222718f13c test_GET_DIRURL_large: reduce from 400 to 200 children: the test fails to
fail anyways, and 200 ought to be enough to trigger the problem, so 400 is
overkill, and just wastes CPU.
2008-01-14 22:31:41 -07:00
Brian Warner
37b7f136ce 'tahoe dump-cap': accept http:// -prefixed URLs too 2008-01-14 14:12:27 -07:00
Brian Warner
6ca0efeef6 add 'tahoe dump-cap' command, to show storage index, lease secrets, etc 2008-01-14 13:43:25 -07:00
Brian Warner
76ee9cccfe storage: improve logging a bit 2008-01-14 11:58:58 -07:00
Zooko O'Whielacronx
676ded6a7e tests: put back skipped and todo tests
closes #258 -- "put back skipped and todo tests"
2008-01-14 21:02:41 -07:00
Brian Warner
964edadf44 offloaded: add a system test, make it pass. files are now being uploaded through the helper. 2008-01-11 05:42:55 -07:00
Brian Warner
08f9c3f2ab offloaded.py: hush pyflakes 2008-01-11 05:05:14 -07:00
Brian Warner
6ac01fde4c offloaded: more test coverage on client side, change interfaces a bit 2008-01-11 04:53:37 -07:00
Brian Warner
11179bb7d7 test_mutable.py: accomodate changes to mutable.py logging 2008-01-10 22:18:34 -07:00
Brian Warner
689c71f946 mutable.py: log more information during publish, specifically the sharemap, and the reason for an UncoordinatedWriteError 2008-01-10 22:16:23 -07:00
robk-tahoe
198f593cad fix dumb typo in tahoe run 2008-01-10 20:14:00 -07:00
robk-tahoe
0b097ac485 change default node-directory on windows to do registry lookup, not ~/.tahoe 2008-01-10 19:32:18 -07:00
robk-tahoe
fbf6c48ed8 move registry module into allmydata.windows package 2008-01-10 19:03:23 -07:00
robk-tahoe
9ed5533760 added tweaked sibpath implementation
use of twisted.python.util.sibpath to find files relative to modules doesn't
work when those modules are bundled into a library by py2exe.  this provides
an alternative implementation (in allmydata.util.sibpath) which checks for
the existence of the file, and if it is not found, attempts to find it relative
to sys.executable instead.
2008-01-10 15:23:41 -07:00
robk-tahoe
8f4f3bf6cc add 'run' command to tahoe
adds a 'run' commands to bin/tahoe / tahoe.exe
it loads a client node into the tahoe process itself,
running in the base dir specified by --basedir/-C and
defaulting to the current working dir.

it runs synchronously, and the tahoe process blocks until
the reactor is stopped.
2008-01-09 19:54:12 -07:00
robk-tahoe
08f445a562 added a 'repl' command to tahoe.exe
this is probably not of very high utility in the unix case of bin/tahoe
but is useful when working with native builds, e.g. py2exe's tahoe.exe,
to examine and debug the runtime environment, linking problems etc.
2008-01-09 19:19:52 -07:00
robk-tahoe
4e3f089257 tweak running to make node start/stop code optional
add a 'install_node_control' flag to runner.run(), default True
this enables the start/stop node commands
which are not too useful on windows
2008-01-08 19:51:18 -07:00
Zooko O'Whielacronx
69dba9a704 tests: increase the timeout on a test which failed on the overloaded virtual buildslaves 2008-01-11 14:27:54 -07:00
Brian Warner
e825406fc2 offloaded: move interfaces to interfaces.py, start implementing backend 2008-01-09 21:25:47 -07:00
Brian Warner
d2f4aff9c2 upload.py: start removing wait_for_numpeers code 2008-01-09 21:25:18 -07:00
Brian Warner
da7778774b offloaded: basic test for client-side of AssistedUploader 2008-01-09 20:25:50 -07:00
Brian Warner
2ad84eeed8 offloaded: create a Helper if 'run_helper' is non-empty 2008-01-09 20:25:05 -07:00
Brian Warner
0e2ddb00be test_system: slight refactoring to eventually make it easier to configure some nodes with the output of others 2008-01-09 20:23:54 -07:00
Brian Warner
ea24864544 offloaded: more code, fix pyflakes problems, change IEncryptedUploader a bit 2008-01-09 17:58:47 -07:00
Brian Warner
db71bdae9c offloaded: early code: most of client-side, defined the RemoteInterfaces 2008-01-08 21:18:54 -07:00
Brian Warner
d4e9e3b9c4 check_speed.py: re-enable 100x200B and 1x100MB CHK tests 2008-01-08 20:59:48 -07:00
robk-tahoe
3a7c688270 fix webish unit tests by making node.url file optional 2008-01-08 12:36:14 -07:00
Brian Warner
464637605e test_system: assert that BASEDIR/node.url is created properly 2008-01-07 17:46:22 -07:00
robk-tahoe
08c3ee73a2 reinstate creation of node.url files upon startup
a recent purge of the start.html code also took away the logic that wrote
'node.url' into the node root.  this is required for the tahoe cli tool to 
find the node.  this puts back a limited fraction of that code, so that the
node writes out a node.url file upon startup.
2008-01-07 18:04:56 -07:00
Zooko O'Whielacronx
9e2ed2df01 direct the user to docs/write_coordination.html in case of an UncoordinatedWriteError 2008-01-08 11:15:06 -07:00
Brian Warner
d9d1697996 util.log: add levels like UNUSUAL 2008-01-07 17:32:45 -07:00
Brian Warner
083ab7252c mutable: improve logging: mark events with level=log.WEIRD and log.UNUSUAL 2008-01-07 17:09:16 -07:00
Brian Warner
6781e2e1c6 mutable.py: update comment about uncoordinated writes appearing as not-enough-peers(unable to get privkey) errors 2008-01-07 14:48:05 -07:00
Zooko O'Whielacronx
4223f7216d rename "dir-uri" to "dir-cap" 2008-01-08 10:41:27 -07:00
Brian Warner
1dd655c59e remove runtime dependency upon setuptools (which crept into allmydata.get_package_versions) 2008-01-04 20:53:41 -07:00
robk-tahoe
6fa70befd5 added "tahoe webopen" command
taking the same arguments as tahoe ls, it does a webbrowser.open to the page
specified by those args.  hence "tahoe webopen" will open a browser to the
root dir specified in private/root_dir.cap by default.

this might be a good alternative to the start.html page.
2008-01-04 18:34:10 -07:00
Zooko O'Whielacronx
bf14613b6a suppress the skipped and the todo unit tests in order to make unit test results prettier (the install.html instructs users to run the unit tests) 2008-01-04 00:36:18 -07:00
Zooko O'Whielacronx
32d2cc8aba fix test_cli to put the root_dir.cap in the private subdir 2008-01-03 17:48:53 -07:00
Zooko O'Whielacronx
ab4303609d cmdline: give useful error messages about the --dir-uri and ~/.tahoe/private/root_dir.cap 2008-01-03 17:35:35 -07:00
Zooko O'Whielacronx
23961448da a few formatting tidy-ups 2008-01-03 17:14:19 -07:00
Brian Warner
acfb11d26f test_client.py: validate more versioning code 2008-01-03 14:38:24 -07:00
Brian Warner
6a2e5d4aea test_client.py: assert allmydata.__version__ is not unknown 2008-01-03 14:34:59 -07:00
Zooko O'Whielacronx
5995d11a3c remove automatic private dir
* rename my_private_dir.cap to root_dir.cap
 * move it into the private subdir
 * change the cmdline argument "--root-uri=[private]" to "--dir-uri=[root]"
2008-01-03 17:02:05 -07:00
Zooko O'Whielacronx
eb373c0001 add human-encodings of caps, refactor encodings of caps, tighten checks, fix unit tests to use values of the right size 2008-01-03 16:55:43 -07:00
Zooko O'Whielacronx
46db7cf1dc add regexes to idlib to match certain kinds of base32-encoded values 2008-01-03 16:44:46 -07:00
Zooko O'Whielacronx
c066903566 fix idlib.could_be_base32_encoded_l() to accept *only* valid strings 2008-01-03 11:43:11 -07:00
Zooko O'Whielacronx
eae499539d refactor constructing URI objects from strings and add human-encoding of WriteableSSKFileURI 2008-01-02 22:12:15 -07:00
Brian Warner
6b81ebfd8e refactor webish.py slightly, improve the test coverage a bit. One test is marked SKIP pending improvements in webish.py 2007-12-25 03:48:57 -07:00
Brian Warner
fae5de8d0d test_web.py: fix pyflakes error 2007-12-25 01:56:04 -07:00
Brian Warner
0e804da8d9 webish: use get_args() everywhere, put .fields=None in MyRequest 2007-12-25 00:07:04 -07:00
Brian Warner
4ba1af37a6 test_web: more coverage of URIPOSTHandler error cases 2007-12-24 22:49:35 -07:00
Brian Warner
7d311b8dd7 test_web: test POST_upload_no_link against /uri, not /uri/ 2007-12-24 17:55:38 -07:00
Brian Warner
ae760b3ee4 test_web.py: use /uri?t=mkdir instead of /uri/?t=mkdir, and confirm that the redirection target is correct 2007-12-24 17:46:52 -07:00
Brian Warner
47761bde93 webish: factor out queryargs-or-formargs extraction, make /uri?t=mkdir work and redirect to a valid url 2007-12-24 17:26:52 -07:00
Brian Warner
4ce196a9c4 node.py: remove the provoke-logport-furlfile-creation hack now that foolscap-0.2.3 does it for us, and add bridge-twisted-logs 2007-12-24 17:24:40 -07:00
Zooko O'Whielacronx
5e8e2faf5d setup: update doc in __init__.py 2007-12-22 10:46:50 -07:00
Zooko O'Whielacronx
1ac11301a7 setup: finish switching from Tahoe's versions of autoversioning tools to pyutil's versions 2007-12-21 14:42:38 -07:00
Zooko O'Whielacronx
a85a4d71f7 webish: add button to make directories and unit test of it
Unfortunately although it passes the unit tests, it doesn't work, because the unit tests and the implementation use the "encode params into URL" technique but the button uses the "encode params into request body" technique.
2007-12-20 15:31:12 -07:00
Zooko O'Whielacronx
a7361179aa make the unit test of the overwrite button more general 2007-12-20 15:23:07 -07:00
Zooko O'Whielacronx
a4bc623fa5 make the wapi/wui [*] support creation of a new directory without there already being an existing directory to link the new one into
[*] WebAPI/WebUI
2007-12-20 12:58:17 -07:00
Brian Warner
d4283ac1ec mutable: always include ourselves in the querylist when Publishing, because 0.7.0 usually stores our root dirnode only on ourselves, and our nodeid might not appear in the first N+epsilon peers 2007-12-19 00:06:53 -07:00
Brian Warner
fc3574a654 mutable.py: one more logging fix 2007-12-18 23:42:41 -07:00
Brian Warner
22f9e8c55b mutable.py: oops, our logging wrappers can't take posargs yet 2007-12-18 23:36:16 -07:00
Brian Warner
c00b88025d mutable.Publish: improve logging 2007-12-18 23:30:50 -07:00
Brian Warner
9a8f68c41f dirnode: add set_uris() and set_nodes() (plural), to set multiple children at once. Use it to set up a new webapi test for issue #237. 2007-12-18 23:30:02 -07:00
Brian Warner
2308420fc6 node: provoke foolscap-0.2.2 into saving logport.furl, so we can attach to it with 'flogtool dump'. Also, place it in private/, since logs are considered somewhat private 2007-12-18 23:27:02 -07:00
Zooko O'Whielacronx
05b04d2b90 fix representation of node ids in PeerTracker objects 2007-12-19 17:55:28 -07:00
Zooko O'Whielacronx
a0d73f8afb remove some no-longer needed replacements of "/" with "!" in uris 2007-12-19 17:54:40 -07:00
Brian Warner
2db158dd52 more new-pyflakes warnings fixed 2007-12-18 18:51:33 -07:00
Brian Warner
50bc0d2fb3 the new pyflakes is stricter, complaining about function definitions that overshadow earlier definitions or imports. Fix some of its complaints. 2007-12-18 18:47:28 -07:00
Brian Warner
318b63fbc7 hush pyflakes 2007-12-18 18:37:22 -07:00
Brian Warner
7fb37209ee create_node.py: need to create private/ dir in create-client so we can touch the my_private_dir.cap file 2007-12-18 15:42:18 -07:00
Brian Warner
60d6728ab3 oops, touch private/my_private_dir.cap when creating the client 2007-12-18 15:36:59 -07:00
Brian Warner
01a93dfe8f check_load: add stats-gathering 2007-12-18 14:07:37 -07:00
Brian Warner
50840b1085 add a simple load-generating tool to do random reads and writes 2007-12-17 21:06:07 -07:00
Brian Warner
b8d77fbb46 move my_private_dir.cap into private/ 2007-12-17 20:57:40 -07:00
Brian Warner
a592551ccf my_private_dir.cap: add newline for readability, open with mode 'w' not 'w+' since we don't need to read from this filehandle 2007-12-17 20:48:48 -07:00
Brian Warner
8b9f86fb17 remove the slash-to-bang conversion from CLI tools and webapi.txt 2007-12-17 20:22:26 -07:00
Zooko O'Whielacronx
2a7f374e45 unit test that POST /uri/?t=mkdir works 2007-12-18 17:47:49 -07:00
Zooko O'Whielacronx
a5a54ac5ca remove the DirnodeURI foolscap schema and mv those regexes into uri.py
We currently do not pass dirnode uris over foolscap.
2007-12-18 17:44:24 -07:00
Zooko O'Whielacronx
9848d2043d make more precise regexp for WriteableSSKFileURI and DirnodeURI and use it in unit tests
Also allow an optional leading "http://127.0.0.1:8123/uri/".
Also fix a few unit tests to generate bogus Dirnode URIs of the modern form instead of the former form.
2007-12-18 13:15:08 -07:00
Zooko O'Whielacronx
ea43753386 fix unit tests to assert that we do *not* link to start.html when there is no private dir, instead of asserting that we *do* 2007-12-17 18:51:16 -07:00
Zooko O'Whielacronx
36e8e4e561 do not put a link from the welcoXme page to the start.html if there is not a private directory 2007-12-17 18:35:59 -07:00
Zooko O'Whielacronx
a983f6d60c rename "my_private_dir.uri" to "my_private_dir.cap" 2007-12-17 18:35:25 -07:00
Zooko O'Whielacronx
08a64c3a2b rename "secret" to "lease_secret" and change its size from 16 to 32 bytes 2007-12-17 18:34:11 -07:00
Zooko O'Whielacronx
8c65bdcf9d put all private state in $BASEDIR/private
fixes #219

The only part of #219 that this doesn't include is the part about 
logpublisher, which has been moved out of tahoe into foolscap.
2007-12-17 16:39:54 -07:00
Zooko O'Whielacronx
d3f23d4052 we no longer need to replace "/" with "!" in urls 2007-12-14 18:25:50 -07:00
Zooko O'Whielacronx
20f549baa1 tidy-up some comments and logging messages 2007-12-14 18:24:46 -07:00