ExternalVendorCode/tahoe-lafs
1
0
Fork 0
mirror of https://github.com/tahoe-lafs/tahoe-lafs.git synced 2024-12-27 16:28:53 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,642 Commits 185 Branches 90 Tags 89 MiB
cf2bd03813
Commit Graph

841 Commits

Author SHA1 Message Date
Brian Warner
4eab5bb50d trailing-whitespace eradication, no functional changes 2007-11-01 15:34:12 -07:00
Brian Warner
e304c74f8f trailing-whitespace eradication, no functional changes 2007-11-01 15:34:07 -07:00
Brian Warner
a037049188 trailing-whitespace eradication, no functional changes 2007-11-01 15:34:01 -07:00
Brian Warner
516ce89a1e trailing-whitespace eradication, no functional changes 2007-11-01 15:33:47 -07:00
Brian Warner
9cd3eaec1e trailing-whitespace eradication, no functional changes 2007-11-01 15:33:41 -07:00
Brian Warner
ef546da72b trailing-whitespace eradication, no functional changes 2007-11-01 15:29:31 -07:00
Brian Warner
8d000aa1ec trailing-whitespace eradication, no functional changes 2007-11-01 15:29:28 -07:00
Brian Warner
8390d83322 trailing-whitespace eradication, no functional changes 2007-11-01 15:29:17 -07:00
Brian Warner
8465e99fe4 trailing-whitespace eradication, no functional changes 2007-11-01 15:29:12 -07:00
Brian Warner
3425cd9202 trailing-whitespace eradication, no functional changes 2007-11-01 15:29:03 -07:00
Brian Warner
433802f5ca trailing-whitespace eradication, no functional changes 2007-11-01 15:28:58 -07:00
Brian Warner
bf29cb38ed trailing-whitespace eradication, no functional changes 2007-11-01 15:28:54 -07:00
Brian Warner
f192ffc18d trailing-whitespace eradication, no functional changes 2007-11-01 15:28:50 -07:00
Brian Warner
fb59627faa trailing-whitespace eradication, no functional changes 2007-11-01 15:25:20 -07:00
Brian Warner
5e974ede20 trailing-whitespace eradication, no functional changes 2007-11-01 15:25:16 -07:00
Brian Warner
164da05ead trailing-whitespace eradication, no functional changes 2007-11-01 15:25:12 -07:00
Brian Warner
284b3e77e0 trailing-whitespace eradication, no functional changes 2007-11-01 15:25:09 -07:00
Brian Warner
1889af0e61 trailing-whitespace eradication, no functional changes 2007-11-01 15:25:04 -07:00
Brian Warner
20af973272 trailing-whitespace eradication, no functional changes 2007-11-01 15:25:00 -07:00
Brian Warner
f4946bc22e trailing-whitespace eradication, no functional changes 2007-11-01 15:22:57 -07:00
Brian Warner
828e2734e6 trailing-whitespace eradication, no functional changes 2007-11-01 15:22:47 -07:00
Brian Warner
d06d4f302f trailing-whitespace eradication, no functional changes 2007-11-01 15:22:41 -07:00
Brian Warner
1e76e9267b trailing-whitespace eradication, no functional changes 2007-11-01 15:22:38 -07:00
Brian Warner
1d8a4cdfe7 mutable: first pass at dirnodes, filenodes, new URIs. Some test coverage. 
The URI typenames need revision, and only a few dirnode methods are
implemented. Filenodes are non-functional, but URI/key-management is in
place. There are a lot of classes with names like "NewDirectoryNode" that
will need to be rename once we decide what (if any) backwards compatibility
want to retain.
 2007-11-01 15:15:29 -07:00
Brian Warner
fb3eddafdb move NotMutableError from dirnode.py into interfaces.py 2007-11-01 15:03:07 -07:00
Brian Warner
bcf84c1238 storage.py: fix tests, timestamps get updated when leases are renewed 2007-10-31 12:31:33 -07:00
Brian Warner
70e7961088 storage.py: more test coverage, make sure leases survive resizing 2007-10-31 12:07:47 -07:00
Brian Warner
948e6b34dd storage.py: improve test coverage even more 2007-10-31 01:44:01 -07:00
Brian Warner
4bd739435f storage.py: more mutable-slot coverage, renewing/cancelling leases 2007-10-31 01:31:56 -07:00
Brian Warner
f9a72e0e75 test_node.py: more coverage of Node.log 2007-10-31 00:56:59 -07:00
Brian Warner
22e3487b9e test_node.py: improve test coverage of node.py 2007-10-31 00:54:42 -07:00
Brian Warner
256ef1bf53 mutable slots: add some test coverage for lease-addition 2007-10-31 00:38:30 -07:00
Brian Warner
68d3d62002 mutable slots: finish up basic coding on server-side containers, add some tests. Remove all caching from MutableShareFile. 2007-10-31 00:10:40 -07:00
Brian Warner
b24c2925e8 checkpointing mutable-file work. Storage layer is 80% in place. 2007-10-30 19:47:36 -07:00
Brian Warner
b257f905a0 webish.py: handle asynchronous checker results. 
Thanks to robk for pointing out that Nevow will accept a Deferred almost
everywhere. In this case, we just pass a Deferred into ctx.fillSlots(). One
quirk: nevow doesn't evaluate all rows of the table in parallel: using a slow
Deferred in a slot in one row seems to stall the next row until that one has
fired, probably to simplify the flattening of the HTML.
 2007-10-30 17:00:37 -07:00
Brian Warner
5491339912 'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever 2007-10-29 11:43:35 -07:00
Brian Warner
3d0ed4b0a9 checker.checker_results_for: ignore uris of 'None' 2007-10-26 18:38:37 -07:00
Brian Warner
42bd2bcf8e webish: tolerate not having a checker, since some unit tests don't make one 2007-10-23 17:35:31 -07:00
Brian Warner
046bda2b47 webish: add checker results and a 'Check' button to the web interface 2007-10-23 17:23:57 -07:00
Brian Warner
afca99c485 interfaces: clarify IChecker.checker_results_for a bit 2007-10-22 18:10:46 -07:00
Brian Warner
57f994fb02 checker: remember checker results, but only in ram for now 2007-10-22 17:46:24 -07:00
Brian Warner
81c818f90c checker.py: rearrange classes a little bit 2007-10-22 16:19:18 -07:00
Brian Warner
e992fed1f5 cli: improve test coverage 2007-10-21 12:33:17 -07:00
Brian Warner
afcc8107af tahoe_ls: list individual files 2007-10-21 12:33:06 -07:00
Brian Warner
aff059dd4b checker: return more information per CHK file, including the shareholder list 2007-10-17 02:25:50 -07:00
Brian Warner
d1f13fd117 add an equally-simple file-verifier 2007-10-16 12:25:09 -07:00
Brian Warner
6160af5f50 encode.py: update comments, max_segment_size is now 2MiB 2007-10-16 11:00:29 -07:00
Brian Warner
9da1d70676 add a simple checker, for both files and directories 2007-10-15 16:16:39 -07:00
Zooko O'Whielacronx
81c56b8e53 shush, pyflakes 2007-10-26 18:53:21 -07:00
Zooko O'Whielacronx
d7af8ae677 improve code coverage by removing untested raise RuntimeError and replacing it with tested assert 2007-10-26 18:37:40 -07:00
Zooko O'Whielacronx
81e0820904 cli: use urllib.quote() on vdrive-path arguments before passing them through HTTP 2007-10-26 18:30:44 -07:00
czooko
d589c385e6 make the anchor text in the WUI be descriptive of the target -- not "Click Here!"! 2007-10-22 16:56:30 -07:00
czooko
5f9f54c11c trivial change to comment -- sentences start with a capital letter and end with a punctuation mark 
I've been volunteering in Irby's first-grade class, and you do NOT get a star
on your Power Sentences worksheet unless you follow this rule.
 2007-10-22 16:55:20 -07:00
czooko
3847228444 patch the LogObserver in a more modern, forward-compatible way and update the in-line comments about it 2007-10-22 16:52:55 -07:00
Zooko O'Whielacronx
74f52d79f2 tests: make test_encode specify the erasure coding params it wants instead of expecting the defaults to be what it wants 2007-10-15 20:07:42 -07:00
Zooko O'Whielacronx
426721f3f2 update a few documents, comments, and defaults to mention 3-of-10 instead of 25-of-100 2007-10-15 19:53:59 -07:00
Zooko O'Whielacronx
bba7b81456 startstop_node: use the new find_exe module 2007-10-15 10:25:15 -07:00
Zooko O'Whielacronx
5b476d73ee setup: generalize the kludge of finding an executable (i.e. trial or twistd) when there might be only a .py script version of it available 2007-10-15 10:25:04 -07:00
Zooko O'Whielacronx
fbc5bdf607 remove unused imports (thanks, pyflakes) 2007-10-15 08:32:21 -07:00
Zooko O'Whielacronx
83d7eb23e6 remove a file accidentally left over from the experiment in using sqlite to maintain lease information 2007-10-14 20:57:59 -07:00
Zooko O'Whielacronx
ed84534c5b a slightly nicer method of computing our timestamp format 2007-10-14 20:46:51 -07:00
Zooko O'Whielacronx
240de64598 install our custom timestamp formats in a less disruptive way 
The unit tests on Windows fail because trial is attempting to remove its own
log observer during teardown.  This patch customizes the extant log observer
object by replacing its formatTime method with our own.

I first tried the approach of storing their log observer object and putting it
back during teardown, but it didn't work (perhaps because our node object
doesn't get a chance to do its deferred stopService behavior in time), and
anyway I generally prefer the "fail-safe", or "crash-only" design.
 2007-10-14 20:43:11 -07:00
Brian Warner
07b03bd55b test_runner.RunNode: pass an explicit webport, to avoid using 8123 (which might be in used by a running node). Closes #175. 2007-10-13 16:06:39 -07:00
Zooko O'Whielacronx
af0edec753 filter out "0.0.0.0" from detected IP addresses 2007-10-13 00:38:16 -07:00
Brian Warner
f0e727867a cli: simplify code by using stdlib's httplib module 2007-10-11 22:29:23 -07:00
Brian Warner
4361b32f2d cli: implement 'mv'. Closes #162. 2007-10-11 20:31:48 -07:00
Brian Warner
3709b343ab tahoe_get.py: remove unused import 2007-10-11 19:47:40 -07:00
Brian Warner
8985b6565d cli: add test coverage 2007-10-11 19:20:41 -07:00
Brian Warner
654bbbed8f node.py: fix timestamps (add ms and Z) by replacing the FileLogObserver. #171. 2007-10-11 17:30:07 -07:00
Brian Warner
479abae92f cli: fix usage to refer to 'tahoe', not 'allmydata'. Closes #154. 2007-10-11 15:37:52 -07:00
Brian Warner
e1f604f7cd change our default HTTP port to 8123 2007-10-11 13:17:23 -07:00
Brian Warner
dc573554c8 rename bin/allmydata-tahoe to bin/tahoe. Closes #155. 2007-10-11 03:38:24 -07:00
Brian Warner
ee72a5adfd rename client.tac to tahoe-client.tac, so that 'ps ax|grep tahoe' works. Closes #156. 2007-10-11 02:48:06 -07:00
Brian Warner
34a25b9b28 node.py: don't append 'Z' to the timestamp, since it's really localtime. We need deeper changes to make it be UTC 2007-10-11 02:24:17 -07:00
Brian Warner
6ed8664c7f check_memory.py: don't use self.keepalive_file until it's been initialized 2007-10-11 02:20:20 -07:00
Brian Warner
a76898244b create_node.py: allow config['webport'] to be missing, for check_memory 2007-10-11 02:19:59 -07:00
Brian Warner
1b406f3c32 node.py: set logging timestamp to '2007-10-11 02:11:14.000Z', per ticket #171. No milliseconds yet, though 2007-10-11 02:13:05 -07:00
Brian Warner
0f000784ce create_node: use a webport by default, on localhost:8011 2007-10-11 02:01:23 -07:00
Brian Warner
8ce93b5e27 test_cli.py: hush pyflakes with a dummy usage, until we get some real CLI tests 2007-10-11 01:55:29 -07:00
Brian Warner
7fd1964c6f runner: make most commands use ~/.tahoe by default (create-client, start/stop/restart, all CLI tools, but *not* create-introducer 2007-10-11 01:54:23 -07:00
Brian Warner
a29ab33379 webish: write node.url, for the benefit of CLI tools 2007-10-11 01:38:04 -07:00
Brian Warner
a470947cc3 cli: use urllib.escape on all URIs 2007-10-11 01:34:44 -07:00
Brian Warner
5b28411b04 cli: add --node-directory and --root-uri to all commands 2007-10-11 00:30:36 -07:00
Brian Warner
ec8781e587 'tahoe restart': re-enable --force option, which was accidentally lost 2007-10-10 20:10:03 -07:00
Zooko O'Whielacronx
021b5d4f2a more information SkipTest for XMLRPC 2007-10-04 11:07:46 -07:00
Brian Warner
8fa19fa273 check_speed: average multiple pings when measuring RTT 2007-09-26 18:16:15 -07:00
Brian Warner
51b59b1219 dump-share: clarify the label on the size of the original file 2007-09-26 15:00:59 -07:00
Brian Warner
3fcee101ee check_speed: measure RTT, report per-file times as a multiple of RTT 2007-09-26 13:07:33 -07:00
Brian Warner
c301b41f50 control: add measure_peer_response_time(), to estimate RTT for the mesh 2007-09-26 12:21:15 -07:00
Brian Warner
c10da1e1ef client.py: add the missing remote_get_nodeid() method claimed in interfaces.py 2007-09-26 12:20:48 -07:00
Brian Warner
0596b9fe19 test_system.py minor typo 2007-09-26 12:07:37 -07:00
Brian Warner
0cfed96796 test_system.py: add coverage for allmydata.control 2007-09-26 12:06:55 -07:00
Brian Warner
aafccf7008 test_client.py: add TODO to test the hotline-timeout file 2007-09-25 21:03:54 -07:00
Brian Warner
c14349f695 check_speed.py: minor comment 2007-09-25 20:07:03 -07:00
Brian Warner
e05311f69a client.py: increase hotline timeout, the check_memory test is failing 2007-09-25 19:22:33 -07:00
Brian Warner
1691524044 check_speed.py: use more small-file tests to improve accuracy of per-file time 2007-09-25 18:57:36 -07:00
Brian Warner
50415cf9c4 check_memory: more keepalive-file debug messages 2007-09-25 18:47:48 -07:00
Brian Warner
8d7368f748 check_memory: put framework log in a stable place, add debug code to figure 
out why the keepalive-file isn't doing its job
 2007-09-25 18:26:54 -07:00
Brian Warner
9b09fd3bf1 test_system.py: do one upload, then test debug scripts, then do other uploads 2007-09-24 18:12:37 -07:00
Zooko O'Whielacronx
e3d782da52 cli: use port 8123 as the example port number 2007-09-24 13:17:27 -07:00
Zooko O'Whielacronx
93efd2902e startstop_node.py: use SIGINT instead of SIGTERM to stop the node (fixes #143) 2007-09-23 07:06:54 -07:00
Zooko O'Whielacronx
a18f7aa6d5 fix test_vdrive (fixes #144) 
It turns out that we actually have *two* files in our storage servers at the 
time that test_vdrive asserts things about the shares.  I suppose that 
test_vdrive happens to pass on all other operating systems because the 
filesystem happens to return the right share as the first one in a 
"listdir()".  The fix in this patch is slightly kludgey -- allow either share 
to pass -- but good enough.
 2007-09-22 15:26:27 -07:00
Brian Warner
ff07ce6234 check_speed: add optional 100MB test, if the 10MB test finished fast enough 2007-09-22 00:04:46 -07:00
Brian Warner
325c7a7bfa node.py: chmod the foolscap private key (node.pem) to 0600, since it's secret 2007-09-21 16:52:55 -07:00
Zooko O'Whielacronx
594a104c71 startstop_node.py: fix bug with options passed to restart and enable restart --profile 2007-09-21 15:48:15 -07:00
Zooko O'Whielacronx
3e4616f4ad cli: add --profile flag 2007-09-21 15:03:47 -07:00
Zooko O'Whielacronx
20079e3019 startstop_node.py: don't pass config to do_start() and do_stop() 2007-09-21 15:03:15 -07:00
Zooko O'Whielacronx
28b2c19f1e startstop_node.py: find twistd.py in sys.prefix/scripts if there isn't a twistd executable on the path 2007-09-21 14:45:20 -07:00
Brian Warner
1c29065f1c check_memory: touch the hotline file more often, to avoid accidental timeout 2007-09-20 19:35:31 -07:00
Brian Warner
d58d794757 check_speed: do both upload and download tests 2007-09-20 18:52:44 -07:00
Brian Warner
2632c0ad8c check_speed: upload multiple files, measure Ax+B 2007-09-20 16:55:33 -07:00
Zooko O'Whielacronx
f0b427485b startstop_node.py: remove debug printout which breaks unit tests 2007-09-20 17:02:36 -07:00
Zooko O'Whielacronx
c2e310825d startstop_node.py: improve the hack of launching twistd 
Thanks to Brian for helping me figure out the cleaner way to do this: take the 
first result from which("twistd"), and if it has the extension ".bat" or 
".exe" then execute it, else execute python and give it as the first argument.
 2007-09-20 12:37:50 -07:00
Brian Warner
3774ce59ea check_memory: fix race condition for startup of in-process server nodes 2007-09-20 15:33:58 -07:00
Brian Warner
77fae0b338 check_memory.py: record initial memory usage (before any connections are made) 2007-09-20 12:36:27 -07:00
Brian Warner
b9d5a4ead4 check_speed.py: run two 1MB uploads and measure the time it takes 2007-09-19 18:40:18 -07:00
Brian Warner
f6be35e122 started framework for an automated speed-checking tool. Doesn't do much yet. 2007-09-19 18:27:47 -07:00
Brian Warner
2b93164a03 test_runner: try harder to work on slow buildslaves and cygwin 2007-09-19 13:56:00 -07:00
Brian Warner
bede39a156 check-memory: add 'receive' mode, for #97 (consumption during share receive 2007-09-19 12:59:32 -07:00
Brian Warner
0cbf2cca08 introducer.py: add test coverage of _disconnected() 2007-09-19 11:50:13 -07:00
Brian Warner
e2f19825d9 startstop_node.py: improve test coverage a little bit 2007-09-19 01:50:27 -07:00
Brian Warner
d31d7ff941 test_system.py: do a large-file test (1.5MB) to trigger pauseProducing 2007-09-19 01:43:44 -07:00
Brian Warner
1340c484c6 download.py: use producer/consumer to reduce memory usage, closes #129. 
If the DownloadTarget is also an IConsumer, give it control of the brakes
by offering ourselves to target.registerProducer(). When they tell us to
pause, set a flag, which is checked between segment downloads and decodes.
webish.py: make WebDownloadTarget an IConsumer and pass control along to
the http.Request, which already knows how to be an IConsumer.
This reduces the memory footprint of stalled HTTP GETs to a bare minimum,
and thus closes #129.
 2007-09-19 00:34:47 -07:00
Brian Warner
9c9a793540 upload.py: fix signature of NonConvergentUploadMixin.get_encryption_key 2007-09-18 23:38:11 -07:00
Brian Warner
ee9b7fd678 check_memory: oops, silly bug make 'upload' push to ourselves, raising the usage 2007-09-19 04:14:48 -07:00
Brian Warner
08cc32bb77 check_memory: add download-GET-slow, to simulate memory usage of a node feeding downloaded data via HTTP GET to a slow client 2007-09-18 20:35:27 -07:00
Brian Warner
a5fab9935b test_runner: better diagnostics in case test_client fails 2007-09-18 20:03:18 -07:00
Brian Warner
2886c5aeae check_memory: don't accept shares for download/download-GET test, since that hits bug #97 2007-09-18 19:40:29 -07:00
Brian Warner
f6acf5a0c3 check_memory: add download, download-GET 2007-09-18 18:56:05 -07:00
Brian Warner
38946439f3 test_runner.py: fix race conditions in start/stop node, should run on cygwin now 2007-09-18 15:17:26 -07:00
Brian Warner
645927ca73 test_runner.py: skip the start/stop test when sys.platform is win32/cygwin. 
The previous twisted.python.runtime.platformType approach didn't catch cygwin
for some reason.
 2007-09-17 21:56:08 -07:00
Brian Warner
f72ef4d8f9 test_runner.py: add tests for startstop_node.py 2007-09-17 02:25:31 -07:00
Brian Warner
cf69accfb6 startstop_node.py: use SIGINT instead of SIGTERM, to allow the node a chance to clean up 2007-09-17 02:24:21 -07:00
Brian Warner
b7c18d6505 webish: improve test coverage 2007-09-17 01:53:46 -07:00
Brian Warner
6cd11037c6 debug: remove the 'dump-share-leases' command, it is subsumed by 'dump-share' 2007-09-17 01:44:39 -07:00
Brian Warner
79bd7d422d provisioning.py: get full test coverage 2007-09-17 01:38:54 -07:00
Brian Warner
311ed144f8 uri.py: improve test coverage a bit 2007-09-17 01:09:47 -07:00
Brian Warner
8451b485a4 storage: fill alreadygot= with all known shares for the given storageindex, not just the ones they asked about 2007-09-17 00:48:40 -07:00
Brian Warner
808f851589 upload: make peer-selection a bit more uniform. Closes #132. 2007-09-16 17:08:34 -07:00
Brian Warner
24e6ccddce peer-selection: if we must loop, send a minimal number of queries (by asking for more than one share per peer on the second pass) 2007-09-16 01:53:00 -07:00
Brian Warner
8a251d8670 upload: remove Tahoe3 peer-selection algorithm 2007-09-16 01:26:11 -07:00
Brian Warner
baa16087cd upload: switch to Tahoe2, add test for uniform share allocation 2007-09-16 01:25:03 -07:00
Brian Warner
979d12cd42 upload.py: implement Tahoe2 peer-selection algorithm 2007-09-16 01:24:07 -07:00
Brian Warner
f24d7450a7 vdrive.py: oops, forgot an import 2007-09-15 15:21:57 -07:00
Brian Warner
d37d74fa1d vdrive: log an error if we weren't able to use the vdrive the way we wanted to 2007-09-15 15:17:29 -07:00
Brian Warner
d628d5f503 storage: remove the leftover incoming/XYZ/ directory when we're done with it 2007-09-15 14:34:04 -07:00
Brian Warner
e9d32f14b9 check_memory.py: preserve client.log and stats.out in _test_memory/ 
Put the nodes in _test_memory/test/, which is clobbered on each test. Also
kill the client with SIGINT instead of SIGKILL. Also don't daemonize the 
client, since we're going to kill it at the end of the test anyways: this
cleans up shutdown a bit.
 2007-09-15 20:53:06 -07:00
Brian Warner
d5ed60e4ad webish: upload: when the localdir= doesn't exist, say so in the HTTP response 2007-09-15 12:49:07 -07:00
Brian Warner
c7986389e5 check_memory.py: have all clients write their logs to _test_memory/client.log instead of a separate file per client 2007-09-15 12:34:05 -07:00
Brian Warner
e7f61a3a6c check_memory: oops, only bail if the process ended abnormally 2007-09-15 11:47:29 -07:00