853 Commits

Author	SHA1	Message	Date
Brian Warner	6fa41e738b	immutable: tolerate filenode.read() with a size= that's too big, rather than hanging	2008-11-04 15:29:19 -07:00
Brian Warner	a2e195df3e	debug catalog-shares: tolerate even more errors on bad files/directories	2008-10-30 14:54:47 -07:00
Brian Warner	ba019bfd3a	#527: expire the cached files that are used to support Range: headers, every hour, when the file is unused and older than an hour	2008-10-30 13:39:09 -07:00
Brian Warner	c205a54965	util/cachedir.py: add a cache-directory manager class, which expires+deletes unused files after a while	2008-10-30 13:01:20 -07:00
Brian Warner	1419db6ac7	test_cli: try to fix windows again	2008-10-30 12:32:04 -07:00
Brian Warner	d97c34d622	debug/test_cli: fix error handling for catalog-shares, to make the test stop failing on windows	2008-10-30 12:06:51 -07:00
Brian Warner	b1db6d9ff2	web: add 'Repair' button to checker results when they indicate unhealthyness. Also add the object's uri to the CheckerResults instance.	2008-10-29 18:09:17 -07:00
Brian Warner	d3f2df00be	webapi: serve the /static URL tree from /public_html (configurable)	2008-10-29 15:34:31 -07:00
Brian Warner	a9101112a4	catalog-shares command: tolerate errors, log them to stderr, handle v2-immutable shares	2008-10-29 15:10:10 -07:00
Brian Warner	186b64b633	test_web.py: one more line of test coverage	2008-10-28 22:00:15 -07:00
Brian Warner	0350994133	test_web: improve test coverage of PUT DIRURL t=uri replace=false	2008-10-28 21:57:44 -07:00
Brian Warner	a5aebf0cbd	web: test (and fix) PUT DIRURL t=uri, which replaces a directory in-place with some other cap	2008-10-28 21:54:46 -07:00
Brian Warner	248033d78c	test_client.py: improve test coverage a bit	2008-10-28 21:43:35 -07:00
Brian Warner	b73c380cdb	move testutil into test/common_util.py, since it doesn't count as 'code under test' for our pyflakes numbers	2008-10-28 21:28:31 -07:00
Brian Warner	294e3fb682	util: move PollMixin to a separate file (pollmixin.py), so testutil can be moved into test/	2008-10-28 21:15:48 -07:00
Brian Warner	4c2235fcef	web/filenode: oops, fix test failures, not everything has a storage index	2008-10-28 18:17:20 -07:00
Brian Warner	b1ca238176	#527: respond to GETs with early ranges quickly, without waiting for the whole file to download. Fixes the alacrity problems with the earlier code. Still needs cache expiration.	2008-10-28 17:56:18 -07:00
Brian Warner	37e3d8e47c	#527: support HTTP 'Range:' requests, using a cachefile. Adds filenode.read(consumer, offset, size) method. Still needs: cache expiration, reduced alacrity.	2008-10-28 13:41:04 -07:00
Brian Warner	914655c52b	interfaces.py: promote immutable.encode.NotEnoughSharesError.. it isn't just for immutable files any more	2008-10-27 13:34:49 -07:00
Brian Warner	fca158e83a	dirnode lookup: use distinct NoSuchChildError instead of the generic KeyError when a child can't be found	2008-10-27 13:15:25 -07:00
Brian Warner	9f21f7cf65	mutable: call remove_advise_corrupt_share when we see share corruption in mapupdate/download/check, tolerate servers that do not implement it	2008-10-24 13:21:28 -07:00
Brian Warner	db37c14ab7	storage: add remote_advise_corrupt_share, for clients to tell storage servers about share corruption that they've discovered. The server logs the report.	2008-10-24 11:52:48 -07:00
Brian Warner	6dbef907ac	mutable/servermap.py: fix needs_merge(), it was incorrectly claiming that mixed shares with distinct seqnums needed a merge, causing repair(force=False) to fail	2008-10-23 21:00:24 -07:00
Brian Warner	0383ec5a49	test_web.test_POST_DIRURL_deepcheck: confirm that /operations/HANDLE/ works with or without the slash	2008-10-23 19:17:59 -07:00
Brian Warner	cadb045288	test_web: more test coverage	2008-10-23 17:11:18 -07:00
Brian Warner	a1cfac89f9	webapi: fix t=rename from==to, it used to delete the file	2008-10-23 16:32:36 -07:00
Brian Warner	d4b4cd8ab8	test_system: update test to match web checker results	2008-10-23 16:32:02 -07:00
Brian Warner	c455d52453	deep-check: add webapi links to detailed per-file/dir results	2008-10-23 16:00:31 -07:00
Brian Warner	76b7b9d835	webapi: make the /operations/ 't=status' qualifier optional, remove it from examples	2008-10-23 15:56:58 -07:00
Brian Warner	2ee6356c89	test_dirnode.py: oops, missed a Monitor(), unbreak tests	2008-10-22 01:50:54 -07:00
Brian Warner	977c6ac510	more #514: pass a Monitor to all checker operations, make mutable-checker honor the cancel flag	2008-10-22 01:38:18 -07:00
Brian Warner	8178b10ef1	dirnode.py: check for cancel during deep-traverse operations, and don't initiate any new ones if we've been cancelled. Gets us closer to #514.	2008-10-22 00:55:52 -07:00
Brian Warner	34ab4e3de3	more #514 log-webop status/cancel: add handle-expiration, test coverage	2008-10-21 22:13:54 -07:00
Brian Warner	0f7c1fd6fd	#514: improve test coverage	2008-10-21 17:52:56 -07:00
Brian Warner	ad3d9207a9	Change deep-size/stats/check/manifest to a start+poll model instead of a single long-running synchronous operation. No cancel or handle-expiration yet. #514.	2008-10-21 17:03:07 -07:00
Zooko O'Whielacronx	8a6d1e5da6	repairer: test all different kinds of corruption that can happen to share files on disk	2008-10-14 16:09:20 -07:00
Brian Warner	b0a00e0f33	util/time_format.py: accept space separator, add unit tests	2008-10-13 15:52:58 -07:00
Brian Warner	46657b797f	test_storage: use different filenames, poor stupid windows	2008-10-09 19:11:39 -07:00
Brian Warner	7031a69bee	storage: introduce v2 immutable shares, with 8-byte offsets fields, to remove two of the three size limitations in #346. This code handles v2 shares but does not generate them. We'll make a release with this v2-tolerance, wait a while, then make a second release that actually generates v2 shares, to avoid compatibility problems.	2008-10-09 18:13:27 -07:00
Brian Warner	288d55825c	storage: split WriteBucketProxy and ReadBucketProxy out into immutable/layout.py . No behavioral changes.	2008-10-09 17:08:00 -07:00
Brian Warner	2edfe12b88	test_web: deep-size is more variable than I thought, so assert less	2008-10-06 22:11:47 -07:00
Brian Warner	3ffaded809	web: change t=manifest to return a list of (path,read/writecap) tuples, instead of a list of verifycaps. Add output=html,text,json.	2008-10-06 21:36:18 -07:00
Brian Warner	8e6d122ecf	web: rewrite t=deep-size in terms of deep-stats, update test to match inclusion of directory sizes	2008-10-06 21:35:39 -07:00
Brian Warner	d90a3ed7f8	test_system: add test coverage for immutable download.ConsumerAdapter, remove debug messages	2008-10-06 15:50:37 -07:00
Brian Warner	934dc6aa77	test_cli.py: remove unused imports	2008-10-06 17:42:04 -07:00
Brian Warner	dbc2337639	CLI: remove 'tahoe admin generate-keypair', since the pycryptopp ecdsa API is about to change incompatibly. We'll undo this once pycryptopp is updated	2008-10-06 17:23:20 -07:00
Brian Warner	09341a969a	dirnode: fix my remarkably-consistent 'metdadata' typo	2008-10-02 18:08:45 -07:00
Brian Warner	d0bdf9a611	dirnode: add get_child_and_metadata_at_path	2008-10-02 17:52:03 -07:00
Brian Warner	9c505e49c2	stop using 'as' as an identifier: as with 'with', 'as' has become a reserved word in python 2.6	2008-10-02 17:27:49 -07:00
Brian Warner	935d185696	tolerate simplejson-2.0.0 and newer, which frequently return bytestrings instead of unicode objects. Closes #523	2008-09-30 15:21:06 -07:00