Zooko O'Whielacronx
bffd0c97f5
command-line: fix all three commands and all two ways to invoke them to require node-url and give a useful usage string if node-url is absent or of the wrong form
2007-08-17 12:54:47 -07:00
Zooko O'Whielacronx
e4f07a975f
tahoe_put.py: don't treat "^HTTP 200 OK" appearing somewhere in the body as if it appeared in the header
2007-08-17 12:06:41 -07:00
Zooko O'Whielacronx
7e8c6eb50b
tahoe_put.py: require node-url to be provided
2007-08-17 12:06:11 -07:00
Zooko O'Whielacronx
922663a7e2
cmdline: change "--server" to "--node-url" and make it have no default value
2007-08-16 16:53:27 -07:00
Zooko O'Whielacronx
1564987e6c
put now exits after doing its work, and it prints a terse message if 200 or 201, and a full dump of response elsewise
2007-08-16 16:30:39 -07:00
Zooko O'Whielacronx
6ed3a23c62
incomplete version of tahoe-put.py
...
It doesn't exit properly afterward, and it might not do the best things with non-success responses from the server.
(See tahoe-put-web2ish.py for an example of better response handling.)
2007-08-16 16:01:01 -07:00
Zooko O'Whielacronx
9ad02dbe80
fix version class to preferred format and correct parsing
2007-08-16 15:38:01 -07:00
Zooko O'Whielacronx
5a1d4aa8b7
version_class.py: if you don't have pkg_resources for comparing version numbers, use distutils.version.LooseVersion
2007-08-16 16:16:41 -07:00
Brian Warner
ceef80bee6
scripts: rearrange Options, make --version behave the same for all commands
2007-08-16 12:50:19 -07:00
Zooko O'Whielacronx
4ed7f0ac2a
fix small bug in unit tests which caused spurious failures on Windows
2007-08-16 14:14:41 -07:00
Zooko O'Whielacronx
a431811011
in-line doc edit: s/pyutil/allmydata.util/
2007-08-16 14:10:48 -07:00
Zooko O'Whielacronx
094b687d6e
import version class and make-version script from pyutil -- fixes win32 build, improves error handling, and eliminates unused features
2007-08-16 14:09:30 -07:00
Zooko O'Whielacronx
6c4fb6fd93
a first crack at the "put" command-line
...
There are actually two versions in this patch, one of which requires twisted.web2 and the other of which uses the Python standard library's socket module. The socketish one doesn't know when the web server is done so it hangs after doing its thing. (Oh -- maybe I should add an HTTP header asking the web server to close the connection when finished.) The web2ish one works better in that respect. Neither of them handle error responses from the server very well yet.
After lunch I intend to finish the socketish one.
To try one, mv src/allmydata/scripts/tahoe_put-{socketish,web2ish}.py src/allmydata/scripts/tahoe_put.py .
If you want to try the web2ish one, and you can't find a web2 package to install, you can get one from:
http://allmydata.org/~zooko/repos/twistedweb2snarf/
2007-08-16 12:15:38 -07:00
Brian Warner
ee6a6c79fa
webish.py: allow users to delete (but not create) empty-named files. Closes #94 .
2007-08-15 23:14:05 -07:00
Brian Warner
c1da0c11bc
webish: implement replace= for POST commands
2007-08-15 15:21:38 -07:00
Brian Warner
1752c9e29e
webish: implement replace= for PUT commands
2007-08-15 13:22:23 -07:00
Brian Warner
42dcc3088e
IDirectoryNode: add has_child() method
2007-08-15 13:22:01 -07:00
Brian Warner
244471dcc4
check_memory.py: Disable the 100MB test for now: our buildslave can't currently handle it because the testnet/framework processes uses something like 600M of RSS.
2007-08-15 12:55:11 -07:00
Brian Warner
a0c16f1a36
client.py: make a note in the logs when the auto-shutdown feature is in use
2007-08-14 02:12:30 -07:00
Brian Warner
179d5462c0
webish: look for when_done= in POST fields as well as queryargs. Closes #101 .
...
We need to look in the fields because that's how we build the mkdir/upload
forms. Without this, uploading or creating directories would leave us on a
page that had just a URI, instead of something actually useful to a human.
2007-08-13 17:45:02 -07:00
Brian Warner
6c6c62037d
fix pyflakes warnings from recent b32decode change
2007-08-12 16:33:51 -07:00
Brian Warner
0332e94656
test_system.py: add coverage for get_permuted_peers()
2007-08-12 16:29:34 -07:00
Brian Warner
1ac83637a6
Client.get_permuted_peers: use self.nodeid now that it's fixed
2007-08-12 16:24:51 -07:00
tahoe
53349c571f
shorten ids
2007-08-12 11:53:18 -07:00
Zooko O'Whielacronx
42f8e57416
don't over-encode the nodeid many times with ascii-encoding
2007-08-12 10:29:38 -07:00
Zooko O'Whielacronx
3bc708529f
foolscap: change using-foolscap.xhtml to say "public key" instead of "private key"
...
In the first instance, I hope that the tubid is generated from the hash of the public key and not the hash of the private key!
In the latter instances, the phrase "public key" as in "public key certificate" is more common.
2007-08-11 09:45:03 -07:00
Brian Warner
2f5a27316f
webish: localfile=/localdir= are now disabled by default, a special switch is required to enable them
2007-08-10 18:21:22 -07:00
Brian Warner
9281a0aedc
webish: reduce POST memory footprint by overriding http.Request
...
The original twisted.web.http.Request class has a requestReceived method
that parses the form body (in the request's .content filehandle) using
the stdlib cgi.parse_multipart() function. parse_multipart() consumes a
lot of memory when handling large file uploads, because it holds the
arguments entirely in RAM. Nevow's subclass of Request uses cgi.FieldStorage
instead, which is much more memory-efficient.
This patch uses a local subclass of Request and a modified copy of the
requestReceived method. It disables the cgi.parse_multipart parsing and
instead relies upon Nevow's use of FieldStorage. Our code must look for
form elements (which come from the body of the POST request) in req.fields,
rather than assuming that they will be copied into req.args (which now
only contains the query arguments that appear in the URL).
As a result, memory usage is no longer inflated by the size of the file
being uploaded in a POST upload request. Note that cgi.FieldStorage uses
temporary files (tempfile.TemporaryFile) to hold the data.
This closes #29 .
2007-08-10 17:25:33 -07:00
Brian Warner
b6ff38e4c7
webish.POSTHandler: fix typo that meant we didn't look for 'name' in req.fields
2007-08-10 17:25:28 -07:00
Brian Warner
998802fd6d
#96 : add flag to enable pushing data to ourselves, defaulting to False
2007-08-09 18:30:24 -07:00
Brian Warner
8b14ad1673
encode.py: log a percentage complete as well as the raw byte counts
2007-08-09 18:28:45 -07:00
Brian Warner
08ee80176a
Encoder.__repr__: mention the file being encoded
2007-08-09 18:26:56 -07:00
Brian Warner
684966d103
encode.py: add a reactor turn barrier between segments, to allow Deferreds to retire and free their arguments, all in the name of reducing memory footprint
2007-08-09 18:26:17 -07:00
Zooko O'Whielacronx
531109e803
fix test_web refactoring so that the WebMixin class isn't a TestCase
...
Thanks, Brian.
2007-08-10 08:40:02 -07:00
wilcoxjg
e13783cd6a
If do_stop attempts to stop a nonexistent process the OSError exception is caught (by errno) and handled tersely.
2007-08-09 08:57:45 -07:00
Zooko O'Whielacronx
39f218ab90
refactor test_web so that other tests can use the part of test_web that sets up a simple filesystem
2007-08-09 13:08:42 -07:00
Brian Warner
9ac5c14037
introducer: don't log.err() an initial connection failure, since that flunks tests. Use self.log() instead. Also improve test_client.py to always trigger this case, before it was finishing to quickly to always hit the problem.
2007-08-09 12:53:44 -07:00
Brian Warner
84d41adfcc
check_memory.py: include a single 100MB test
2007-08-09 11:30:33 -07:00
Zooko O'Whielacronx
6d905265a1
zfec: required version of setuptools is 0.6c6 on cygwin, 0.6a9 on other platforms
2007-08-09 10:29:03 -07:00
Zooko O'Whielacronx
5bbbdd1e91
zfec: default setuptools version is now 0.6c6
2007-08-09 10:28:38 -07:00
Zooko O'Whielacronx
d1c40a7ab5
zfec: add benchmark utility
2007-08-09 10:19:13 -07:00
Zooko O'Whielacronx
279561b61b
zfec: add to README.txt how to run the unit tests
2007-07-20 15:51:24 -07:00
Zooko O'Whielacronx
31a1e03194
zfec: fix link to zfec-dev mailing list
2007-07-20 13:57:47 -07:00
Zooko O'Whielacronx
a1fbfc9e53
zfec: fix README.txt to explain how to use setuptools with GNU stow better
...
Also remove requirement of setuptools >= v0.6c3. I *think* that using setuptools in the modern way relieves this requirement, but I haven't tested it on dapper yet.
2007-07-20 13:57:01 -07:00
Zooko O'Whielacronx
df3fc9b5ed
zfec: clarify licensing requirements (transitive grace period)
2007-07-20 13:55:46 -07:00
Zooko O'Whielacronx
8522689641
zfec: shebang usr bin env python in ez_setup.py
2007-06-04 04:45:17 -07:00
Zooko O'Whielacronx
5643ef81a1
zfec: update doc strings in fileutil
2007-06-04 04:44:44 -07:00
Zooko O'Whielacronx
9b08691f51
fix iputil so that it doesn't launch dozens of processes when you give it a full path and so that it tries executables in preference order and stops as soon as one gives out a dotted-quad string
2007-08-09 10:56:47 -07:00
Zooko O'Whielacronx
524c9f1fc2
startstop_node now works if the logs directory already exists
...
Thanks to Arno and Arch for pointing this out.
2007-08-08 21:43:48 -07:00
Brian Warner
57df32aac5
now that the buildslave is moved to a new machine, enable the 50MB test
2007-08-09 01:32:52 -07:00
warner-tahoe
1b863ed433
foolscap: fix .deb-breaking bug (foolscap.lothar.com: #8 )
2007-08-07 19:00:08 -07:00
warner-tahoe
afe006d700
update foolscap to foolscap-0.1.5, the latest release
2007-08-07 18:55:47 -07:00
Zooko O'Whielacronx
c367dfed5c
shebang /usr/bin/env python in ez_setup.py
...
This makes it so that "./ez_setup.py" works on more platforms.
2007-08-08 14:37:40 -07:00
Zooko O'Whielacronx
13c18a06d9
fix missing import -- this bug was introduced by the recent patch to relax setuptools version requirements
2007-08-07 14:25:44 -07:00
Zooko O'Whielacronx
9a8abab722
require setuptools >= 0.6c6 on cygwin, and >= 0.6a9 on other platforms
...
Earlier I tried 0.6a9 (which comes in .deb format on Dapper) and something
didn't work, so I raised it to 0.6c3. However, I didn't make a note of what
failed, and so now I'm hoping that what failed was cygwin-specific. Anyway,
everyone look out for setuptools compatibility problems on the your favorite
platform (and I'll check the buildslaves), and we'll raise the required version
as little as possible and only on the problematic platform.
2007-08-07 14:15:54 -07:00
tahoe
c4e5510813
setuptools upgrade to 0.6c6
2007-07-31 16:18:11 -07:00
Zooko O'Whielacronx
42d3afffa2
refactor test_uri and add a test of the empty file
2007-07-26 10:48:30 -07:00
Brian Warner
2ba415bd3e
move nodelogs from BASEDIR/twistd.log* to BASEDIR/logs/twistd.log*, closes #61
2007-07-24 20:44:33 -07:00
Brian Warner
8de93635af
test_web.py: oops, fix syntax error caused by removing comments
2007-07-25 03:21:30 -07:00
Brian Warner
6aff425fd2
test_web.py: remove spurious '# YES' lines, now that all the tests pass
2007-07-24 20:16:21 -07:00
Brian Warner
f664d4d80d
vdrive: eventually create public/private dirnodes event if the vdrive server isn't available at start up
2007-07-24 19:44:25 -07:00
Brian Warner
c3293f4f37
interfaces: move signatures into docstrings, to reduce lines of code and improve code-coverage numbers
2007-07-24 19:43:21 -07:00
Brian Warner
e3eba2d6c5
remove unused imports: hush pyflakes warnings
2007-07-24 18:13:58 -07:00
Zooko O'Whielacronx
32c90c6468
switch from rfc 3548 base-32 to z-base-32 except for tubids/nodeids
2007-07-24 13:46:06 -07:00
Brian Warner
e6e9ddc588
refactor upload/encode, to split encrypt and encode responsibilities
2007-07-23 19:31:53 -07:00
Brian Warner
9c5ab89afe
truncate storage index to 128 bits, since it's derived from a 128 bit AES key
2007-07-22 19:48:44 -07:00
Brian Warner
81a9904455
CHK: remove the storage index from the URI, deriving it from the key instead
2007-07-21 18:23:15 -07:00
Brian Warner
2bc3c163b6
uri.py: get keys and index from the URI instance
2007-07-21 17:45:00 -07:00
Brian Warner
1d9a58977f
uri: implement URI-processing classes, IFileURI/IDirnodeURI, use internally
2007-07-21 15:40:36 -07:00
Brian Warner
32fcf0b405
dirnode.build_manifest(): tolerate cycles in the directory graph
2007-07-21 15:40:13 -07:00
Brian Warner
e3a57fca98
upload: finish refactoring, all unit tests pass now
2007-07-19 22:53:29 -07:00
Brian Warner
9af506900b
upload: refactor to enable streaming upload. not all tests pass yet
2007-07-19 18:21:44 -07:00
Brian Warner
a7f04616bf
webish: improve test coverage further
2007-07-17 12:28:29 -07:00
Brian Warner
3197e1d39b
webish: improve test coverage of WebDownloadTarget
2007-07-17 12:16:45 -07:00
Brian Warner
d927d371b7
check_memory.py: test POST-based uploads as well as from-disk ones
2007-07-16 20:17:51 -07:00
Brian Warner
4db205b8b3
vdrive.py: log a note when we successfully retrieve the global root directory
2007-07-16 20:17:06 -07:00
Brian Warner
0826b1bd34
introducer.py: minor rearrangement of methods
2007-07-16 19:47:42 -07:00
Brian Warner
0269a6229b
check_memory.py: fix benign-but-noisy vdrive.furl handling bug
2007-07-16 19:34:52 -07:00
Brian Warner
0fd5dcacf6
check_memory: update it, write stats to a file, disable 50MB test for now
2007-07-16 18:08:55 -07:00
Brian Warner
1aa22b9abd
client.py: add a 'debug_no_storage' option to throw out all share data
2007-07-16 18:07:03 -07:00
Brian Warner
e91288d9ed
client.py: write control.furl in the right place
2007-07-16 18:06:27 -07:00
robk-org
920fed7f2a
added unit test to webish's rename function
...
added unit tests to test various permutations of the rename function, and
some sanity checks on the rename-form function.
also added a guard to prevent '/' in from_/to_name in rename calls.
2007-07-16 17:05:01 -07:00
Brian Warner
9be3da03f6
runner.py: make 'allmydata-tahoe --version' emit version numbers of everything
2007-07-16 14:58:36 -07:00
Brian Warner
20c980d02b
reduce MAX_SEGMENT_SIZE from 2MB to 1MB, to compensate for the large blocks that 3-of-10 produces
2007-07-16 13:48:34 -07:00
Brian Warner
56dcb814a8
webish: test error cases more thoroughly by looking inside the response text
2007-07-16 12:01:19 -07:00
Brian Warner
3f294d5597
webish: oops, handle POST without localfile= too
2007-07-16 12:00:54 -07:00
Brian Warner
f207f4a199
webish.py: disallow slashes in POSTed filenames. Closes #75 .
2007-07-16 11:53:12 -07:00
Brian Warner
7bc031a81d
webish.Directory: add a 'text/plain' link for files, to download as plaintext.
...
This is useful to view (e.g.) .py files that would otherwise be served as
some weird text/x-python that browsers will just want to save to disk.
2007-07-13 23:45:35 -07:00
Brian Warner
225fbfee57
storage.py: add a test for the next_power_of_k fix I made a few hours ago, basically do an upload with a non-power-of-two number of segments
2007-07-13 22:24:06 -07:00
Brian Warner
6e1ad64c9d
webish.py: test that _get_or_create_directories fix I made a few hours ago
2007-07-13 22:19:16 -07:00
Brian Warner
016e17446a
simplejson: lower our minimum-required-version of setuptools to 0.6a9, since that seems to work, and it's the version that comes with dapper
2007-07-13 19:47:56 -07:00
Brian Warner
a290205ade
webish: handle PUTs to direct children of the root
2007-07-13 19:31:52 -07:00
Brian Warner
8a39ee9034
storage.py: turn some assertions into preconditions
2007-07-13 19:30:48 -07:00
Brian Warner
9fc687cdfc
storage.py: handle num_segments != power-of-two without an assertion
2007-07-13 19:30:21 -07:00
Brian Warner
5c08be170e
interfaces: increase ShareSize now that our default k is smaller (hence blocks are bigger)
2007-07-13 19:29:31 -07:00
Brian Warner
c6f52e379a
rename storageserver.py to just storage.py, since it has both server and client sides now
2007-07-13 17:25:45 -07:00
Brian Warner
0468448b85
welcome.xhtml: add a link to allmydata.org
2007-07-13 17:15:44 -07:00
Brian Warner
d206843625
encode.py: minor typo
2007-07-13 17:00:06 -07:00
Brian Warner
4d868e6649
fix dump-uri-extension
2007-07-13 16:58:08 -07:00
Brian Warner
35117d77a0
storageserver.ReadBucketProxy: break out _parse_offsets, for debug tools
2007-07-13 16:52:17 -07:00
Brian Warner
7589a8ee82
storage: we must truncate short segments. Now most tests pass (except uri_extension)
2007-07-13 16:38:25 -07:00
Brian Warner
1f8e407d9c
more #85 work, system test still fails
2007-07-13 15:09:01 -07:00
Brian Warner
cd8648d39b
storage: use one file per share instead of 7 ( #85 ). work-in-progress, tests still fail
2007-07-13 14:04:49 -07:00
Brian Warner
6ff94541a8
control.py: make get_memory_usage() callable from elsewhere
2007-07-08 19:07:54 -07:00
robk-org
d65d02fa58
add a 'rename' button to the webish dir view
...
alongside the 'del' button is now presented a 'rename' button, which takes
the user to a new page, the 't=rename-form' page, which asks ther user for
the new name of the child and ultimately submits a POST request to the dir
for 't=rename' to perform the actual rename i.e. an attach followed by a
delete of children.
2007-07-12 16:53:54 -07:00
robk-org
15c3055176
fix bug in arg handling around 'delete' button in directory view
...
the code composing the form providing the 'delete' button in a dir
view was broken in that it tried to put some of the arguments into
the url query, rather than as the form's post args. worse, nevow
was kind enough to escape the querystring making it invalid.
2007-07-12 16:46:54 -07:00
robk-org
cacc9ac7b1
include the filename on URI-link urls for files
...
this is likely to induce browsers to do more useful things with the result
than they would when given neither content-type nor filename. (i.e. they
can guess that a .jpg file is an image, even with a bogus content type)
2007-07-11 15:26:47 -07:00
Brian Warner
798b714bef
webish.DirnodeWalkerMixin: comment out the code that demonstrates what we
...
would do if we could just use generators, since we don't use it.
2007-07-12 23:28:09 -07:00
Brian Warner
b0c65ed232
note that setting k=1 is equivalent to replication
2007-07-12 16:22:12 -07:00
Brian Warner
ba7e14a870
fix several methods to handle LIT URIs correctly, rather than assuming that all filenodes are CHK URIs
2007-07-12 16:17:49 -07:00
Brian Warner
53cf757be3
make it possible to download LIT uris. oops.
2007-07-12 16:16:59 -07:00
Brian Warner
5399395c27
allow the introducer to set default encoding parameters. Closes #84 .
...
By writing something like "25 75 100" into a file named 'encoding_parameters'
in the central Introducer's base directory, all clients which use that
introducer will be advised to use 25-out-of-100 encoding for files (i.e.
100 shares will be produced, 25 are required to reconstruct, and the upload
process will be happy if it can find homes for at least 75 shares). The
default values are "3 7 10". For small meshes, the defaults are probably
good, but for larger ones it may be appropriate to increase the number of
shares.
2007-07-12 15:33:30 -07:00
Brian Warner
def63d193e
implement URI:LIT, which stores small (<55B) files inside the URI itself. Fixes #81 .
2007-07-12 13:22:36 -07:00
Brian Warner
b62252183d
interfaces.py: increase RIVirtualDriveServer.list constraint from 100 entries to 1000, for now
2007-07-12 13:23:52 -07:00
Brian Warner
9238c61224
cli: implement 'get'
2007-07-11 10:26:19 -07:00
Zooko O'Whielacronx
32166c360a
tahoe_ls: remove a couple of vestigial or debugging bits
2007-07-10 19:46:40 -07:00
Brian Warner
b419b853ea
cli: implement 'allmydata-tahoe ls'
2007-07-10 19:37:37 -07:00
Brian Warner
d8a878da86
startstop_node.py: refactor find_twistd() out so it is only run when you need to start a node
2007-07-10 19:13:55 -07:00
Brian Warner
f22801aa33
runner.py: further refactoring
2007-07-10 19:05:18 -07:00
Brian Warner
4a16d20d85
runner.py: start to refactor into separate files
2007-07-10 18:41:52 -07:00
Brian Warner
944583a599
tahoe-ls.py: hush a pyflakes warning
2007-07-10 16:26:05 -07:00
Brian Warner
38ef49aea9
patch simplejson's ezsetup to take a min_version, and patch setup.py to use it, to allow installs on edgy machines with setuptools-0.6c3
2007-07-10 16:11:11 -07:00
Brian Warner
cf57359b0b
remove simplejson.egg-info from the repo (and boringfile it), it should never have been in the original tarball
2007-07-10 15:51:58 -07:00
Brian Warner
ea3c3e6780
import simplejson directly, and remove our local copies of the component .py files from util/json*
2007-07-10 15:49:32 -07:00
Brian Warner
dec729028f
tahoe-ls.py: initial version of an 'ls' CLI utility
2007-07-10 15:34:55 -07:00
Brian Warner
0d80d569fa
import simplejson-1.7.1 into src/simplejson
2007-07-10 15:22:53 -07:00
Brian Warner
13e84526a1
webapi: normalized API: use t=upload or t=download when providing localdir= or localfile=
2007-07-10 13:24:10 -07:00
Brian Warner
ad038497db
import the decoder portion of simplejson-1.7.1 too
2007-07-10 13:12:40 -07:00
Brian Warner
5264559561
webish: cosmetic: fix missing whitespace in HTML
2007-07-10 10:33:19 -07:00
Zooko O'Whielacronx
2a4423ba14
tahoe-get.py: fix bug: actually respect the optional server argument
2007-07-09 18:47:16 -07:00
Zooko O'Whielacronx
9bc87f610c
tahoe-get.py: add optional target-local-file argument
2007-07-09 18:27:11 -07:00
Zooko O'Whielacronx
9641a6df22
tahoe-get.py: accept vdrive and server options (using optparse)
2007-07-09 18:20:02 -07:00
Zooko O'Whielacronx
8769f2eeba
tahoe-get.py: the first, most primitive command-line client
2007-07-09 18:19:53 -07:00
Brian Warner
dce1dc2730
storage: wrap buckets in a local proxy
...
This will make it easier to change RIBucketWriter in the future to reduce the wire
protocol to just open/write(offset,data)/close, and do all the structuring on the
client end. The ultimate goal is to store each bucket in a single file, to reduce
the considerable filesystem-quantization/inode overhead on the storage servers.
2007-07-08 23:27:46 -07:00
Brian Warner
8891544d6c
directory.xhtml: oops, missed a comma
2007-07-08 00:44:08 -07:00
Brian Warner
295c3a75c2
directory.xhtml: remove the leftover XML link
2007-07-08 00:33:20 -07:00
Brian Warner
0395ad76eb
web: indent the JSON to make it easier for humans to read, but slightly larger
2007-07-08 00:23:23 -07:00
Brian Warner
72fc8c5cb8
web: use real JSON instead of the fake stubs
...
Also include the encoder portion of Bob Ippolito's simplejson-1.7.1 as
allmydata.util.json_encoder . simplejson is distributed under a more liberal
license than Tahoe (looks to be modified BSD), so redistributing it should be ok.
2007-07-08 00:17:11 -07:00
Brian Warner
2d06a66ec1
test_web.test_welcome: give the rooturl a trailing slash, otherwise older versions of twisted complain
2007-07-07 23:22:52 -07:00
Brian Warner
bd8625076a
web: remove t=XML, and other dead code
2007-07-07 22:55:15 -07:00
Brian Warner
159f8bfd50
web: improve test coverage
2007-07-07 22:47:18 -07:00
Brian Warner
e2f99247f2
web: make sure we present read-only directories properly
2007-07-07 22:21:20 -07:00
Brian Warner
135f08a518
web: remove more dead code
2007-07-07 22:20:03 -07:00
Brian Warner
8952114442
webish.py: remove dead code
2007-07-07 22:12:46 -07:00
Brian Warner
62e8528cc6
web: /uri/ must escape slashes, we use bangs for this
2007-07-07 22:06:52 -07:00
Brian Warner
fb40b55bc3
web: replace welcome-page download-URI form with new version
2007-07-07 22:06:22 -07:00
Brian Warner
5b0c9df14c
web: survive bogus URIs when displaying sizes
2007-07-07 21:31:18 -07:00
Brian Warner
fe3c002842
web: show the root name of the vdrive
2007-07-07 21:31:02 -07:00
Brian Warner
9e2ce51de7
web: change title to say 'Tahoe', not tahoe2
2007-07-07 21:30:38 -07:00
Brian Warner
e5482b5254
web: add a 'return to welcome page' link
2007-07-07 21:30:04 -07:00
Brian Warner
2adb773210
web: add when_done to all POST operations, use it from upload/mkdir/mount/delete forms
2007-07-07 21:17:48 -07:00
Brian Warner
0cb154f402
web: make 'delete' buttons work again
2007-07-07 20:46:30 -07:00
Brian Warner
b3f0293d50
web: change per-directory forms to match new POST scheme
2007-07-07 20:35:47 -07:00
Brian Warner
617a85df67
web: remove debug prints
2007-07-07 20:11:30 -07:00
Brian Warner
464f25e5f2
web: more test work, now all tests pass, POST too, only XMLRPC left to implement
2007-07-07 20:06:58 -07:00
Brian Warner
f35c9c6540
test_system.py: change/remove the tests that currently fail due to web changes
2007-07-07 20:06:44 -07:00
Brian Warner
7d92b8a123
webish.py: add links to JSON/etc representations of directory contents to the listing
2007-07-07 11:31:07 -07:00
Brian Warner
5fbdce155c
runner.py: add --force flag to restart, to restart a not-already-running node
2007-07-07 11:17:32 -07:00
Brian Warner
10a5ff3767
webish: fix ?t=manifest, ?t=xml so they don't throw exceptions, prune directory.xhtml
2007-07-07 11:15:31 -07:00
Brian Warner
0cd730a7b3
web: more test work, now all tests either pass or are skipped (POST, XMLRPC, and URI/)
2007-07-07 10:34:05 -07:00
Brian Warner
d501984eba
webapi: checkpointing more test progress
2007-07-07 00:16:36 -07:00
Brian Warner
6570253d6b
checkpointing new webapi: not all tests pass yet
2007-07-06 19:43:55 -07:00
Brian Warner
21e12f383d
web: missed a IndexError-to-KeyError conversion
2007-07-06 19:43:03 -07:00
Brian Warner
71c04fc2e7
web: use KeyError (rather than IndexError) to signal a missing child
2007-07-06 19:40:08 -07:00
Brian Warner
a34040df99
interfaces: remove spurious 'self' from interface declarations
2007-07-06 19:39:47 -07:00
Brian Warner
9e42dda6a4
add IDirectoryNode.get_child_at_path
2007-07-06 19:38:37 -07:00
Brian Warner
a1c97aa0be
storageserver: include metadata in the sizelimit, at least after the bucket has been closed
2007-07-03 17:38:49 -07:00
Brian Warner
94e6e6160b
activate storage size limits in the client. Closes #34 .
...
To use this, write a number like 10MB or 5Gb or 5000000000 to a file
named 'sizelimit' in the client's base directory. The node will not grant
leases for shares that would take it much beyond this many bytes of
storage. Note that metadata is not included in the allocation count until
a restart, so the actual space consumed may grow beyond the limit if
the node is not restarted very frequently and the amount of metadata is
significant.
2007-07-03 17:27:07 -07:00
Brian Warner
c80ea7d693
storageserver: implement size limits. No code to enable them yet, though
2007-07-03 17:08:02 -07:00
Brian Warner
9ddb929651
fileutil: add du() function
2007-07-03 15:49:45 -07:00
Brian Warner
c4a8db3eb2
webish: provide a valid Content-Length header on downloads
2007-07-03 15:09:00 -07:00
Brian Warner
622acc690a
webish: improve reporting of web download errors that occur early enough
...
If the error occurs before any data has been sent, we can give a sensible
error message (code 500, stack trace, etc). This will cover most of the error
cases. The ones that aren't covered are when we run out of good peers after
successfully decoding the first segment, either because they go away or
because their shares are corrupt.
2007-07-03 13:47:37 -07:00
Brian Warner
f15bb302a1
webish.py: handle errors during download better. Addresses #65 .
...
Previously, exceptions during a web download caused a hang rather than some
kind of exception or error message. This patch improves the situation by
terminating the HTTP download rather than letting it hang forever. The
behavior still isn't ideal, however, because the error can occur too late to
abort the HTTP request cleanly (i.e. with an error code). In fact, the
Content-Type header and response code have already been set by the time any
download errors have been detected, so the browser is committed to displaying
an image or whatever (thus any error message we put into the stream is
unlikely to be displayed in a meaningful way).
2007-07-03 13:18:14 -07:00
Brian Warner
7e32d3c8af
test_util: improve test coverage of allmydata.util.fileutil
2007-07-03 11:15:05 -07:00
Brian Warner
6427b44b42
webish: make each link in the directory name an href to that directory
2007-06-29 11:17:18 -07:00
Brian Warner
9d47c2524e
test_system: stall for a second while bouncing the client, it might help windows
2007-06-28 19:20:28 -07:00
Brian Warner
9ecde0d23e
webish: fix link to private_vdrive
2007-06-28 19:07:52 -07:00
Brian Warner
5ffc66ad7b
client.py: remove unused import
2007-06-28 18:01:00 -07:00
Brian Warner
4196c9ff66
client.py: remove unused code
2007-06-28 17:55:13 -07:00
Brian Warner
a8bf0645dc
interfaces.py: remove some unused 'pass' lines
2007-06-29 00:50:00 -07:00
Brian Warner
efb99078b6
change IVirtualDrive.get_node_at_path to accept either a list or a single slash-separated string
2007-06-28 17:46:14 -07:00
Brian Warner
5854916299
test_system.py: more vdrive coverage
2007-06-28 15:05:33 -07:00
Brian Warner
d6e732b65f
vdrive: add get_node_at_path(pathlist)
2007-06-28 11:00:03 -07:00
Brian Warner
13400e24ac
vdrive: make sure we really record global/private root directory uris
2007-06-28 10:59:51 -07:00
Brian Warner
b06c74c2a1
Add the 'vdrive' service, for clients to access the public/private root dirs.
...
These allow client-side code to conveniently retrieve the IDirectoryNode
instances for both the global shared public root directory, and the per-user
private root directory.
2007-06-27 17:11:06 -07:00
Brian Warner
1d86cd161b
webish.py: add a web page to display the manifest for any particular directory
2007-06-26 19:55:21 -07:00
Brian Warner
18ab5ce837
dirnode: add build_manifest() and introduce 'refresh capabilities'
2007-06-26 19:41:20 -07:00
Brian Warner
2766b7988b
remove unused/obsoleted workqueue.py
2007-06-26 17:25:23 -07:00
Brian Warner
b11fa20191
merge vdrive.py and filetable.py into a single dirnode.py
2007-06-26 17:16:58 -07:00
Brian Warner
78c2376fa3
more runner.py test coverage: don't bypass argv parsing
2007-06-26 16:51:38 -07:00
Brian Warner
912fc5a77e
runner.py: improve test coverage further: implement --quiet with StringIOs
2007-06-26 16:19:18 -07:00
Brian Warner
de24d3cd94
dump_uri_extension: improve test coverage of runner.py
2007-06-26 15:55:00 -07:00
Brian Warner
a505560bbe
improve test coverage of runner.py
2007-06-26 15:36:46 -07:00
Brian Warner
b6162681d5
webish: mark read-only directories as such when listing their parent
2007-06-26 12:37:00 -07:00
Brian Warner
bc2603c818
vdrive: protect dirnode contents with an HMAC
2007-06-26 12:36:21 -07:00
Brian Warner
4a0682874b
remove old filetree code
2007-06-25 20:34:19 -07:00
Brian Warner
fb02488a8e
vdrive: switch to URI:DIR and URI:DIR-RO, providing transitive readonlyness
2007-06-25 13:23:51 -07:00
Brian Warner
107207e09d
webish: log dirname in mkdir
2007-06-15 02:48:19 -07:00
Brian Warner
a00bde050b
webish: when mounting a shared directory, don't automatically move to it
2007-06-15 02:34:24 -07:00
Brian Warner
2066e8ddfc
webish: add option to export/import shared directories (always read-write)
2007-06-15 02:31:23 -07:00
