2007-10-15 21:56:02 +00:00
|
|
|
NEW VERSION RELEASED -- Allmydata-Tahoe version 0.6.1
|
2007-06-11 16:21:42 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
We are pleased to announce the release of version 0.6.1 of
|
|
|
|
allmydata.org "Tahoe", a secure, decentralized storage grid under a
|
|
|
|
free-software licence. This is the successor to v0.6, which was
|
2007-10-16 04:33:25 +00:00
|
|
|
released September 24, 2007 (see [1]). This release focusses on
|
2007-10-15 21:56:02 +00:00
|
|
|
packaging, documentation, and usability improvements.
|
2007-06-11 16:21:42 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
Since v0.6 we've made the following changes:
|
2007-08-23 20:51:41 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
* Make the command-line tool it automatically stash its state in a
|
|
|
|
directory ("~/.tahoe" by default), and make it automatically get
|
|
|
|
the capability to access your private vdrive from the state
|
|
|
|
directory. (ticket #120)
|
2007-08-23 20:51:41 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
* Add the "tahoe mv" command. (ticket #162)
|
2007-09-24 21:32:31 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
* Rewrite the README and add README.win32 to make it clearer which
|
|
|
|
steps are required to build from source. (ticket #148)
|
2007-09-24 21:32:31 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
* Establish port 8123 as the default web port on localhost so that
|
|
|
|
people can share full URLs that start with
|
|
|
|
"http://localhost:8123/".
|
2007-09-19 21:26:46 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
* Update webapi.txt [2] to reflect the security fix from ticket #98.
|
2007-08-23 20:51:41 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
* Add more automated performance measurements and graphs on the
|
|
|
|
Performance page [3].
|
2007-06-11 16:21:42 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
* Rename the command-line tool from "allmydata-tahoe" to "tahoe".
|
|
|
|
(ticket #155)
|
2007-09-19 02:24:16 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
We also improved numerous small issues in packaging, documentation,
|
|
|
|
usability, testing, and source code maintenance. For complete
|
|
|
|
details, see this web page which shows all the changes we made between
|
|
|
|
the last release and this one: [4].
|
2007-08-16 23:52:22 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
Allmydata.org Tahoe v0.6.1 is compatible with Allmydata.org Tahoe
|
|
|
|
v0.6.
|
2007-06-11 16:21:42 +00:00
|
|
|
|
|
|
|
|
|
|
|
WHAT IS IT GOOD FOR?
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-08-16 23:03:02 +00:00
|
|
|
With Tahoe, you can store your files in a distributed way across a set
|
2007-10-15 21:56:02 +00:00
|
|
|
of computers, such that if some of the computers fail, you can
|
|
|
|
retrieve your data from the remaining computers. You can also
|
|
|
|
securely share your files with other users.
|
2007-07-23 01:21:29 +00:00
|
|
|
|
|
|
|
This release is targeted at hackers and users who are willing to use a
|
|
|
|
text-oriented web user interface, or a command-line user interface.
|
|
|
|
(Or a RESTful API. Just telnet to localhost and type HTTP requests to
|
2007-08-17 19:25:09 +00:00
|
|
|
get started.)
|
2007-07-23 01:21:29 +00:00
|
|
|
|
2007-08-07 21:23:23 +00:00
|
|
|
Because this software is new, it is not yet recommended for storage of
|
|
|
|
highly confidential data nor for important data which is not otherwise
|
2007-08-17 19:25:09 +00:00
|
|
|
backed up. Given that caveat, this software works and there are no
|
2007-10-15 21:56:02 +00:00
|
|
|
major known security flaws which would compromise confidentiality or
|
|
|
|
data integrity. (For a current description of all known security
|
|
|
|
issues and an overview of Tahoe's security properties, please see the
|
|
|
|
Security web page: [5].)
|
2007-08-07 21:23:23 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
This release of Tahoe is suitable for the "friendnet" use case [6].
|
2007-08-17 19:25:09 +00:00
|
|
|
It is easy to set up a private grid which is securely shared among a
|
|
|
|
specific, limited set of friends. Files uploaded to this shared grid
|
|
|
|
will be available to all friends, even when some of the computers are
|
|
|
|
unavailable. It is also easy to encrypt individual files and
|
|
|
|
directories so that only designated recipients can read them.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-05-01 15:26:47 +00:00
|
|
|
LICENCE
|
|
|
|
|
2007-07-05 01:59:26 +00:00
|
|
|
Tahoe is offered under the GNU General Public License (v2 or later),
|
|
|
|
with the added permission that, if you become obligated to release a
|
|
|
|
derived work under this licence (as per section 2.b), you may delay
|
2007-08-16 23:03:02 +00:00
|
|
|
the fulfillment of this obligation for up to 12 months. If you are
|
2007-08-17 19:25:09 +00:00
|
|
|
obligated to release code under section 2.b of this licence, you are
|
|
|
|
obligated to release it under these same terms, including the 12-month
|
|
|
|
grace period clause.
|
2007-05-01 15:26:47 +00:00
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
INSTALLATION
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-09-22 03:03:27 +00:00
|
|
|
Tahoe works on Linux, Mac OS X, Windows, Cygwin, and Solaris. For
|
2007-10-15 21:56:02 +00:00
|
|
|
installation instructions please see the README [7].
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-08-17 19:25:09 +00:00
|
|
|
USAGE - web interface
|
2007-04-20 00:30:06 +00:00
|
|
|
|
2007-06-29 23:55:38 +00:00
|
|
|
Once installed, create a "client node". Instruct this client node to
|
2007-07-05 01:59:26 +00:00
|
|
|
connect to a specific "introducer node" by means of config files in
|
2007-08-17 19:25:09 +00:00
|
|
|
the client node's working directory. To join a grid, copy in the
|
|
|
|
.furl files for that grid. To create a private grid, run your own
|
2007-07-05 01:59:26 +00:00
|
|
|
introducer, and copy its .furl files. See the README for step-by-step
|
|
|
|
instructions.
|
|
|
|
|
2007-09-18 22:04:30 +00:00
|
|
|
Each client node can run a local webserver (enabled by writing the
|
2007-08-17 19:25:09 +00:00
|
|
|
desired port number into a file called 'webport'). The welcome page
|
|
|
|
of this webserver shows the node's status, including which introducer
|
2007-09-18 22:04:30 +00:00
|
|
|
is being used and which other nodes are connected.
|
2007-08-17 19:25:09 +00:00
|
|
|
|
|
|
|
Links from the welcome page lead to other pages that give access to a
|
|
|
|
virtual filesystem, in which each directory is represented by a
|
|
|
|
separate page. Each directory page shows a list of the files
|
|
|
|
available there, with download links, and forms to upload new files.
|
|
|
|
|
|
|
|
USAGE - command-line interface
|
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
Run "tahoe ls [VIRTUAL PATH NAME]" to list the contents of a virtual
|
|
|
|
directory. Run "tahoe get [VIRTUAL FILE NAME] [LOCAL FILE NAME]" to
|
|
|
|
download a file. Run "tahoe put [LOCAL FILE NAME] [VIRTUAL FILE
|
|
|
|
NAME]" to upload a file. Run "tahoe rm [VIRTUAL PATH NAME]" to unlink
|
|
|
|
a file or directory in the virtual drive. Run "tahoe --help" to learn
|
|
|
|
about more commands.
|
2007-08-17 19:25:09 +00:00
|
|
|
|
|
|
|
USAGE - other
|
2007-07-05 01:59:26 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
You can control the filesystem through the RESTful web API [2]. Other
|
2007-09-18 22:04:30 +00:00
|
|
|
ways to access the filesystem are planned: please see the
|
2007-10-15 21:56:02 +00:00
|
|
|
roadmap.txt [8] for some plans.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
HACKING AND COMMUNITY
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
Please join the mailing list [9] to discuss the ideas behind Tahoe and
|
2007-07-05 01:59:26 +00:00
|
|
|
extensions of and uses of Tahoe. Patches that extend and improve
|
2007-10-15 21:56:02 +00:00
|
|
|
Tahoe are gratefully accepted -- roadmap.txt [8] shows the next
|
|
|
|
improvements that we plan to make and CREDITS [10] lists the names of
|
|
|
|
people who've contributed to the project. The wiki Dev page [11]
|
2007-09-18 22:04:30 +00:00
|
|
|
collects various hacking resources including revision history
|
2007-10-15 21:56:02 +00:00
|
|
|
browsing, automated test results, automated performance tests, graphs
|
|
|
|
of how many people are using the public test grid for how many files,
|
|
|
|
and more.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
NETWORK ARCHITECTURE
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-07-05 01:59:26 +00:00
|
|
|
Each peer maintains a connection to each other peer. A single
|
|
|
|
distinct server called an "introducer" is used to discover other peers
|
|
|
|
with which to connect.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-07-05 01:59:26 +00:00
|
|
|
To store a file, the file is encrypted and erasure coded, and each
|
|
|
|
resulting share is uploaded to a different peer. The secure hash of
|
|
|
|
the encrypted file and the encryption key are packed into a URI,
|
|
|
|
knowledge of which is necessary and sufficient to recover the file.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-07-05 01:59:26 +00:00
|
|
|
To fetch a file, starting with the URI, a subset of shares is
|
|
|
|
downloaded from peers, the file is reconstructed from the shares, and
|
|
|
|
then decrypted.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-07-05 01:59:26 +00:00
|
|
|
A single distinct server called a "vdrive server" maintains a global
|
|
|
|
mapping from pathnames/filenames to URIs.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
We are aware of certain limitations on decentralization and
|
2007-07-05 01:59:26 +00:00
|
|
|
scalability inherent in this version. In particular, the
|
|
|
|
completely-connected property of the grid and the requirement of a
|
|
|
|
single distinct introducer and vdrive server limits the possible size
|
|
|
|
of the grid. We have plans to loosen these limitations (see
|
|
|
|
roadmap.txt). Currently it should be noted that the grid already
|
|
|
|
depends as little as possible on the accessibility and correctness of
|
|
|
|
the introduction server and the vdrive server. Also note that the
|
2007-09-18 22:04:30 +00:00
|
|
|
choice of which servers to use is easily configured -- you can set up
|
|
|
|
a private grid for you and your friends as easily as connecting to our
|
|
|
|
public test grid.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
SOFTWARE ARCHITECTURE
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-07-05 01:59:26 +00:00
|
|
|
Tahoe is a "from the ground-up" rewrite, inspired by Allmydata's
|
2007-10-15 21:56:02 +00:00
|
|
|
existing consumer backup service as well as by its ancestor Mojo
|
2007-09-24 21:32:31 +00:00
|
|
|
Nation. It is primarily written in the Python programming language.
|
2007-07-05 01:59:26 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
Tahoe is based on the Foolscap library [12] which provides a remote
|
2007-07-05 01:59:26 +00:00
|
|
|
object protocol inspired by the capability-secure "E" programming
|
2007-10-15 21:56:02 +00:00
|
|
|
language [13]. Foolscap allows us to express the intended behavior of
|
2007-07-05 01:59:26 +00:00
|
|
|
the distributed grid directly in object-oriented terms while relying
|
|
|
|
on a well-engineered, secure transport layer.
|
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
The network layer is provided by the Twisted library [14].
|
2007-07-05 01:59:26 +00:00
|
|
|
Computationally intensive operations are performed in native compiled
|
|
|
|
code, such as the "zfec" library for fast erasure coding (also
|
2007-10-15 21:56:02 +00:00
|
|
|
available separately: [15]).
|
2007-09-18 22:04:30 +00:00
|
|
|
|
|
|
|
|
|
|
|
SPONSORSHIP
|
2007-07-05 01:59:26 +00:00
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
Tahoe is sponsored by Allmydata, Inc. [16], a provider of consumer
|
2007-07-05 01:59:26 +00:00
|
|
|
backup services. Allmydata, Inc. contributes hardware, software,
|
|
|
|
ideas, bug reports, suggestions, demands, and money (employing several
|
2007-08-17 20:33:03 +00:00
|
|
|
allmydata.org Tahoe hackers and allowing them to spend part of their
|
|
|
|
work time on the next-generation, free-software project). We are
|
|
|
|
eternally grateful!
|
2007-06-11 16:21:42 +00:00
|
|
|
|
|
|
|
|
2007-10-15 21:56:02 +00:00
|
|
|
Zooko O'Whielacronx
|
|
|
|
on behalf of the allmydata.org team
|
|
|
|
October 15, 2007
|
|
|
|
Boulder, Colorado
|
|
|
|
|
|
|
|
|
|
|
|
[1] http://allmydata.org/trac/tahoe/browser/relnotes.txt?rev=1346
|
|
|
|
[2] http://allmydata.org/trac/tahoe/browser/docs/webapi.txt?rev=1428
|
|
|
|
[3] http://allmydata.org/trac/tahoe/wiki/Performance
|
|
|
|
[4] http://allmydata.org/trac/tahoe/timeline?from=2007-10-15&daysback=21&changeset=on&milestone=on&ticket=on&ticket_details=on&wiki=on
|
|
|
|
[5] http://allmydata.org/trac/tahoe/wiki/Security
|
|
|
|
[6] http://allmydata.org/trac/tahoe/wiki/UseCases
|
|
|
|
[7] http://allmydata.org/trac/tahoe/browser/README?rev=1424
|
|
|
|
[8] http://allmydata.org/trac/tahoe/browser/roadmap.txt
|
|
|
|
[9] http://allmydata.org/cgi-bin/mailman/listinfo/tahoe-dev
|
|
|
|
[10] http://allmydata.org/trac/tahoe/browser/CREDITS?rev=1424
|
|
|
|
[11] http://allmydata.org/trac/tahoe/wiki/Dev
|
|
|
|
[12] http://foolscap.lothar.com/trac
|
|
|
|
[13] http://erights.org/
|
|
|
|
[14] http://twistedmatrix.com/
|
|
|
|
[15] http://pypi.python.org/pypi/zfec
|
|
|
|
[16] http://allmydata.com
|