2007-06-11 16:21:42 +00:00
|
|
|
NEW VERSION RELEASED
|
|
|
|
|
2007-06-29 23:58:05 +00:00
|
|
|
We are pleased to announce the release of version 0.4 of Allmydata-Tahoe, a
|
2007-06-11 16:21:42 +00:00
|
|
|
secure, decentralized storage grid under a free-software licence. This is
|
2007-06-29 23:58:05 +00:00
|
|
|
the follow-up to v0.3 which was released June 6, 2007 (see [1]).
|
2007-06-11 16:21:42 +00:00
|
|
|
|
|
|
|
Since then we've made several improvements, including:
|
|
|
|
|
2007-06-29 23:58:05 +00:00
|
|
|
* Add encrypted, mutable directories, so that you can organize your files
|
|
|
|
into directories, change the contents of directories, and share your
|
|
|
|
directories with your friends, without thereby sharing your directories
|
|
|
|
with anyone else -- not even with the owners of the servers that host
|
|
|
|
your directories.
|
2007-06-11 16:21:42 +00:00
|
|
|
|
2007-06-29 23:58:05 +00:00
|
|
|
* make it so that web browsers can connect to the Tahoe node securely with
|
|
|
|
https (ticket #55)
|
2007-06-11 16:21:42 +00:00
|
|
|
|
|
|
|
|
2007-06-29 23:58:05 +00:00
|
|
|
For complete details, see this web page which shows all ticket changes,
|
|
|
|
repository checkins, and wiki changes from June 11 to today, June 29: [2].
|
2007-06-11 16:21:42 +00:00
|
|
|
|
2007-06-29 23:58:05 +00:00
|
|
|
Allmydata-Tahoe v0.4 is incompatible with v0.3 due to the new encrypted
|
|
|
|
directory structure, among other things. (Note that this applies only to
|
|
|
|
directories -- individual files uploaded with v0.3 are probably downloadable
|
|
|
|
with v0.4.)
|
2007-06-11 16:21:42 +00:00
|
|
|
|
|
|
|
|
|
|
|
WHAT IS IT GOOD FOR?
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
The source code that we are releasing is the current working prototype for
|
2007-06-29 23:58:27 +00:00
|
|
|
Allmydata's next-generation product. This release is targeted at hackers
|
|
|
|
and users who are willing to use a minimal, text-oriented web user
|
|
|
|
interface.
|
2007-04-30 04:24:55 +00:00
|
|
|
|
2007-06-11 16:21:42 +00:00
|
|
|
This software is not yet recommended for storage of highly confidential data
|
2007-06-29 23:58:27 +00:00
|
|
|
nor for important data which is not otherwise backed up, but it is useful
|
|
|
|
for experimentation, prototyping, and extension.
|
2007-06-11 16:21:42 +00:00
|
|
|
|
2007-06-29 23:58:27 +00:00
|
|
|
This release of Allmydata-Tahoe is suitable for Use Case #2: "groups of
|
|
|
|
friends who want to share backup and file-sharing" (see the wiki page
|
|
|
|
"UseCases": [3]). It is easy to set up a private grid which is securely
|
|
|
|
shared among a specific, limited set of friends. Files uploaded to this
|
|
|
|
shared grid will be available to all friends, even when some of the
|
|
|
|
computers are unavailable. It is also easy to use a public grid, but to
|
|
|
|
encrypt individual files and directories so that only intended recipients
|
|
|
|
can read them.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-05-01 15:26:47 +00:00
|
|
|
LICENCE
|
|
|
|
|
2007-06-29 23:58:27 +00:00
|
|
|
Tahoe is offered under the GNU General Public License (v2 or later), with
|
|
|
|
the added permission that, if you become obligated to release a derived work
|
2007-05-01 15:26:47 +00:00
|
|
|
under this licence (as per section 2.b), you may delay the fulfillment of
|
|
|
|
this obligation for up to 12 months.
|
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
INSTALLATION
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-06-11 16:21:42 +00:00
|
|
|
This release of Tahoe works on Linux/x86, Linux/amd64, Mac/Intel, Mac/PPC,
|
|
|
|
Windows-native, and Cygwin.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-06-11 16:21:42 +00:00
|
|
|
To install, download the tarball [4], untar it, go into the resulting
|
|
|
|
directory, and follow the directions in the README [5].
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
USAGE
|
|
|
|
|
2007-06-29 23:55:38 +00:00
|
|
|
Once installed, create a "client node". Instruct this client node to
|
|
|
|
connect to a specific "introducer node" by means of config files in the
|
|
|
|
client node's working directory. To join a public grid, copy in the .furl
|
|
|
|
files for that grid. To create a private grid, run your own introducer, and
|
|
|
|
copy its .furl files. See the README for step-by-step instructions.
|
2007-04-20 00:30:06 +00:00
|
|
|
|
|
|
|
Each client node runs a local webserver (enabled by writing the desired port
|
2007-06-29 23:55:38 +00:00
|
|
|
number into a file called 'webport'). The front page of this webserver
|
|
|
|
shows the node's status, including which introducer is being used and which
|
|
|
|
other nodes are connected. Links from the status page lead to others that
|
|
|
|
give access to a shared virtual filesystem, in which each directory is
|
|
|
|
represented by a separate page. Each directory page shows a list of the
|
|
|
|
files available there, with download links, and forms to upload new files.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
Other ways to access the filesystem are planned, as well as other structures
|
2007-06-29 23:55:38 +00:00
|
|
|
than the single globally-shared namespace implemented by this release:
|
|
|
|
please see the roadmap.txt [6] for some rough details.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
HACKING AND COMMUNITY
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-06-11 16:21:42 +00:00
|
|
|
Please join the mailing list [7] to discuss the ideas behind Tahoe and
|
2007-04-19 20:55:13 +00:00
|
|
|
extensions of and uses of Tahoe. Patches that extend and improve Tahoe are
|
2007-05-01 15:26:47 +00:00
|
|
|
gratefully accepted -- roadmap.txt shows the next improvements that we plan
|
2007-06-29 23:58:27 +00:00
|
|
|
to make and CREDITS lists the names of people who've contributed to the
|
|
|
|
project. You can browse the revision control history, source code, and
|
|
|
|
issue tracking at the Trac instance [8]. Please see the buildbot [9], which
|
|
|
|
shows how Tahoe builds and passes unit tests on each checkin, and the code
|
|
|
|
coverage results [10] and percentage-covered graph [11], which show how much
|
|
|
|
of the Tahoe source code is currently exercised by the test suite.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
NETWORK ARCHITECTURE
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
Each peer maintains a connection to each other peer. A single distinct
|
|
|
|
server called an "introducer" is used to discover other peers with which to
|
|
|
|
connect.
|
|
|
|
|
|
|
|
To store a file, the file is encrypted and erasure coded, and each resulting
|
2007-06-29 23:58:27 +00:00
|
|
|
share is uploaded to a different peer. The secure hash of the encrypted
|
|
|
|
file and the encryption key are packed into a URI, knowledge of which is
|
|
|
|
necessary and sufficient to recover the file.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-06-29 23:58:27 +00:00
|
|
|
To fetch a file, starting with the URI, a subset of shares is downloaded
|
|
|
|
from peers, the file is reconstructed from the shares, and then decrypted.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-05-02 20:52:11 +00:00
|
|
|
A single distinct server called a "vdrive server" maintains a global mapping
|
|
|
|
from pathnames/filenames to URIs.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-06-11 16:21:42 +00:00
|
|
|
We are acutely aware of the limitations of decentralization and scalability
|
|
|
|
inherent in this version. In particular, the completely-connected property
|
2007-04-30 20:06:09 +00:00
|
|
|
of the grid and the requirement of a single distinct introducer and vdrive
|
|
|
|
server limits the possible size of the grid. We have plans to loosen these
|
2007-05-01 15:26:47 +00:00
|
|
|
limitations (see roadmap.txt). Currently it should be noted that the grid
|
2007-06-29 23:58:27 +00:00
|
|
|
already depends as little as possible on the accessibility and correctness
|
|
|
|
of the introduction server and the vdrive server. Also note that the choice
|
|
|
|
of which servers to use is easily configured -- you should be able to set up
|
|
|
|
a private grid for you and your friends almost as easily as to connect to
|
|
|
|
our public test grid.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
|
2007-04-20 00:30:06 +00:00
|
|
|
SOFTWARE ARCHITECTURE
|
2007-04-19 20:55:13 +00:00
|
|
|
|
|
|
|
Tahoe is a "from the ground-up" rewrite, inspired by Allmydata's existing
|
2007-06-11 16:21:42 +00:00
|
|
|
consumer backup service. It is primarily written in the Python programming
|
|
|
|
language.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-06-11 16:21:42 +00:00
|
|
|
Tahoe is based on the Foolscap library [12] which provides a remote object
|
|
|
|
protocol inspired by the capability-secure "E" programming language [13].
|
2007-05-01 00:43:06 +00:00
|
|
|
Foolscap allows us to express the intended behavior of the distributed grid
|
|
|
|
directly in object-oriented terms while relying on a well-engineered, secure
|
|
|
|
transport layer.
|
2007-04-19 20:55:13 +00:00
|
|
|
|
2007-06-11 16:21:42 +00:00
|
|
|
The network layer is provided by the Twisted library [14]. Computationally
|
|
|
|
intensive operations are performed in native compiled code, such as the
|
|
|
|
"zfec" library for fast erasure coding (also available separately: [15]).
|
|
|
|
|
|
|
|
Tahoe is sponsored by Allmydata, Inc. [16], a provider of consumer backup
|
|
|
|
services. Allmydata, Inc. contributes hardware, software, ideas, bug
|
|
|
|
reports, suggestions, demands, and money (employing several Allmydata-Tahoe
|
|
|
|
hackers and allowing them to spend part of their work time on the
|
|
|
|
next-generation, free-software project). We are eternally grateful!
|
|
|
|
|
|
|
|
|
2007-06-29 23:58:05 +00:00
|
|
|
Zooko O'Whielacronx and Brian Warner
|
2007-06-11 16:21:42 +00:00
|
|
|
on behalf of the Allmydata-Tahoe team
|
2007-06-29 23:58:05 +00:00
|
|
|
June 29, 2007
|
|
|
|
Boulder, Colorado and San Francisco, California
|
2007-06-11 16:21:42 +00:00
|
|
|
|
|
|
|
|
2007-06-29 23:58:05 +00:00
|
|
|
[1] http://allmydata.org/trac/tahoe/browser/relnotes.txt?rev=790
|
|
|
|
[2] http://allmydata.org/trac/tahoe/timeline?from=2007-06-29&daysback=17&changeset=on&ticket=on&wiki=on&update=Update
|
2007-06-11 16:21:42 +00:00
|
|
|
[3] http://allmydata.org/trac/tahoe/wiki/UseCases
|
2007-06-29 23:58:05 +00:00
|
|
|
[4] http://allmydata.org/source/tahoe/tahoe-0.4.tar.gz
|
|
|
|
[5] http://allmydata.org/trac/tahoe/browser/README?rev=844
|
2007-06-11 16:21:42 +00:00
|
|
|
[6] http://allmydata.org/trac/tahoe/browser/roadmap.txt
|
|
|
|
[7] http://allmydata.org/cgi-bin/mailman/listinfo/tahoe-dev
|
|
|
|
[8] http://allmydata.org/trac/tahoe
|
|
|
|
[9] http://allmydata.org/buildbot
|
|
|
|
[10] http://allmydata.org/tahoe-figleaf/figleaf/
|
|
|
|
[11] http://allmydata.org/tahoe-figleaf-graph/hanford.allmydata.com-tahoe_figleaf.html
|
|
|
|
[12] http://twistedmatrix.com/trac/wiki/FoolsCap
|
|
|
|
[13] http://erights.org/
|
|
|
|
[14] http://twistedmatrix.com/
|
|
|
|
[15] http://allmydata.org/trac/tahoe/browser/src/zfec
|
|
|
|
[16] http://allmydata.com
|
|
|
|
|