ExternalVendorCode/tahoe-lafs
1
0
Fork 0
mirror of https://github.com/tahoe-lafs/tahoe-lafs.git synced 2024-12-22 22:32:23 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
13,786 Commits 185 Branches 90 Tags 89 MiB
012693f6b2
Commit Graph

604 Commits

Author SHA1 Message Date
david-sarah
bac24aee0d Fix pyflakes warnings in misc/ directories other than misc/build_helpers. refs #1557 2011-10-07 03:30:31 +00:00
Brian Warner
1bbdec2a20 show-tool-versions: tolerate missing setuptools 2011-11-01 01:00:10 -07:00
Brian Warner
4baffeed1d show-tool-versions.py: condense output, hide file-not-found exceptions 2011-11-01 00:45:32 -07:00
Brian Warner
4952eef485 show-tool-versions.py: remove setuptools_trial, unused 2011-10-30 17:47:42 -07:00
david-sarah
3142538b0d misc/coding_tools/make-canary-files.py: fix a suspicious capture reported by check-miscaptures (although it happens not to be a bug because the callback will be processed synchronously). refs #1556 2011-10-08 22:05:31 -07:00
david-sarah
cbd0569e45 misc/check-interfaces.py: print a warning if a .pyc or .pyo file exists without a corresponding .py file. 2011-10-12 16:36:09 -07:00
david-sarah
bbb6e5d25e misc/simulators/hashbasedsig.py: simplify by removing unnecessary local function that captured a variable declared in a for loop (this was not a bug, but the code was unclear). Also fix a pyflakes warning about an import. refs #1556 2011-10-06 19:30:01 -07:00
david-sarah
32262239e5 misc/coding_tools/check_interfaces.py: report all violations rather than only one for a given class, by including a forked version of verifyClass. refs #1474 2011-09-16 15:34:50 -07:00
david-sarah
9ca8ff7bfc misc/coding_tools/check_interfaces.py: use os.walk instead of FilePath, since this script shouldn't really depend on Twisted. refs #1474 2011-09-16 14:26:33 -07:00
david-sarah
f1445ce0b2 misc/coding_tools/check-interfaces.py: reduce false-positives by adding Dummy* to the set of excluded classnames, and bench-* to the set of excluded basenames. refs #1474 2011-09-16 14:26:24 -07:00
david-sarah
417054aaba Add a script 'misc/coding_tools/check-interfaces.py' that checks whether zope interfaces are enforced. Also add 'check-interfaces', 'version-and-path', and 'code-checks' targets to the Makefile. fixes #1474 2011-09-15 09:15:32 -07:00
Brian Warner
37cd111009 remove misc/debian[_helpers], rely upon official packaging instead. fixes #1454 2011-08-11 11:27:05 -07:00
david-sarah
91c7cf9007 misc/build_helpers/run_trial.py: undo change to block pywin32 (it didn't work because run_trial.py is no longer used). refs #1334 2011-07-21 20:54:02 -07:00
david-sarah
6e0607f4e0 misc/build_helpers/run_trial.py: ensure that pywin32 is not on the sys.path when running the test suite. Includes some temporary debugging printouts that will be removed. refs #1334 2011-07-21 19:49:07 -07:00
Zooko O'Whielacronx
4f8e3e5ae8 contrib: remove the contributed fuse modules and the entire contrib/ directory, which is now empty 
Also remove a couple of vestigial references to figleaf, which is long gone.
fixes #1409 (remove contrib/fuse)
 2011-07-12 08:32:29 -07:00
david-sarah
a817163cc6 docs: convert NEWS to NEWS.rst and change all references to it. 2011-05-16 18:02:55 -07:00
francois
58af7c8f69 munin tahoe_files plugin: fix incorrect file count 
fixes #1391
 2011-04-27 22:53:12 -07:00
david-sarah
ae3373188c misc/build_helpers/run-with-pythonpath.py: fix pyflakes unused import warning. 2011-01-21 17:50:50 -08:00
david-sarah
06e0d13451 Apply pyflakes to more files and fix the resulting warnings. 2011-01-20 18:10:11 -08:00
david-sarah
5a7c99d29d Change misc/build_helpers/test-with-fake-pkg to use 'setup.py trial'. refs #1296 2011-01-18 20:24:01 -08:00
Brian Warner
1e377c2225 debian/control: add python-twisted-conch to dependencies. Closes #1095. 2011-01-16 23:12:06 -08:00
david-sarah
60d32bb7f7 misc/build_helpers/run_trial.py: fix pyflakes warning. 2011-01-15 00:04:56 -08:00
david-sarah
e2b564024b misc/build_helpers/test-with-fake-dists.py: clean up directories and files only if they exist. 2011-01-14 21:30:11 -08:00
david-sarah
089b27d9f8 misc/build_helpers/test-with-fake-dists.py: wrong arguments in comment. 2011-01-14 20:53:25 -08:00
david-sarah
33786a6d55 Attempt to fix test-with-fake-dist build step. 2011-01-14 18:26:51 -08:00
david-sarah
3ad08e6d2f misc/build_helpers/show-tool-versions.py: remove attempts to show stdout.encoding and stderr.encoding that always printed None due to redirection. Also remove code to show os.path.supports_unicode_filenames which is not useful. refs #1251 2011-01-02 17:51:44 -08:00
Brian Warner
1f0e2574cc update Makefile and coverage2el.py to coverage-3.4 
It might still work with coverage-3.3 if you run with COVERAGE_OMIT=""
 2010-11-25 12:38:32 -08:00
david-sarah
41e96b3e5a misc/build_helpers/run_trial.py: allow the module argument to specify a leaf module rather than a directory. This fixes false positive wrong-source errors in the test-from-prefixdir step when we test only allmydata.test.test_runner. 2010-11-21 15:39:57 -08:00
Zooko O'Whielacronx
f606ce068b misc: gen-package-table: show only the highest-numbered package for each platform and each library 2010-11-19 21:39:05 -08:00
Zooko O'Whielacronx
62af525179 tests: test-with-fake-dists: clean up *just* the pycryptopp-0.5.24 eggs when exiting 
also don't set the PATH and PYTHONPATH, which is unnecessary for this test
also wrap the behavior in a couple of functions, just for tidiness
 2010-11-17 22:31:09 -08:00
Zooko O'Whielacronx
7cda268a78 setup: show-tool-versions: include the version of valgrind 2010-11-17 19:06:23 -08:00
Zooko O'Whielacronx
0730d693e8 setup: clean up fake pycryptopp distribution after test-with-fake-dists.py created it 2010-11-17 01:32:49 -08:00
Zooko O'Whielacronx
8fef758511 tests: test-with-fake-dists.py has the side-effect of injecting a fake package into ./support, so after that test rm -rf ./support, and likewise with ./pycryptopp*.egg. 2010-11-17 01:01:00 -08:00
Zooko O'Whielacronx
bc396b53ab tests: change test-with-fake-pkg to exercise a test suite which actually requires pycryptopp, thus making this a better test which can detect ill-installed pycryptopp 2010-11-17 23:23:34 -08:00
david-sarah
55bd4e254f misc/build_helpers/gen-package-table.py: put 'n/a' in table entries for pywin32 on non-Windows platforms. Also remove some dead code. refs #1247 2010-11-14 11:35:58 -08:00
Zooko O'Whielacronx
51523f7326 setup: include pycryptopp in the set of Python packages described in the show-tool-versions step (for cross-referencing with the test-with-fake-dists step, which behaves differently depending on what version(s) of pycryptopp are already present before it starts) 2010-11-14 02:05:40 -08:00
Zooko O'Whielacronx
6514cd9a29 setup: gen-package-table.py -- Python packages can have . in their name 2010-11-14 00:26:43 -08:00
Zooko O'Whielacronx
c14e20c2f8 setup: David-Sarah's new gen-package-table.py plus my patch to put the newer versions of Python first 
fixes #1247
 2010-11-13 23:35:32 -08:00
Zooko O'Whielacronx
59dcd5014d setup: test whether the build system prefers binary dists which are new enough over source dists which are even newer 
ref: #1233
 2010-11-13 07:28:22 -08:00
Zooko O'Whielacronx
1c449db88f setup: remove separate licensing declaration 
Whenever Free Software/Open Source legal folks are examining the Tahoe-LAFS source code, it seems like there has to be a discussion and documentation about every single licensing declaration. Since this one is (was) permissive, then you would think it could be avoided, but I'm not betting on it. We would probably have to install a copy of the MIT licence into every one of the "copyright" files under the debian/ subdirectory, for example. So: let's just let hashbasedsig.py be licensed the same way as the rest of Tahoe-LAFS.
 2010-11-10 20:45:30 -08:00
david-sarah
901690a029 misc/build_helpers/show-tool-versions.py: look for zetuptoolz egg in the current directory, not the parent. 2010-11-07 15:36:15 -08:00
david-sarah
f7caef635f misc/build_helpers/show-tool-versions.py: if we can't import pkg_resources, insert the bundled zetuptoolz egg onto sys.path. 2010-11-06 14:44:04 -08:00
david-sarah
564f47e5fe misc/build_helpers/gen-package-table.py: allow all lowercase letters except 'w' (for example, 'c' and 'dev') in package versions. 2010-11-05 08:47:56 -07:00
david-sarah
50e9ed3ed0 misc/build_helpers/run_trial.py: minor refactoring -- make variable names consistent between run_trial.py and test_runner.py 2010-11-03 18:20:27 -07:00
Zooko O'Whielacronx
3e1c3a8a79 setup: fix gen-package-table to allow the "_r$REV" version numbers of packages 2010-11-04 00:39:44 -07:00
david-sarah
af4822d2d8 misc/build_helpers/gen-package-table.py: fix missing 'r's (meant to delete CRs :-) 2010-11-02 21:37:18 -07:00
david-sarah
a643558f04 add misc/build_helpers/gen-package-table.py. refs #1247 2010-11-02 21:33:28 -07:00
Zooko O'Whielacronx
c3b1bca954 tests: make test-with-fake-pkg's unacceptably-old fake pycryptopp be 0.5.13 instead of 0.5.17, since 0.5.17 is acceptably new on non-x86 archs 
Also move the fakepkgs directory to be in misc/build_helpers/ instead of in the base of the source tree.
 2010-11-01 22:33:57 -07:00
Zooko O'Whielacronx
582417c3ca setup: add platform.machine() to show-tool-versions, because FreeStorm WinXP builder apparently thinks that its platform.machine() is not one of ['i386', 'x86_64', 'amd64', ''], since it is requiring pycryptopp >= 0.5.14 instead of pycryptopp >= 0.5.20 2010-10-31 21:27:21 -07:00
david-sarah
8eca94e498 misc/build_helpers/run_trial.py: fix another typo in last patch. 2010-10-31 09:03:32 -07:00
david-sarah
7da0457ee5 misc/build_helpers/run_trial.py: fix typo in last patch. 2010-10-31 08:52:15 -07:00
david-sarah
74996ffe46 misc/build_helpers/run_trial.py: fix false positive on directory check that can occur when running run_trial from test-with-fake-pkg manually. 2010-10-31 08:36:13 -07:00
Zooko O'Whielacronx
0ab6211da4 setup: show-tool-versions: emit module and __version__ information even when module name != distribution (package) name, and add TwistedCore, TwistedWeb, and TwistedConch 2010-10-30 00:02:33 -07:00
david-sarah
7cec440a14 misc/build_helpers/test-with-fake-pkg.py: look for eggs in the parent of the src directory. refs #1190 2010-10-29 20:43:03 -07:00
david-sarah
8835f009d0 misc/build_helpers/run_trial.py: look for zetuptoolz egg in the parent directory, not the cwd of run_trial. refs #1190 2010-10-29 16:03:29 -07:00
david-sarah
fd02946074 setup.py, misc/build_helpers/run_trial.py: use undocumented __requires__ variable to cause setuptools/zetuptoolz to put the correct versions of dependencies on sys.path. Also ensure that run_trial adds the bundled zetuptoolz egg at the start of sys.path if present. Make the source directory comparison work correctly for the test-with-fake-pkg build step. refs #1190 2010-10-29 15:28:25 -07:00
david-sarah
390c40cd8c add misc/build_helpers/test-with-fake-pkg.py. refs #1190 2010-10-28 19:51:50 -07:00
Zooko O'Whielacronx
5c31a7079b setup: catch and log ValueError from locale.getdefaultlocale() in show-tool-versions.py 
I got a bug report from Mathias Baert showing that locale.getdefaultlocale() raises an exception on his Mac OS X system. Heh.
 2010-10-14 22:44:40 -07:00
Zooko O'Whielacronx
4c30b80061 setup: add flappclient to the set of tools reported on by show-tool-versions 2010-09-23 00:23:25 -07:00
Zooko O'Whielacronx
76594cb955 setup: format the output of show-tool-versions for better human-readability 2010-09-20 15:54:15 -07:00
Zooko O'Whielacronx
0cc0d19f57 setup: make show-tool-versions report entire verbose exception stack traces when it fails to find a Python package 2010-09-18 18:15:54 -07:00
Zooko O'Whielacronx
a5ebcfa4df setup: add information about setuptools_darcs and darcsver to the show-tool-versions output 2010-09-18 15:04:10 -07:00
Zooko O'Whielacronx
04fabe3a69 misc: add docstring to bench_spans.py telling how to run it 
ref #1182
 2010-09-10 21:14:42 -07:00
Zooko O'Whielacronx
8beb5ea799 add simulator to explore the trade-offs for hashed-based digital signatures 2010-08-18 20:06:30 -07:00
Zooko O'Whielacronx
2b534b0a5e misc: add benchmarking tool for spans 2010-08-18 19:14:20 -07:00
david-sarah
cd8d41584e test_storage.py: change skip note for test_large_share to say that Windows doesn't support sparse files. refs #569 2010-08-04 19:26:12 -07:00
Brian Warner
cd360c847c check-umids: oops, forgot to add the tool 2010-08-04 00:17:13 -07:00
Brian Warner
818089644a coverage tools: ignore errors, display lines-uncovered in elisp mode. Fix Makefile paths. 2010-08-04 00:11:31 -07:00
Brian Warner
6c2a4f0d0f misc/simulators/sizes.py: update, we now use SHA256 (not SHA1), so large-file overhead grows to 0.5% 2010-08-04 00:09:42 -07:00
Brian Warner
eee70fba35 storage-overhead: try to fix, probably still broken 2010-08-04 00:08:15 -07:00
david-sarah
66a0604c71 misc/build_helpers/show-tool-versions.py: get sys.std{out,err}.encoding and 'as' version correctly, and improve formatting. 2010-08-03 03:11:28 -07:00
david-sarah
cd7fb133b7 misc/build_helpers/show-tool-versions.py: avoid error message when 'as -version' does not create a.out. 2010-08-03 02:48:12 -07:00
david-sarah
3af6f19cb0 misc/build_helpers/run_trial.py: check that the root from which the module we are testing was loaded is the current directory. This version of the patch folds in later fixes to the logic for caculating the directories to compare, and improvements to error messages. addresses #1137 2010-08-01 21:55:35 -07:00
Zooko O'Whielacronx
302760a339 docs: fix licensing typo that was earlier fixed in [20090921164651-92b7f-7f97b58101d93dc588445c52a9aaa56a2c7ae336] 
I wish we didn't copies of this licensing text in several different files so that changes can be accidentally omitted from some of them.
 2010-07-28 22:29:23 -07:00
david-sarah
9c6ec58be5 misc/build_helpers/run-with-pythonpath.py: fix stale comment, and remove 'trial' example that is not the right way to run trial. 2010-07-26 15:57:29 -07:00
Zooko O'Whielacronx
6bcf7a465f setup: show-tool-versions.py: print out the output from the unix command "locale" and re-arrange encoding data a little bit 2010-06-08 21:07:14 -07:00
Zooko O'Whielacronx
73689bbfd3 setup: add zope.interface to the packages described by show-tool-versions.py 2010-06-08 20:49:15 -07:00
david-sarah
5adc1d789d show-tool-versions.py: platform.linux_distribution() is not always available 2010-06-07 17:45:23 -07:00
david-sarah
1e70a8303f show-tool-versions.py: show platform.linux_distribution() 2010-06-07 17:38:29 -07:00
Zooko O'Whielacronx
d826db89af setup: update authorship, datestamp, licensing, and add special exceptions to allow combination with Eclipse- and QPL- licensed code 2010-06-06 23:23:29 -07:00
Zooko O'Whielacronx
1fc6be28f4 setup: organize misc/ scripts and tools and remove obsolete ones 
This is for ticket #1068.
 2010-06-06 22:16:18 -07:00
Zooko O'Whielacronx
bcb03583d7 setup: loosen the Desert Island test to allow it to check the network for new packages as long as it doesn't actually download any 
(You can look but don't touch.)
 2010-06-06 10:57:17 -07:00
Zooko O'Whielacronx
68d292a968 setup: have the buildbots print out locale.getpreferredencoding(), locale.getdefaultlocale(), locale.getlocale(), and os.path.supports_unicode_filenames 
Even though that latter one is completely useless, I'm curious.
 2010-06-05 09:29:32 -07:00
Francois Deppierraz
bed23ee6d6 misc/show-tool-versions.py: Display additional Python interpreter encoding informations (stdout, stdin and filesystem) 2010-05-21 02:43:13 -07:00
Zooko O'Whielacronx
7b3a9a3d0e setup: remove bundled zipfile egg of setuptools 
We're about to replace it with bundled unpacked source code of setuptools, which is much nicer for debugging and evolving under revision control.
 2010-05-23 13:51:20 -07:00
Zooko O'Whielacronx
6eb84564c6 setup: remove bundled copy of setuptools_trial-0.5.2.tar 
Hopefully it will get installed automatically as needed and we won't bundle it anymore.
 2010-05-22 15:15:39 -07:00
Zooko O'Whielacronx
0b306e31ce setup: remove bundled setuptools_darcs-1.2.8.tar 
This version of setuptools_darcs had a bug when used on Windows which has been fixed in setuptools_darcs-1.2.9. Hopefully we will not need to bundle a copy of setuptools_darcs-1.2.9 in with Tahoe-LAFS and can instead rely on it to be downloaded from PyPI or bundled in the "tahoe deps" separate tarball.
 2010-05-21 18:53:33 -07:00
freestorm77
b78323e7ae run_trial.darcspath 2010-05-10 16:28:29 -07:00
Zooko O'Whielacronx
e60b968be2 setup: new improved misc/show-tool-versions.py 2010-05-15 22:01:22 -07:00
Zooko O'Whielacronx
2da57bab5f setup: fix typos in misc/show-tool-versions.py 2010-05-09 23:36:15 -07:00
Zooko O'Whielacronx
77189291c4 setup: show code-coverage tool versions in show-tools-versions.py 2010-05-09 23:29:55 -07:00
Zooko O'Whielacronx
82b9b91775 docs: update README, mv it to README.txt, update setup.py 2010-05-04 02:43:40 -07:00
Zooko O'Whielacronx
122e01e710 setup: reorder and extend the show-tool-versions script, the better to glean information about our new buildslaves 2010-05-03 21:56:43 -07:00
david-sarah
42ebd2dc64 Fix another typo in tahoe_storagespace munin plugin 2010-04-16 15:09:35 -07:00
freestorm77
08fc553fe9 munin-tahoe_storagespace 
Plugin configuration rename
 2010-02-21 14:36:26 -07:00
Zooko O'Whielacronx
de5cf49eba setup: add licensing declaration for setuptools (noticed by the FSF compliance folks) 2010-03-09 10:44:15 -08:00
Zooko O'Whielacronx
34a50b857a docs: a few small edits to try to guide newcomers through the docs 
These edits were suggested by my watching over Jake Appelbaum's shoulder as he completely ignored/skipped/missed install.html and also as he decided that debian.txt wouldn't help him with basic installation. Then I threw in a few docs edits that have been sitting around in my sandbox asking to be committed for months.
 2010-03-03 15:19:02 -08:00
Brian Warner
625ad78877 misc/coverage.el: improve filename matching 2010-02-23 23:47:57 -05:00
Peter Secor
8f3246430b docs running.html - "tahoe run ." does not work with the current installation, replaced with "tahoe start ." 2010-02-06 08:53:20 -08:00
Brian Warner
880f824103 code coverage: replace figleaf with coverage.py, should work on py2.6 now. 
It still lacks the right HTML report (the builtin report is very pretty, but
lacks the "lines uncovered" numbers that I want), and the half-finished
delta-from-last-run measurements.
 2010-02-03 08:54:21 -08:00
david-sarah
584c0ed487 Fix boodlegrid use of set_children 2010-01-25 22:34:14 -08:00
Zooko O'Whielacronx
7afccbdabc docs: CREDITS: add David-Sarah to the CREDITS file 2010-01-08 22:04:35 -08:00
Brian Warner
800fc176ec misc/ringsim.py: make it deterministic, more detail about grid-is-full behavior 2009-12-26 21:48:32 -05:00
Brian Warner
aa102da804 misc/ringsim.py: tool to discuss #302 2009-12-26 01:03:39 -05:00
Zooko O'Whielacronx
00a44c057a docs: a few licensing clarifications requested by Ubuntu 2009-09-26 20:32:26 -07:00
Zooko O'Whielacronx
aaaa633f18 setup: remove a convenience copy of figleaf, to ease inclusion into Ubuntu Karmic Koala 
We need to carefully document the licence of figleaf in order to get Tahoe-LAFS into Ubuntu Karmic Koala.  However, figleaf isn't really a part of Tahoe-LAFS per se -- this is just a "convenience copy" of a development tool.  The quickest way to make Tahoe-LAFS acceptable for Karmic then, is to remove figleaf from the Tahoe-LAFS tarball itself.  People who want to run figleaf on Tahoe-LAFS (as everyone should want) can install figleaf themselves.  I haven't tested this -- there may be incompatibilities between upstream figleaf and the copy that we had here...
 2009-09-23 22:32:15 -07:00
Zooko O'Whielacronx
abdf8a6f10 setup: shebang for misc/build-deb.py to fail quickly 
Without this patch, when I ran "chmod +x ./misc/build-deb.py && ./misc/build-deb.py" then it hung indefinitely.  (I wonder what it was doing.)
 2009-08-19 06:56:26 -07:00
Zooko O'Whielacronx
603e08c4a9 doc: licensing cleanups 
Use nice utf-8 © instead of "(c)". Remove licensing statements on utility modules that have been assigned to allmydata.com by their original authors. (Nattraverso was not assigned to allmydata.com -- it was LGPL'ed -- but I checked and src/allmydata/util/iputil.py was completely rewritten and doesn't contain any line of code from nattraverso.)  Add notes to misc/debian/copyright about licensing on files that aren't just allmydata.com-licensed.
 2009-09-20 10:16:31 -07:00
Brian Warner
9dd27bc7ee build-deb.py: run darcsver early, otherwise we get the wrong version later on 2009-09-17 20:36:20 -07:00
Brian Warner
7dc17aa078 new approach for debian packaging, sharing pieces across distributions. Still experimental, still only works for sid. 2009-08-18 12:05:27 -07:00
Brian Warner
24b1805ca0 new experimental deb-packaging rules. Only works for sid so far. 2009-08-17 18:40:52 -07:00
Zooko O'Whielacronx
69f0d306e7 setup: remove bundled version of darcsver-1.2.1 
That version of darcsver emits a scary error message when the darcs executable or the _darcs subdirectory is not found.
This error is hidden (unless the --loud option is passed) in darcsver >= 1.3.1.
Fixes #788.
 2009-08-16 16:34:32 -07:00
Zooko O'Whielacronx
2a63fc9159 docs: update relnotes.txt, relnotes-short.txt, and others documentation bits for v1.5.0 release! 2009-08-01 19:57:10 -07:00
Brian Warner
ba904dfeb5 debian/control: update binary package deps to pycryptopp-0.5.15 2009-07-20 23:50:25 -04:00
Zooko O'Whielacronx
6cbaaf31b5 mac: emit the stdout and stderr from a failed call to Allmydata (this is very useful diagnostic info) 2009-07-14 18:43:38 -07:00
Zooko O'Whielacronx
d2132213e3 mac: improve shutdown and clean-up after the test of the macintosh packaging 2009-07-14 05:26:55 -07:00
Zooko O'Whielacronx
4a4a47a66d setup: add "test_mac_diskimage" command which attempts to mount and use a .dmg to make sure it has a good Tahoe distribution in it 2009-07-12 16:09:40 -07:00
Zooko O'Whielacronx
7682f6b120 setup: add sys.maxunicode to the show-tool-versions output in order to investigate http://bugs.python.org/setuptools/issue78 2009-07-08 17:45:33 -07:00
Brian Warner
d79b2a02b4 clean up debian packaging: we have control files for etch/lenny/sid, and 
everything else uses one of those. Add dependency on python-pysqlite2 for
platforms that use py2.4 by default. Update foolscap dependency to 0.4.1.
 2009-07-03 00:28:04 -07:00
Brian Warner
5626e17725 * find-trailing-spaces.py: exit rc=1 if whitespace found, to be a pre-commit hook 2009-06-29 15:46:58 -07:00
Zooko O'Whielacronx
18876466f5 setup: copy in misc/show-tools-version.py from zfec -- it prints out platform and setuptools versions 2009-06-20 22:58:46 -07:00
Zooko O'Whielacronx
2a51a7bb90 setup: run the same "make quicktest" on Windows as on non-Windows 
I checked and it behaves about as well on Windows as the previous version did.
 2009-06-11 12:32:14 -07:00
Brian Warner
8e25066753 misc/run-with-pythonpath.py: exec() the child (on unix), to remove the intermediate process 2009-06-01 14:01:37 -07:00
Brian Warner
a0e3c586b2 fix quicktest: stop using setuptools, add misc/run-with-pythonpath.py, to make it run faster 2009-04-14 13:14:00 -07:00
Zooko O'Whielacronx
55de7c3fed setup: specify in the debian/control files that tahoe is compatible with Python 2.6 2009-03-11 15:59:02 -07:00
Zooko O'Whielacronx
cc9adba8a3 setup: update the debian/copyright text to reflect the current licences 2009-03-11 08:29:52 -07:00
Brian Warner
247c23904c misc/*: remove RuntimeError too 2009-02-22 17:34:01 -07:00
Brian Warner
c2a2e93089 move show-tool-versions out of setup.py and into a separate script in misc/ , since setuptools is trying to build and install a bunch of stuff first 2009-02-19 01:35:58 -07:00
Zooko O'Whielacronx
5a21cecd67 setup: add new darcsver-1.2.1 which includes Brian's and Nils Durner's patch to ignore non-ascii chars in XML output 2009-02-11 15:52:53 -07:00
Zooko O'Whielacronx
912b4ebf13 setup: removed bundled darcsver-1.2.0 
(I'm about to add a new bundled darcsver-1.2.1, but I want to see what the buildbots will do when there is no bundled darcsver present.)
 2009-02-11 14:19:04 -07:00
Zooko O'Whielacronx
4d785cfe30 setup: bundle setuptools-0.6c12dev (our own toothpick of setuptools) this version completes my patch to fix http://bugs.python.org/setuptools/issue54 , which is necessary for tahoe to build with --prefix=support without doing a lot of PYTHONPATH gymnastics around the call to setup.py 2009-02-05 09:28:18 -07:00
Zooko O'Whielacronx
c900ed8e69 setup: remove old bundled setuptools-0.6c11dev (our own toothpick of setuptools) 2009-02-05 09:27:58 -07:00
Zooko O'Whielacronx
40179a0ed8 setup: merge recent patches that change the set of bundled tools in misc/dependencies/ 2009-02-04 13:32:22 -07:00
Zooko O'Whielacronx
7d22cd4547 setup: bundle new setuptools_trial 2009-02-04 13:24:54 -07:00
Zooko O'Whielacronx
4df4efbaf0 setup: remove old bundled setuptools_trial 2009-02-04 13:24:42 -07:00
Zooko O'Whielacronx
944aa25709 setup: bundle new setuptools_darcs 2009-02-04 13:24:29 -07:00
Zooko O'Whielacronx
a2c1a93822 setup: remove old bundled setuptools_darcs 2009-02-04 13:24:18 -07:00
Zooko O'Whielacronx
759698224a roll back the upgrade of the bundled setuptools_trial from 0.5 to 0.5.1 
Upgrading setuptools trial in that way leads to a very tricky problem in setuptools's handling of recursive installation of the build-time dependencies of build-time dependencies...

rolling back:

Tue Feb  3 22:17:18 MST 2009  zooko@zooko.com
  * setup: bundle new setuptools_trial-0.5.1

    A ./misc/dependencies/setuptools_trial-0.5.1.tar
Tue Feb  3 22:17:32 MST 2009  zooko@zooko.com
  * setup: remove old bundled setuptools_trial

    R ./misc/dependencies/setuptools_trial-0.5.tar
 2009-02-04 01:38:36 -07:00
Zooko O'Whielacronx
05030112e8 setup: remove old bundled setuptools_trial 2009-02-03 23:17:32 -07:00
Zooko O'Whielacronx
313080fbf0 setup: bundle new setuptools_trial-0.5.1 2009-02-03 23:17:18 -07:00
Zooko O'Whielacronx
4af8c8cd24 setup: bundle new setuptools_darcs-1.2.5 2009-02-03 23:17:04 -07:00
Zooko O'Whielacronx
4988d1e81c setup: remove old bundled setuptools_darcs 2009-02-03 23:16:40 -07:00
Zooko O'Whielacronx
6e10a9c499 setup: remove bundled darcsver in gzipped format 2009-02-03 23:16:28 -07:00
Zooko O'Whielacronx
c613660500 setup: bundle darcsver in ungzipped format 2009-02-03 23:16:17 -07:00
Zooko O'Whielacronx
0c91a467e8 setup: remove old bundled setuptools-0.6c10dev (our own toothpick of setuptools) 2009-02-02 22:23:04 -07:00
Zooko O'Whielacronx
5c0d937eec setup: bundle setuptools-0.6c11dev (our own toothpick of setuptools) 
Hopefully this one fixes the issue with easy_install not searching the sys.path for packages that were requested to be installed, (setuptools #17), thus allowing us to do away with the "--site-dirs=" kludges, which are currently breaking some of our buildbots.
 2009-02-02 22:19:50 -07:00
Brian Warner
d8d4070e98 misc/dependencies: update setuptools_trial from 0.4 to 0.5 2009-02-02 17:36:57 -07:00
Zooko O'Whielacronx
6a4d5abc1d setup: add new bundled darcsver-1.2.0 2009-01-29 12:51:15 -07:00
Zooko O'Whielacronx
20d2136e24 setup: remove old bundled darcsver-1.1.8 2009-01-29 12:51:02 -07:00
Zooko O'Whielacronx
16f0fef785 setup: bundle darcsver-1.1.8 2009-01-28 14:03:26 -07:00
Zooko O'Whielacronx
4945dd0b0a setup: remove old bundled dependency darcsver-1.1.5 2009-01-28 12:20:12 -07:00
Brian Warner
8d6bdb5856 diskwatcher: cache growth results (which take 30s to generate) for 3 minutes, to help munin, which invokes it 6 times in a row every 5 minutes 2009-01-25 17:06:39 -07:00
Zooko O'Whielacronx
0dbc0f1194 setup: add new bundled setuptools_trial-0.4 2009-01-20 17:40:12 -07:00
Zooko O'Whielacronx
8351d9d41e setup: remove old bundled setuptools_trial-0.2 2009-01-20 17:39:18 -07:00
Zooko O'Whielacronx
4cd02cc12f setup: bundle setuptools_trial in misc/dependencies/ 2008-12-01 11:44:38 -07:00
Brian Warner
6ec352fe92 misc/cpu-watcher.tac: tolerate disk-full errors when writing the pickle, and pickle corruption from earlier disk-full errors 2008-12-05 15:54:12 -07:00
Brian Warner
995a16e3b1 misc/spacetime/diskwatcher.tac: remove dead code 2008-11-19 14:05:52 -07:00
Brian Warner
d224d22cb7 munin/tahoe_disktotal: add a 'disk used' line, since it will always be less than disktotal 2008-11-18 15:44:31 -07:00
Brian Warner
1e024d5e82 munin/tahoe_introstats: add line for distinct-storage-hosts (which counts machines instead of nodes) 2008-11-18 15:32:38 -07:00
Brian Warner
7d68e4397b munin/tahoe_diskused: new plugin to show total disk space used across the grid 2008-11-18 01:25:25 -07:00
Brian Warner
3d03e5257c munin/tahoe_disktotal: new plugin to show total disk space (used and unused) in the grid 2008-11-18 00:51:01 -07:00
Brian Warner
0a819e2912 diskwatcher: record total-space (the size of the disk as reported by df) in the db, report it to HTTP clients. This will involve a 50-item-per-second upgrade process when it is first used on old data 2008-11-17 21:45:16 -07:00
Zooko O'Whielacronx
eae5403e5a shebang: replace "/usr/bin/python" with "/usr/bin/env python" 2008-11-04 18:03:06 -07:00
Zooko O'Whielacronx
24650490ed misc/fixshebangs.py 2008-11-04 18:01:30 -07:00
Zooko O'Whielacronx
9f299ad55b setup: include _pkgutil.py in setuptools bootstrap egg so that it will work on Python 2.4 2008-10-25 08:28:39 -07:00
Zooko O'Whielacronx
8f260826b4 setup: remove old bundled setuptools-0.6c9 2008-10-25 06:49:47 -07:00
Zooko O'Whielacronx
3c974763ab setup: bundle an SVN snapshot of setuptools instead of the most recent stable release of setuptools 
This SVN snapshot fixes a problem that prevents the setting up of nevow:
http://bugs.python.org/setuptools/issue20
 2008-10-25 06:48:37 -07:00
Zooko O'Whielacronx
cd015228d5 setup: bundle setuptools-0.6c9 2008-09-30 13:04:48 -07:00
Zooko O'Whielacronx
8cad310dc8 setup: remove bundled setuptools-0.6c8 2008-09-30 13:03:36 -07:00
Brian Warner
f3d730428f misc/incident-gatherer: add classify_tahoe.py: a foolscap incident-gatherer classification plugin 2008-10-15 15:09:40 -07:00
Brian Warner
06770f720e misc/cpu-watcher.tac: use writeaside-and-rename for the history.pickle file 2008-09-30 17:30:53 -07:00
Brian Warner
3aba70bbcf misc/spacetime: use async polling so we can add a 60-second timeout, add an index to the 'url' Axiom column for 2x speedup 2008-09-30 16:34:48 -07:00
Brian Warner
1a3f154c21 munin/tahoe_doomsday: oops, tolerate 'null' in the timeleft results, to unbreak the 2wk/4wk graphs 2008-09-30 13:20:51 -07:00
Brian Warner
1f9af40fd4 misc/make-canary-files.py: tool to create 'canary files', explained in the docstring 2008-09-24 17:47:16 -07:00
Brian Warner
d4b522bedf misc/make_umid: change docs, make elisp code easier to grab 2008-09-20 11:39:33 -07:00
Brian Warner
cf27f81a88 misc/check-build.py: ignore the 'Downloading file:..' line that occurs for the setup_requires= -triggered handling of the setuptools egg 2008-09-16 22:17:25 -07:00
Brian Warner
1853020a5f #249: add 'test-desert-island', to assert that a tahoe-deps.tar.gz -enabled build does not download anything 2008-09-16 18:37:02 -07:00
Brian Warner
fafdf58e41 #249: move dependent libs out of misc/dependencies/, get them from tahoe-deps.tar.gz instead 2008-09-16 18:25:45 -07:00
Brian Warner
7da70b8197 misc/xfer-client.py: small foolscap utility to transfer a file to a waiting server 2008-09-08 16:19:03 -07:00
Brian Warner
be11bfe812 munin: add tahoe_diskleft plugin, update spacetime/diskwatcher.tac to support it 2008-08-28 13:32:36 -07:00
Brian Warner
d47d19cbfb debian: include misc/cpu-watcher.tac in the debian package 2008-08-27 15:30:26 -07:00
Brian Warner
482b3e0939 munin/tahoe_doomsday: change the graph title, 'time predictor' is more accurate than 'space predictor' 2008-08-27 14:30:13 -07:00
Brian Warner
ba6e525952 munin/tahoe_diskusage: clip the graph at zero, to prevent transient negative excursions (such as when a lot of old logfiles are deleted from a storage server's disk) from scaling the graph into unusability 2008-08-27 12:35:43 -07:00
Brian Warner
96a1ec33b8 misc/make_umid: little script and elisp fragment to insert umid= arguments 2008-08-25 18:59:18 -07:00
Brian Warner
743ca91bcd munin diskusage/doomsday: oops, fix labels, everything was reported in the 1hr column 2008-08-11 13:34:31 -07:00
Brian Warner
8828fe8769 munin/tahoe_overhead: don't emit non-sensicial numbers 2008-08-07 14:40:08 -07:00
Brian Warner
f7ad0d2f6f munin: add tahoe_overhead plugin, to measure effectiveness of GC and deleting data from inactive accounts 2008-08-07 13:39:25 -07:00
Brian Warner
39db60cc2b diskwatcher.tac: include total-bytes-used 2008-08-07 13:12:14 -07:00
Brian Warner
1c36a52db5 misc/dependencies: remove the no-longer-useful foolscap-0.2.5 tarball 2008-08-07 11:45:46 -07:00
Brian Warner
f77af25ef7 diskwatcher.tac: don't report negative timeleft 2008-08-07 10:34:33 -07:00
Brian Warner
7502971df6 diskwatcher.tac: reduce the polling rate to once per hour 2008-08-06 23:20:21 -07:00
Brian Warner
e19564df59 misc/spacetime: add munin plugins, add everything to .deb 2008-08-06 23:00:03 -07:00
Brian Warner
7fbfbcbe4d diskwatcher.tac: hush pyflakes 2008-08-06 22:04:27 -07:00
Brian Warner
730a28aa0d diskwatcher.tac: add async-GET code, but leave it commented out: urlopen() seems to work better for now 2008-08-06 22:03:27 -07:00
Brian Warner
c90bc3ad71 cpu-watcher.tac: improve error message 2008-08-06 21:38:01 -07:00
Brian Warner
46d0c9c995 disk-watcher: first draft of a daemon to use the HTTP stats interface and its new storage_server.disk_avail feature, to track changes in disk space over time 2008-08-06 21:22:22 -07:00
Brian Warner
4863b17371 misc/cpu-watcher.tac: tolerate missing pidfiles, just skip over that sample 2008-08-06 21:17:05 -07:00
Brian Warner
027408b9d2 debian/control: update dependencies to match _auto_deps: foolscap-0.3.0, pycryptopp-0.5 2008-08-05 18:32:22 -07:00
Brian Warner
315a89f9d8 munin/tahoe_spacetime: show 2wk data even if 4wk data is unavailable 2008-07-28 12:42:33 -07:00
Zooko O'Whielacronx
497aedfab9 simulate_load: put it in friendnet mode and print out a sum of doubled shares 2008-07-21 14:11:06 -07:00
Brian Warner
870fb68620 munin/tahoe_server_latency: add percentile to graph title 2008-07-16 16:08:17 -07:00
Brian Warner
af0648c0f8 munin/serverops: improve graph title 2008-07-16 12:36:42 -07:00
Brian Warner
5b3868ae2e debian/rules: put munin plugins in /usr/share/PACKAGENAME/munin/, make them +x, remove packagename from rules to make branches easier to manage 2008-07-15 18:47:41 -07:00
Brian Warner
43b54c1abb sid/control: set python versions to 2.4,2.5 , to match feisty/control, since sid has had 2.5 available forever now 2008-07-15 18:42:38 -07:00
Brian Warner
340b7add4f debian/changelog: remove all versions but 0.0.1, so debchange can always override it. The 'deb-X' Makefile targets should not be used; run 'make deb-X-head' instead 2008-07-15 15:23:41 -07:00
Brian Warner
390c5c6ca5 munin/tahoe_stats: add server operations per second (allocate/get/writev/readv 2008-07-14 13:25:35 -07:00
Brian Warner
0f231e2e66 munin/tahoe_stats: rearrange config a bit, no functional changes 2008-07-14 13:25:01 -07:00
Brian Warner
6525742b37 munin/tahoe_server_operations: fix comments 2008-07-14 13:18:47 -07:00
Brian Warner
a72dfcc00d munin: add plugin for storage-server operations per second 2008-07-14 13:18:11 -07:00
Brian Warner
d14d6d0985 copy debian/sid changes to debian/feisty 2008-07-14 12:56:38 -07:00
Brian Warner
7eaead0fcc debian/sid: add more docs to package, including munin plugins 2008-07-14 12:55:34 -07:00
Brian Warner
b2f062ab82 misc/munin: add server_latency plugin 2008-07-14 12:29:19 -07:00
Zooko O'Whielacronx
0e77fe1e92 misc/simulate_load.py: fix bug in which only K shares were uploaded instead of N, and fix the x axis in place so that successive runs can be compared 2008-07-12 16:54:29 -07:00
Zooko O'Whielacronx
f969c5f80e misc/simulate_load.py: use a more realistic distribution of file sizes, and automate the formatting of the ascii art so that it fits in 70 columns and the number of files uploaded is properly marked 2008-07-12 15:37:27 -07:00
Zooko O'Whielacronx
b483c4710d add misc/simulate_load.py in an attempt to understand why permuting the peerlist per each storage index matters 2008-07-12 14:26:22 -07:00
Brian Warner
f303670265 misc/munin: rename plugins to make munin happy: use underscores rather than hyphens, remove .py suffix 2008-07-11 15:21:13 -07:00
Brian Warner
503ce1cbd7 remove obsolete tahoe-sharesperfile munin plugin 2008-07-11 15:17:33 -07:00
Brian Warner
38252b6df1 remove tahoe-dirnodes.py munin plugin, it is way obsolete 2008-07-11 15:14:28 -07:00
Zooko O'Whielacronx
9bd1cdcdd8 setup: remove bundled darcsver-1.1.2.tar 2008-06-21 14:04:26 -07:00
Zooko O'Whielacronx
c151c13b5e setup: bundle darcsver-1.1.5 into misc/dependencies 
Once we implement #249 (move bundled dependencies out of revision control history and make them optional) then we can stop doing this.  Until then we try not to do it unless we really need to...
 2008-06-21 13:56:24 -07:00
Zooko O'Whielacronx
52a5651da2 setup: remove Nevow 0.9.18 tarball from misc/dependencies 
The 0.9.18 version of Nevow doesn't declare its dependency on Twisted in a machine-readable way ( http://divmod.org/trac/ticket/2629 ).  Neither does the current release of Nevow (0.9.31), but hopefully a future release of Nevow in the near future will fix this.
Also, we're going to be managing external dependencies like this in a separate darcs repository in the future instead of checking them into our Tahoe source tree.
 2008-06-09 11:41:56 -07:00
Zooko O'Whielacronx
b06ba64214 setup: quote the results of misc/find_trial.py so that they can be passed through a shell even if they contain spaces 2008-06-05 15:59:45 -07:00
Brian Warner
c23f675095 misc/munin/tahoe_spacetime.py: add a munin plugin to estimate how much time remains before you run out of space 2008-05-28 11:33:54 -07:00
Brian Warner
15b373ad9c misc/delete-old-helper.sh: simple script to delete old+abandoned helper files 2008-05-27 21:17:20 -07:00
Brian Warner
74df0b58b5 munin: add tahoe_cpu_watcher.py, to track the data from misc/cpu-watcher.tac 2008-05-07 13:19:08 -07:00
Brian Warner
79147a3f6a misc/cpu-watcher*: add some tools to monitor CPU usage of arbitrary processes, like tahoe nodes 2008-05-07 12:34:29 -07:00
Zooko O'Whielacronx
b1583ac6a0 setup: remove bundled pycryptopp-0.3.0.tar 2008-05-06 08:24:46 -07:00
Zooko O'Whielacronx
045e2bcdf4 setup: bundle pycryptopp-0.5.1.tar 
pycryptopp-0.3.0 incorrectly crypts AES (depending on compiler and version of Crypto++ used)
Very soon now we're going to set up an "ext" repository to hold all tarballs and no longer check them into our trunk source tree.
 2008-05-06 08:23:36 -07:00
Brian Warner
773e9abe24 debian: add python-setuptools to the debian install-time dependencies. Should close #382. 2008-04-24 16:01:04 -07:00
Brian Warner
d2a2b8a4ae munin/tahoe_estimate_files.py: tool to estimate the total number of slots (mutable and immutable combined) in the grid, from a small sample 2008-04-24 11:28:35 -07:00
robk-tahoe
5f5ed6b08d munin stats: fix typo in mutable file stats 2008-04-23 15:50:29 -07:00
robk-tahoe
f74042c75e munin stats: add mutable/uploader traffic graphs 
this adds munin graphs to present data already published by nodes to
the stats_gatherer, namely mutable files published/retrieved, and 
immutable files uploaded, and the bytes thereof
 2008-04-23 14:39:41 -07:00
Brian Warner
239c950810 munin/tahoe-stats.py: category is 'counters' not 'stats', use DERIVE 2008-04-23 14:03:23 -07:00
Zooko O'Whielacronx
1e2698713b setup: remove the misc/hatch-eggs.py script, which we no longer use since [1937] 2008-04-23 13:41:56 -07:00
Zooko O'Whielacronx
ece902a4cf setup: windows: make sub-ver.py treat None as 0 2008-04-21 06:37:13 -07:00
Brian Warner
5afc26f1d1 misc/sizes.py: update to match current defaults: 128KiB segsize, 3-of-10 2008-04-16 16:29:53 -07:00
Brian Warner
77c3c616ab misc/boodlegrid.tac: tweak sounds a bit 2008-04-15 11:01:49 -07:00
Brian Warner
500934b72f helper stats: fix the /helper_status page, the recent conflict merging missed some uses. Added tests, updated the munin plugins to match 2008-04-14 13:18:53 -07:00
robk-tahoe
766deaa9b6 stats_gatherer: reconcile helper stats gathering 
I'd implemented stats gathering hooks in the helper a while back.
Brian did the same without reference to my changes.  This reconciles
those two changes, encompassing all the stats in both changes,
implemented through the stats_provider interface.

this also provide templates for all 10 helper graphs in the 
tahoe-stats munin plugin.
 2008-04-10 17:25:44 -07:00
robk-tahoe
d8f3521a02 munin: added a series of munin graphs to report upload helper state 2008-03-25 18:30:46 -07:00
Brian Warner
623d82a130 debian: use our own /usr/bin/tahoe, remove runtime dependency on setuptools (since it required egg-aware versions of all dependencies too) 2008-04-10 16:29:59 -07:00
Brian Warner
5cfccbf44f debian: we now require setuptools at build time, and that or pkg_resources at runtime 2008-04-10 15:43:56 -07:00
Brian Warner
3f61198042 debian: use setuptools-generated support/bin/tahoe instead of bin/tahoe, to match Zooko's change that makes our in-tree bin/tahoe spawn support/bin/tahoe 2008-04-10 14:36:27 -07:00
Brian Warner
d36d731752 oops, change debian dependency on zfec to 1.1, not 1.1.0 2008-04-09 17:45:52 -07:00
Brian Warner
5385ec8fc9 make debian dependencies match _auto_deps.py ones, for foolscap and zfec 2008-04-09 10:23:01 -07:00
Brian Warner
ec77a5dc92 update our misc/dependencies to have foolscap-0.2.5 2008-04-03 16:08:22 -07:00
Brian Warner
fb51a60993 munin plugins: add 'graph_category tahoe' 2008-03-28 16:18:30 -07:00
Brian Warner
5da9f42cf8 add munin/tahoe-rootdir-space 2008-03-28 16:18:09 -07:00
Brian Warner
da6ab9f522 munin/tahoe-introstats.py: put this graph in the 'tahoe' category 2008-03-28 14:51:37 -07:00
Brian Warner
6b416fc28c helper: add another munin plugin 2008-03-27 16:50:30 -07:00