david-sarah
4d6260d6ad
check-miscaptures.py: report the number of files that were not analysed due to syntax errors (and don't count them in the number of suspicious captures). refs #1555
2011-10-09 05:03:01 +00:00
david-sarah
efd3c8b113
check-miscaptures.py: handle corner cases around default arguments correctly. Also make a minor optimization when there are no assigned variables to consider. refs #1555
2011-10-09 04:50:23 +00:00
david-sarah
5359c24e99
check-miscaptures.py: Python doesn't really have declarations; report the topmost assignment. refs #1555
2011-10-09 04:48:00 +00:00
david-sarah
1c6fe1d230
check-miscaptures.py: handle destructuring function arguments correctly. refs #1555
2011-10-09 04:47:10 +00:00
david-sarah
d2f3ef9714
check-miscaptures.py: check while loops and list comprehensions as well as for loops. Also fix a pyflakes warning. refs #1555
2011-10-09 04:40:22 +00:00
david-sarah
be1c94893f
Add misc/coding_tools/check-miscaptures.py to detect incorrect captures of variables declared in a for loop, and a 'make check-miscaptures' Makefile target to run it. (It is also run by 'make code-checks'.) This is a rewritten version that reports much fewer false positives, by determining captured variables more accurately. fixes #1555
2011-10-07 07:41:21 +00:00
david-sarah
bac24aee0d
Fix pyflakes warnings in misc/ directories other than misc/build_helpers. refs #1557
2011-10-07 03:30:31 +00:00
Brian Warner
1bbdec2a20
show-tool-versions: tolerate missing setuptools
2011-11-01 01:00:10 -07:00
Brian Warner
4baffeed1d
show-tool-versions.py: condense output, hide file-not-found exceptions
2011-11-01 00:45:32 -07:00
Brian Warner
4952eef485
show-tool-versions.py: remove setuptools_trial, unused
2011-10-30 17:47:42 -07:00
david-sarah
3142538b0d
misc/coding_tools/make-canary-files.py: fix a suspicious capture reported by check-miscaptures (although it happens not to be a bug because the callback will be processed synchronously). refs #1556
2011-10-08 22:05:31 -07:00
david-sarah
cbd0569e45
misc/check-interfaces.py: print a warning if a .pyc or .pyo file exists without a corresponding .py file.
2011-10-12 16:36:09 -07:00
david-sarah
bbb6e5d25e
misc/simulators/hashbasedsig.py: simplify by removing unnecessary local function that captured a variable declared in a for loop (this was not a bug, but the code was unclear). Also fix a pyflakes warning about an import. refs #1556
2011-10-06 19:30:01 -07:00
david-sarah
32262239e5
misc/coding_tools/check_interfaces.py: report all violations rather than only one for a given class, by including a forked version of verifyClass. refs #1474
2011-09-16 15:34:50 -07:00
david-sarah
9ca8ff7bfc
misc/coding_tools/check_interfaces.py: use os.walk instead of FilePath, since this script shouldn't really depend on Twisted. refs #1474
2011-09-16 14:26:33 -07:00
david-sarah
f1445ce0b2
misc/coding_tools/check-interfaces.py: reduce false-positives by adding Dummy* to the set of excluded classnames, and bench-* to the set of excluded basenames. refs #1474
2011-09-16 14:26:24 -07:00
david-sarah
417054aaba
Add a script 'misc/coding_tools/check-interfaces.py' that checks whether zope interfaces are enforced. Also add 'check-interfaces', 'version-and-path', and 'code-checks' targets to the Makefile. fixes #1474
2011-09-15 09:15:32 -07:00
Brian Warner
37cd111009
remove misc/debian[_helpers], rely upon official packaging instead. fixes #1454
2011-08-11 11:27:05 -07:00
david-sarah
91c7cf9007
misc/build_helpers/run_trial.py: undo change to block pywin32 (it didn't work because run_trial.py is no longer used). refs #1334
2011-07-21 20:54:02 -07:00
david-sarah
6e0607f4e0
misc/build_helpers/run_trial.py: ensure that pywin32 is not on the sys.path when running the test suite. Includes some temporary debugging printouts that will be removed. refs #1334
2011-07-21 19:49:07 -07:00
Zooko O'Whielacronx
4f8e3e5ae8
contrib: remove the contributed fuse modules and the entire contrib/ directory, which is now empty
...
Also remove a couple of vestigial references to figleaf, which is long gone.
fixes #1409 (remove contrib/fuse)
2011-07-12 08:32:29 -07:00
david-sarah
a817163cc6
docs: convert NEWS to NEWS.rst and change all references to it.
2011-05-16 18:02:55 -07:00
francois
58af7c8f69
munin tahoe_files plugin: fix incorrect file count
...
fixes #1391
2011-04-27 22:53:12 -07:00
david-sarah
ae3373188c
misc/build_helpers/run-with-pythonpath.py: fix pyflakes unused import warning.
2011-01-21 17:50:50 -08:00
david-sarah
06e0d13451
Apply pyflakes to more files and fix the resulting warnings.
2011-01-20 18:10:11 -08:00
david-sarah
5a7c99d29d
Change misc/build_helpers/test-with-fake-pkg to use 'setup.py trial'. refs #1296
2011-01-18 20:24:01 -08:00
Brian Warner
1e377c2225
debian/control: add python-twisted-conch to dependencies. Closes #1095 .
2011-01-16 23:12:06 -08:00
david-sarah
60d32bb7f7
misc/build_helpers/run_trial.py: fix pyflakes warning.
2011-01-15 00:04:56 -08:00
david-sarah
e2b564024b
misc/build_helpers/test-with-fake-dists.py: clean up directories and files only if they exist.
2011-01-14 21:30:11 -08:00
david-sarah
089b27d9f8
misc/build_helpers/test-with-fake-dists.py: wrong arguments in comment.
2011-01-14 20:53:25 -08:00
david-sarah
33786a6d55
Attempt to fix test-with-fake-dist build step.
2011-01-14 18:26:51 -08:00
david-sarah
3ad08e6d2f
misc/build_helpers/show-tool-versions.py: remove attempts to show stdout.encoding and stderr.encoding that always printed None due to redirection. Also remove code to show os.path.supports_unicode_filenames which is not useful. refs #1251
2011-01-02 17:51:44 -08:00
Brian Warner
1f0e2574cc
update Makefile and coverage2el.py to coverage-3.4
...
It might still work with coverage-3.3 if you run with COVERAGE_OMIT=""
2010-11-25 12:38:32 -08:00
david-sarah
41e96b3e5a
misc/build_helpers/run_trial.py: allow the module argument to specify a leaf module rather than a directory. This fixes false positive wrong-source errors in the test-from-prefixdir step when we test only allmydata.test.test_runner.
2010-11-21 15:39:57 -08:00
Zooko O'Whielacronx
f606ce068b
misc: gen-package-table: show only the highest-numbered package for each platform and each library
2010-11-19 21:39:05 -08:00
Zooko O'Whielacronx
62af525179
tests: test-with-fake-dists: clean up *just* the pycryptopp-0.5.24 eggs when exiting
...
also don't set the PATH and PYTHONPATH, which is unnecessary for this test
also wrap the behavior in a couple of functions, just for tidiness
2010-11-17 22:31:09 -08:00
Zooko O'Whielacronx
7cda268a78
setup: show-tool-versions: include the version of valgrind
2010-11-17 19:06:23 -08:00
Zooko O'Whielacronx
0730d693e8
setup: clean up fake pycryptopp distribution after test-with-fake-dists.py created it
2010-11-17 01:32:49 -08:00
Zooko O'Whielacronx
8fef758511
tests: test-with-fake-dists.py has the side-effect of injecting a fake package into ./support, so after that test rm -rf ./support, and likewise with ./pycryptopp*.egg.
2010-11-17 01:01:00 -08:00
Zooko O'Whielacronx
bc396b53ab
tests: change test-with-fake-pkg to exercise a test suite which actually requires pycryptopp, thus making this a better test which can detect ill-installed pycryptopp
2010-11-17 23:23:34 -08:00
david-sarah
55bd4e254f
misc/build_helpers/gen-package-table.py: put 'n/a' in table entries for pywin32 on non-Windows platforms. Also remove some dead code. refs #1247
2010-11-14 11:35:58 -08:00
Zooko O'Whielacronx
51523f7326
setup: include pycryptopp in the set of Python packages described in the show-tool-versions step (for cross-referencing with the test-with-fake-dists step, which behaves differently depending on what version(s) of pycryptopp are already present before it starts)
2010-11-14 02:05:40 -08:00
Zooko O'Whielacronx
6514cd9a29
setup: gen-package-table.py -- Python packages can have . in their name
2010-11-14 00:26:43 -08:00
Zooko O'Whielacronx
c14e20c2f8
setup: David-Sarah's new gen-package-table.py plus my patch to put the newer versions of Python first
...
fixes #1247
2010-11-13 23:35:32 -08:00
Zooko O'Whielacronx
59dcd5014d
setup: test whether the build system prefers binary dists which are new enough over source dists which are even newer
...
ref: #1233
2010-11-13 07:28:22 -08:00
Zooko O'Whielacronx
1c449db88f
setup: remove separate licensing declaration
...
Whenever Free Software/Open Source legal folks are examining the Tahoe-LAFS source code, it seems like there has to be a discussion and documentation about every single licensing declaration. Since this one is (was) permissive, then you would think it could be avoided, but I'm not betting on it. We would probably have to install a copy of the MIT licence into every one of the "copyright" files under the debian/ subdirectory, for example. So: let's just let hashbasedsig.py be licensed the same way as the rest of Tahoe-LAFS.
2010-11-10 20:45:30 -08:00
david-sarah
901690a029
misc/build_helpers/show-tool-versions.py: look for zetuptoolz egg in the current directory, not the parent.
2010-11-07 15:36:15 -08:00
david-sarah
f7caef635f
misc/build_helpers/show-tool-versions.py: if we can't import pkg_resources, insert the bundled zetuptoolz egg onto sys.path.
2010-11-06 14:44:04 -08:00
david-sarah
564f47e5fe
misc/build_helpers/gen-package-table.py: allow all lowercase letters except 'w' (for example, 'c' and 'dev') in package versions.
2010-11-05 08:47:56 -07:00
david-sarah
50e9ed3ed0
misc/build_helpers/run_trial.py: minor refactoring -- make variable names consistent between run_trial.py and test_runner.py
2010-11-03 18:20:27 -07:00
Zooko O'Whielacronx
3e1c3a8a79
setup: fix gen-package-table to allow the "_r$REV" version numbers of packages
2010-11-04 00:39:44 -07:00
david-sarah
af4822d2d8
misc/build_helpers/gen-package-table.py: fix missing 'r's (meant to delete CRs :-)
2010-11-02 21:37:18 -07:00
david-sarah
a643558f04
add misc/build_helpers/gen-package-table.py. refs #1247
2010-11-02 21:33:28 -07:00
Zooko O'Whielacronx
c3b1bca954
tests: make test-with-fake-pkg's unacceptably-old fake pycryptopp be 0.5.13 instead of 0.5.17, since 0.5.17 is acceptably new on non-x86 archs
...
Also move the fakepkgs directory to be in misc/build_helpers/ instead of in the base of the source tree.
2010-11-01 22:33:57 -07:00
Zooko O'Whielacronx
582417c3ca
setup: add platform.machine() to show-tool-versions, because FreeStorm WinXP builder apparently thinks that its platform.machine() is not one of ['i386', 'x86_64', 'amd64', ''], since it is requiring pycryptopp >= 0.5.14 instead of pycryptopp >= 0.5.20
2010-10-31 21:27:21 -07:00
david-sarah
8eca94e498
misc/build_helpers/run_trial.py: fix another typo in last patch.
2010-10-31 09:03:32 -07:00
david-sarah
7da0457ee5
misc/build_helpers/run_trial.py: fix typo in last patch.
2010-10-31 08:52:15 -07:00
david-sarah
74996ffe46
misc/build_helpers/run_trial.py: fix false positive on directory check that can occur when running run_trial from test-with-fake-pkg manually.
2010-10-31 08:36:13 -07:00
Zooko O'Whielacronx
0ab6211da4
setup: show-tool-versions: emit module and __version__ information even when module name != distribution (package) name, and add TwistedCore, TwistedWeb, and TwistedConch
2010-10-30 00:02:33 -07:00
david-sarah
7cec440a14
misc/build_helpers/test-with-fake-pkg.py: look for eggs in the parent of the src directory. refs #1190
2010-10-29 20:43:03 -07:00
david-sarah
8835f009d0
misc/build_helpers/run_trial.py: look for zetuptoolz egg in the parent directory, not the cwd of run_trial. refs #1190
2010-10-29 16:03:29 -07:00
david-sarah
fd02946074
setup.py, misc/build_helpers/run_trial.py: use undocumented __requires__ variable to cause setuptools/zetuptoolz to put the correct versions of dependencies on sys.path. Also ensure that run_trial adds the bundled zetuptoolz egg at the start of sys.path if present. Make the source directory comparison work correctly for the test-with-fake-pkg build step. refs #1190
2010-10-29 15:28:25 -07:00
david-sarah
390c40cd8c
add misc/build_helpers/test-with-fake-pkg.py. refs #1190
2010-10-28 19:51:50 -07:00
Zooko O'Whielacronx
5c31a7079b
setup: catch and log ValueError from locale.getdefaultlocale() in show-tool-versions.py
...
I got a bug report from Mathias Baert showing that locale.getdefaultlocale() raises an exception on his Mac OS X system. Heh.
2010-10-14 22:44:40 -07:00
Zooko O'Whielacronx
4c30b80061
setup: add flappclient to the set of tools reported on by show-tool-versions
2010-09-23 00:23:25 -07:00
Zooko O'Whielacronx
76594cb955
setup: format the output of show-tool-versions for better human-readability
2010-09-20 15:54:15 -07:00
Zooko O'Whielacronx
0cc0d19f57
setup: make show-tool-versions report entire verbose exception stack traces when it fails to find a Python package
2010-09-18 18:15:54 -07:00
Zooko O'Whielacronx
a5ebcfa4df
setup: add information about setuptools_darcs and darcsver to the show-tool-versions output
2010-09-18 15:04:10 -07:00
Zooko O'Whielacronx
04fabe3a69
misc: add docstring to bench_spans.py telling how to run it
...
ref #1182
2010-09-10 21:14:42 -07:00
Zooko O'Whielacronx
8beb5ea799
add simulator to explore the trade-offs for hashed-based digital signatures
2010-08-18 20:06:30 -07:00
Zooko O'Whielacronx
2b534b0a5e
misc: add benchmarking tool for spans
2010-08-18 19:14:20 -07:00
david-sarah
cd8d41584e
test_storage.py: change skip note for test_large_share to say that Windows doesn't support sparse files. refs #569
2010-08-04 19:26:12 -07:00
Brian Warner
cd360c847c
check-umids: oops, forgot to add the tool
2010-08-04 00:17:13 -07:00
Brian Warner
818089644a
coverage tools: ignore errors, display lines-uncovered in elisp mode. Fix Makefile paths.
2010-08-04 00:11:31 -07:00
Brian Warner
6c2a4f0d0f
misc/simulators/sizes.py: update, we now use SHA256 (not SHA1), so large-file overhead grows to 0.5%
2010-08-04 00:09:42 -07:00
Brian Warner
eee70fba35
storage-overhead: try to fix, probably still broken
2010-08-04 00:08:15 -07:00
david-sarah
66a0604c71
misc/build_helpers/show-tool-versions.py: get sys.std{out,err}.encoding and 'as' version correctly, and improve formatting.
2010-08-03 03:11:28 -07:00
david-sarah
cd7fb133b7
misc/build_helpers/show-tool-versions.py: avoid error message when 'as -version' does not create a.out.
2010-08-03 02:48:12 -07:00
david-sarah
3af6f19cb0
misc/build_helpers/run_trial.py: check that the root from which the module we are testing was loaded is the current directory. This version of the patch folds in later fixes to the logic for caculating the directories to compare, and improvements to error messages. addresses #1137
2010-08-01 21:55:35 -07:00
Zooko O'Whielacronx
302760a339
docs: fix licensing typo that was earlier fixed in [20090921164651-92b7f-7f97b58101d93dc588445c52a9aaa56a2c7ae336]
...
I wish we didn't copies of this licensing text in several different files so that changes can be accidentally omitted from some of them.
2010-07-28 22:29:23 -07:00
david-sarah
9c6ec58be5
misc/build_helpers/run-with-pythonpath.py: fix stale comment, and remove 'trial' example that is not the right way to run trial.
2010-07-26 15:57:29 -07:00
Zooko O'Whielacronx
6bcf7a465f
setup: show-tool-versions.py: print out the output from the unix command "locale" and re-arrange encoding data a little bit
2010-06-08 21:07:14 -07:00
Zooko O'Whielacronx
73689bbfd3
setup: add zope.interface to the packages described by show-tool-versions.py
2010-06-08 20:49:15 -07:00
david-sarah
5adc1d789d
show-tool-versions.py: platform.linux_distribution() is not always available
2010-06-07 17:45:23 -07:00
david-sarah
1e70a8303f
show-tool-versions.py: show platform.linux_distribution()
2010-06-07 17:38:29 -07:00
Zooko O'Whielacronx
d826db89af
setup: update authorship, datestamp, licensing, and add special exceptions to allow combination with Eclipse- and QPL- licensed code
2010-06-06 23:23:29 -07:00
Zooko O'Whielacronx
1fc6be28f4
setup: organize misc/ scripts and tools and remove obsolete ones
...
This is for ticket #1068 .
2010-06-06 22:16:18 -07:00
Zooko O'Whielacronx
bcb03583d7
setup: loosen the Desert Island test to allow it to check the network for new packages as long as it doesn't actually download any
...
(You can look but don't touch.)
2010-06-06 10:57:17 -07:00
Zooko O'Whielacronx
68d292a968
setup: have the buildbots print out locale.getpreferredencoding(), locale.getdefaultlocale(), locale.getlocale(), and os.path.supports_unicode_filenames
...
Even though that latter one is completely useless, I'm curious.
2010-06-05 09:29:32 -07:00
Francois Deppierraz
bed23ee6d6
misc/show-tool-versions.py: Display additional Python interpreter encoding informations (stdout, stdin and filesystem)
2010-05-21 02:43:13 -07:00
Zooko O'Whielacronx
7b3a9a3d0e
setup: remove bundled zipfile egg of setuptools
...
We're about to replace it with bundled unpacked source code of setuptools, which is much nicer for debugging and evolving under revision control.
2010-05-23 13:51:20 -07:00
Zooko O'Whielacronx
6eb84564c6
setup: remove bundled copy of setuptools_trial-0.5.2.tar
...
Hopefully it will get installed automatically as needed and we won't bundle it anymore.
2010-05-22 15:15:39 -07:00
Zooko O'Whielacronx
0b306e31ce
setup: remove bundled setuptools_darcs-1.2.8.tar
...
This version of setuptools_darcs had a bug when used on Windows which has been fixed in setuptools_darcs-1.2.9. Hopefully we will not need to bundle a copy of setuptools_darcs-1.2.9 in with Tahoe-LAFS and can instead rely on it to be downloaded from PyPI or bundled in the "tahoe deps" separate tarball.
2010-05-21 18:53:33 -07:00
freestorm77
b78323e7ae
run_trial.darcspath
2010-05-10 16:28:29 -07:00
Zooko O'Whielacronx
e60b968be2
setup: new improved misc/show-tool-versions.py
2010-05-15 22:01:22 -07:00
Zooko O'Whielacronx
2da57bab5f
setup: fix typos in misc/show-tool-versions.py
2010-05-09 23:36:15 -07:00
Zooko O'Whielacronx
77189291c4
setup: show code-coverage tool versions in show-tools-versions.py
2010-05-09 23:29:55 -07:00
Zooko O'Whielacronx
82b9b91775
docs: update README, mv it to README.txt, update setup.py
2010-05-04 02:43:40 -07:00
Zooko O'Whielacronx
122e01e710
setup: reorder and extend the show-tool-versions script, the better to glean information about our new buildslaves
2010-05-03 21:56:43 -07:00
david-sarah
42ebd2dc64
Fix another typo in tahoe_storagespace munin plugin
2010-04-16 15:09:35 -07:00
freestorm77
08fc553fe9
munin-tahoe_storagespace
...
Plugin configuration rename
2010-02-21 14:36:26 -07:00
Zooko O'Whielacronx
de5cf49eba
setup: add licensing declaration for setuptools (noticed by the FSF compliance folks)
2010-03-09 10:44:15 -08:00
Zooko O'Whielacronx
34a50b857a
docs: a few small edits to try to guide newcomers through the docs
...
These edits were suggested by my watching over Jake Appelbaum's shoulder as he completely ignored/skipped/missed install.html and also as he decided that debian.txt wouldn't help him with basic installation. Then I threw in a few docs edits that have been sitting around in my sandbox asking to be committed for months.
2010-03-03 15:19:02 -08:00
Brian Warner
625ad78877
misc/coverage.el: improve filename matching
2010-02-23 23:47:57 -05:00
Peter Secor
8f3246430b
docs running.html - "tahoe run ." does not work with the current installation, replaced with "tahoe start ."
2010-02-06 08:53:20 -08:00
Brian Warner
880f824103
code coverage: replace figleaf with coverage.py, should work on py2.6 now.
...
It still lacks the right HTML report (the builtin report is very pretty, but
lacks the "lines uncovered" numbers that I want), and the half-finished
delta-from-last-run measurements.
2010-02-03 08:54:21 -08:00
david-sarah
584c0ed487
Fix boodlegrid use of set_children
2010-01-25 22:34:14 -08:00
Zooko O'Whielacronx
7afccbdabc
docs: CREDITS: add David-Sarah to the CREDITS file
2010-01-08 22:04:35 -08:00
Brian Warner
800fc176ec
misc/ringsim.py: make it deterministic, more detail about grid-is-full behavior
2009-12-26 21:48:32 -05:00
Brian Warner
aa102da804
misc/ringsim.py: tool to discuss #302
2009-12-26 01:03:39 -05:00
Zooko O'Whielacronx
00a44c057a
docs: a few licensing clarifications requested by Ubuntu
2009-09-26 20:32:26 -07:00
Zooko O'Whielacronx
aaaa633f18
setup: remove a convenience copy of figleaf, to ease inclusion into Ubuntu Karmic Koala
...
We need to carefully document the licence of figleaf in order to get Tahoe-LAFS into Ubuntu Karmic Koala. However, figleaf isn't really a part of Tahoe-LAFS per se -- this is just a "convenience copy" of a development tool. The quickest way to make Tahoe-LAFS acceptable for Karmic then, is to remove figleaf from the Tahoe-LAFS tarball itself. People who want to run figleaf on Tahoe-LAFS (as everyone should want) can install figleaf themselves. I haven't tested this -- there may be incompatibilities between upstream figleaf and the copy that we had here...
2009-09-23 22:32:15 -07:00
Zooko O'Whielacronx
abdf8a6f10
setup: shebang for misc/build-deb.py to fail quickly
...
Without this patch, when I ran "chmod +x ./misc/build-deb.py && ./misc/build-deb.py" then it hung indefinitely. (I wonder what it was doing.)
2009-08-19 06:56:26 -07:00
Zooko O'Whielacronx
603e08c4a9
doc: licensing cleanups
...
Use nice utf-8 © instead of "(c)". Remove licensing statements on utility modules that have been assigned to allmydata.com by their original authors. (Nattraverso was not assigned to allmydata.com -- it was LGPL'ed -- but I checked and src/allmydata/util/iputil.py was completely rewritten and doesn't contain any line of code from nattraverso.) Add notes to misc/debian/copyright about licensing on files that aren't just allmydata.com-licensed.
2009-09-20 10:16:31 -07:00
Brian Warner
9dd27bc7ee
build-deb.py: run darcsver early, otherwise we get the wrong version later on
2009-09-17 20:36:20 -07:00
Brian Warner
7dc17aa078
new approach for debian packaging, sharing pieces across distributions. Still experimental, still only works for sid.
2009-08-18 12:05:27 -07:00
Brian Warner
24b1805ca0
new experimental deb-packaging rules. Only works for sid so far.
2009-08-17 18:40:52 -07:00
Zooko O'Whielacronx
69f0d306e7
setup: remove bundled version of darcsver-1.2.1
...
That version of darcsver emits a scary error message when the darcs executable or the _darcs subdirectory is not found.
This error is hidden (unless the --loud option is passed) in darcsver >= 1.3.1.
Fixes #788 .
2009-08-16 16:34:32 -07:00
Zooko O'Whielacronx
2a63fc9159
docs: update relnotes.txt, relnotes-short.txt, and others documentation bits for v1.5.0 release!
2009-08-01 19:57:10 -07:00
Brian Warner
ba904dfeb5
debian/control: update binary package deps to pycryptopp-0.5.15
2009-07-20 23:50:25 -04:00
Zooko O'Whielacronx
6cbaaf31b5
mac: emit the stdout and stderr from a failed call to Allmydata (this is very useful diagnostic info)
2009-07-14 18:43:38 -07:00
Zooko O'Whielacronx
d2132213e3
mac: improve shutdown and clean-up after the test of the macintosh packaging
2009-07-14 05:26:55 -07:00
Zooko O'Whielacronx
4a4a47a66d
setup: add "test_mac_diskimage" command which attempts to mount and use a .dmg to make sure it has a good Tahoe distribution in it
2009-07-12 16:09:40 -07:00
Zooko O'Whielacronx
7682f6b120
setup: add sys.maxunicode to the show-tool-versions output in order to investigate http://bugs.python.org/setuptools/issue78
2009-07-08 17:45:33 -07:00
Brian Warner
d79b2a02b4
clean up debian packaging: we have control files for etch/lenny/sid, and
...
everything else uses one of those. Add dependency on python-pysqlite2 for
platforms that use py2.4 by default. Update foolscap dependency to 0.4.1.
2009-07-03 00:28:04 -07:00
Brian Warner
5626e17725
* find-trailing-spaces.py: exit rc=1 if whitespace found, to be a pre-commit hook
2009-06-29 15:46:58 -07:00
Zooko O'Whielacronx
18876466f5
setup: copy in misc/show-tools-version.py from zfec -- it prints out platform and setuptools versions
2009-06-20 22:58:46 -07:00
Zooko O'Whielacronx
2a51a7bb90
setup: run the same "make quicktest" on Windows as on non-Windows
...
I checked and it behaves about as well on Windows as the previous version did.
2009-06-11 12:32:14 -07:00
Brian Warner
8e25066753
misc/run-with-pythonpath.py: exec() the child (on unix), to remove the intermediate process
2009-06-01 14:01:37 -07:00
Brian Warner
a0e3c586b2
fix quicktest: stop using setuptools, add misc/run-with-pythonpath.py, to make it run faster
2009-04-14 13:14:00 -07:00
Zooko O'Whielacronx
55de7c3fed
setup: specify in the debian/control files that tahoe is compatible with Python 2.6
2009-03-11 15:59:02 -07:00
Zooko O'Whielacronx
cc9adba8a3
setup: update the debian/copyright text to reflect the current licences
2009-03-11 08:29:52 -07:00
Brian Warner
247c23904c
misc/*: remove RuntimeError too
2009-02-22 17:34:01 -07:00
Brian Warner
c2a2e93089
move show-tool-versions out of setup.py and into a separate script in misc/ , since setuptools is trying to build and install a bunch of stuff first
2009-02-19 01:35:58 -07:00
Zooko O'Whielacronx
5a21cecd67
setup: add new darcsver-1.2.1 which includes Brian's and Nils Durner's patch to ignore non-ascii chars in XML output
2009-02-11 15:52:53 -07:00
Zooko O'Whielacronx
912b4ebf13
setup: removed bundled darcsver-1.2.0
...
(I'm about to add a new bundled darcsver-1.2.1, but I want to see what the buildbots will do when there is no bundled darcsver present.)
2009-02-11 14:19:04 -07:00
Zooko O'Whielacronx
4d785cfe30
setup: bundle setuptools-0.6c12dev (our own toothpick of setuptools) this version completes my patch to fix http://bugs.python.org/setuptools/issue54 , which is necessary for tahoe to build with --prefix=support without doing a lot of PYTHONPATH gymnastics around the call to setup.py
2009-02-05 09:28:18 -07:00
Zooko O'Whielacronx
c900ed8e69
setup: remove old bundled setuptools-0.6c11dev (our own toothpick of setuptools)
2009-02-05 09:27:58 -07:00
Zooko O'Whielacronx
40179a0ed8
setup: merge recent patches that change the set of bundled tools in misc/dependencies/
2009-02-04 13:32:22 -07:00
Zooko O'Whielacronx
7d22cd4547
setup: bundle new setuptools_trial
2009-02-04 13:24:54 -07:00
Zooko O'Whielacronx
4df4efbaf0
setup: remove old bundled setuptools_trial
2009-02-04 13:24:42 -07:00
Zooko O'Whielacronx
944aa25709
setup: bundle new setuptools_darcs
2009-02-04 13:24:29 -07:00
Zooko O'Whielacronx
a2c1a93822
setup: remove old bundled setuptools_darcs
2009-02-04 13:24:18 -07:00
Zooko O'Whielacronx
759698224a
roll back the upgrade of the bundled setuptools_trial from 0.5 to 0.5.1
...
Upgrading setuptools trial in that way leads to a very tricky problem in setuptools's handling of recursive installation of the build-time dependencies of build-time dependencies...
rolling back:
Tue Feb 3 22:17:18 MST 2009 zooko@zooko.com
* setup: bundle new setuptools_trial-0.5.1
A ./misc/dependencies/setuptools_trial-0.5.1.tar
Tue Feb 3 22:17:32 MST 2009 zooko@zooko.com
* setup: remove old bundled setuptools_trial
R ./misc/dependencies/setuptools_trial-0.5.tar
2009-02-04 01:38:36 -07:00
Zooko O'Whielacronx
05030112e8
setup: remove old bundled setuptools_trial
2009-02-03 23:17:32 -07:00
Zooko O'Whielacronx
313080fbf0
setup: bundle new setuptools_trial-0.5.1
2009-02-03 23:17:18 -07:00
Zooko O'Whielacronx
4af8c8cd24
setup: bundle new setuptools_darcs-1.2.5
2009-02-03 23:17:04 -07:00
Zooko O'Whielacronx
4988d1e81c
setup: remove old bundled setuptools_darcs
2009-02-03 23:16:40 -07:00
Zooko O'Whielacronx
6e10a9c499
setup: remove bundled darcsver in gzipped format
2009-02-03 23:16:28 -07:00
Zooko O'Whielacronx
c613660500
setup: bundle darcsver in ungzipped format
2009-02-03 23:16:17 -07:00
Zooko O'Whielacronx
0c91a467e8
setup: remove old bundled setuptools-0.6c10dev (our own toothpick of setuptools)
2009-02-02 22:23:04 -07:00
Zooko O'Whielacronx
5c0d937eec
setup: bundle setuptools-0.6c11dev (our own toothpick of setuptools)
...
Hopefully this one fixes the issue with easy_install not searching the sys.path for packages that were requested to be installed, (setuptools #17 ), thus allowing us to do away with the "--site-dirs=" kludges, which are currently breaking some of our buildbots.
2009-02-02 22:19:50 -07:00
Brian Warner
d8d4070e98
misc/dependencies: update setuptools_trial from 0.4 to 0.5
2009-02-02 17:36:57 -07:00
Zooko O'Whielacronx
6a4d5abc1d
setup: add new bundled darcsver-1.2.0
2009-01-29 12:51:15 -07:00
Zooko O'Whielacronx
20d2136e24
setup: remove old bundled darcsver-1.1.8
2009-01-29 12:51:02 -07:00
Zooko O'Whielacronx
16f0fef785
setup: bundle darcsver-1.1.8
2009-01-28 14:03:26 -07:00
Zooko O'Whielacronx
4945dd0b0a
setup: remove old bundled dependency darcsver-1.1.5
2009-01-28 12:20:12 -07:00
Brian Warner
8d6bdb5856
diskwatcher: cache growth results (which take 30s to generate) for 3 minutes, to help munin, which invokes it 6 times in a row every 5 minutes
2009-01-25 17:06:39 -07:00
Zooko O'Whielacronx
0dbc0f1194
setup: add new bundled setuptools_trial-0.4
2009-01-20 17:40:12 -07:00
Zooko O'Whielacronx
8351d9d41e
setup: remove old bundled setuptools_trial-0.2
2009-01-20 17:39:18 -07:00
Zooko O'Whielacronx
4cd02cc12f
setup: bundle setuptools_trial in misc/dependencies/
2008-12-01 11:44:38 -07:00
Brian Warner
6ec352fe92
misc/cpu-watcher.tac: tolerate disk-full errors when writing the pickle, and pickle corruption from earlier disk-full errors
2008-12-05 15:54:12 -07:00
Brian Warner
995a16e3b1
misc/spacetime/diskwatcher.tac: remove dead code
2008-11-19 14:05:52 -07:00
Brian Warner
d224d22cb7
munin/tahoe_disktotal: add a 'disk used' line, since it will always be less than disktotal
2008-11-18 15:44:31 -07:00
Brian Warner
1e024d5e82
munin/tahoe_introstats: add line for distinct-storage-hosts (which counts machines instead of nodes)
2008-11-18 15:32:38 -07:00
Brian Warner
7d68e4397b
munin/tahoe_diskused: new plugin to show total disk space used across the grid
2008-11-18 01:25:25 -07:00
Brian Warner
3d03e5257c
munin/tahoe_disktotal: new plugin to show total disk space (used and unused) in the grid
2008-11-18 00:51:01 -07:00
Brian Warner
0a819e2912
diskwatcher: record total-space (the size of the disk as reported by df) in the db, report it to HTTP clients. This will involve a 50-item-per-second upgrade process when it is first used on old data
2008-11-17 21:45:16 -07:00
Zooko O'Whielacronx
eae5403e5a
shebang: replace "/usr/bin/python" with "/usr/bin/env python"
2008-11-04 18:03:06 -07:00
Zooko O'Whielacronx
24650490ed
misc/fixshebangs.py
2008-11-04 18:01:30 -07:00
Zooko O'Whielacronx
9f299ad55b
setup: include _pkgutil.py in setuptools bootstrap egg so that it will work on Python 2.4
2008-10-25 08:28:39 -07:00
Zooko O'Whielacronx
8f260826b4
setup: remove old bundled setuptools-0.6c9
2008-10-25 06:49:47 -07:00
Zooko O'Whielacronx
3c974763ab
setup: bundle an SVN snapshot of setuptools instead of the most recent stable release of setuptools
...
This SVN snapshot fixes a problem that prevents the setting up of nevow:
http://bugs.python.org/setuptools/issue20
2008-10-25 06:48:37 -07:00
Zooko O'Whielacronx
cd015228d5
setup: bundle setuptools-0.6c9
2008-09-30 13:04:48 -07:00
Zooko O'Whielacronx
8cad310dc8
setup: remove bundled setuptools-0.6c8
2008-09-30 13:03:36 -07:00
Brian Warner
f3d730428f
misc/incident-gatherer: add classify_tahoe.py: a foolscap incident-gatherer classification plugin
2008-10-15 15:09:40 -07:00
Brian Warner
06770f720e
misc/cpu-watcher.tac: use writeaside-and-rename for the history.pickle file
2008-09-30 17:30:53 -07:00
Brian Warner
3aba70bbcf
misc/spacetime: use async polling so we can add a 60-second timeout, add an index to the 'url' Axiom column for 2x speedup
2008-09-30 16:34:48 -07:00
Brian Warner
1a3f154c21
munin/tahoe_doomsday: oops, tolerate 'null' in the timeleft results, to unbreak the 2wk/4wk graphs
2008-09-30 13:20:51 -07:00
Brian Warner
1f9af40fd4
misc/make-canary-files.py: tool to create 'canary files', explained in the docstring
2008-09-24 17:47:16 -07:00
Brian Warner
d4b522bedf
misc/make_umid: change docs, make elisp code easier to grab
2008-09-20 11:39:33 -07:00
Brian Warner
cf27f81a88
misc/check-build.py: ignore the 'Downloading file:..' line that occurs for the setup_requires= -triggered handling of the setuptools egg
2008-09-16 22:17:25 -07:00
Brian Warner
1853020a5f
#249 : add 'test-desert-island', to assert that a tahoe-deps.tar.gz -enabled build does not download anything
2008-09-16 18:37:02 -07:00
Brian Warner
fafdf58e41
#249 : move dependent libs out of misc/dependencies/, get them from tahoe-deps.tar.gz instead
2008-09-16 18:25:45 -07:00
Brian Warner
7da70b8197
misc/xfer-client.py: small foolscap utility to transfer a file to a waiting server
2008-09-08 16:19:03 -07:00
Brian Warner
be11bfe812
munin: add tahoe_diskleft plugin, update spacetime/diskwatcher.tac to support it
2008-08-28 13:32:36 -07:00
Brian Warner
d47d19cbfb
debian: include misc/cpu-watcher.tac in the debian package
2008-08-27 15:30:26 -07:00
Brian Warner
482b3e0939
munin/tahoe_doomsday: change the graph title, 'time predictor' is more accurate than 'space predictor'
2008-08-27 14:30:13 -07:00
Brian Warner
ba6e525952
munin/tahoe_diskusage: clip the graph at zero, to prevent transient negative excursions (such as when a lot of old logfiles are deleted from a storage server's disk) from scaling the graph into unusability
2008-08-27 12:35:43 -07:00
Brian Warner
96a1ec33b8
misc/make_umid: little script and elisp fragment to insert umid= arguments
2008-08-25 18:59:18 -07:00
Brian Warner
743ca91bcd
munin diskusage/doomsday: oops, fix labels, everything was reported in the 1hr column
2008-08-11 13:34:31 -07:00
Brian Warner
8828fe8769
munin/tahoe_overhead: don't emit non-sensicial numbers
2008-08-07 14:40:08 -07:00
Brian Warner
f7ad0d2f6f
munin: add tahoe_overhead plugin, to measure effectiveness of GC and deleting data from inactive accounts
2008-08-07 13:39:25 -07:00
Brian Warner
39db60cc2b
diskwatcher.tac: include total-bytes-used
2008-08-07 13:12:14 -07:00
Brian Warner
1c36a52db5
misc/dependencies: remove the no-longer-useful foolscap-0.2.5 tarball
2008-08-07 11:45:46 -07:00
Brian Warner
f77af25ef7
diskwatcher.tac: don't report negative timeleft
2008-08-07 10:34:33 -07:00
Brian Warner
7502971df6
diskwatcher.tac: reduce the polling rate to once per hour
2008-08-06 23:20:21 -07:00
Brian Warner
e19564df59
misc/spacetime: add munin plugins, add everything to .deb
2008-08-06 23:00:03 -07:00
Brian Warner
7fbfbcbe4d
diskwatcher.tac: hush pyflakes
2008-08-06 22:04:27 -07:00
Brian Warner
730a28aa0d
diskwatcher.tac: add async-GET code, but leave it commented out: urlopen() seems to work better for now
2008-08-06 22:03:27 -07:00
Brian Warner
c90bc3ad71
cpu-watcher.tac: improve error message
2008-08-06 21:38:01 -07:00
Brian Warner
46d0c9c995
disk-watcher: first draft of a daemon to use the HTTP stats interface and its new storage_server.disk_avail feature, to track changes in disk space over time
2008-08-06 21:22:22 -07:00
Brian Warner
4863b17371
misc/cpu-watcher.tac: tolerate missing pidfiles, just skip over that sample
2008-08-06 21:17:05 -07:00
Brian Warner
027408b9d2
debian/control: update dependencies to match _auto_deps: foolscap-0.3.0, pycryptopp-0.5
2008-08-05 18:32:22 -07:00
Brian Warner
315a89f9d8
munin/tahoe_spacetime: show 2wk data even if 4wk data is unavailable
2008-07-28 12:42:33 -07:00
Zooko O'Whielacronx
497aedfab9
simulate_load: put it in friendnet mode and print out a sum of doubled shares
2008-07-21 14:11:06 -07:00
Brian Warner
870fb68620
munin/tahoe_server_latency: add percentile to graph title
2008-07-16 16:08:17 -07:00
Brian Warner
af0648c0f8
munin/serverops: improve graph title
2008-07-16 12:36:42 -07:00
Brian Warner
5b3868ae2e
debian/rules: put munin plugins in /usr/share/PACKAGENAME/munin/, make them +x, remove packagename from rules to make branches easier to manage
2008-07-15 18:47:41 -07:00
Brian Warner
43b54c1abb
sid/control: set python versions to 2.4,2.5 , to match feisty/control, since sid has had 2.5 available forever now
2008-07-15 18:42:38 -07:00
Brian Warner
340b7add4f
debian/changelog: remove all versions but 0.0.1, so debchange can always override it. The 'deb-X' Makefile targets should not be used; run 'make deb-X-head' instead
2008-07-15 15:23:41 -07:00
Brian Warner
390c5c6ca5
munin/tahoe_stats: add server operations per second (allocate/get/writev/readv
2008-07-14 13:25:35 -07:00
Brian Warner
0f231e2e66
munin/tahoe_stats: rearrange config a bit, no functional changes
2008-07-14 13:25:01 -07:00
Brian Warner
6525742b37
munin/tahoe_server_operations: fix comments
2008-07-14 13:18:47 -07:00
Brian Warner
a72dfcc00d
munin: add plugin for storage-server operations per second
2008-07-14 13:18:11 -07:00
Brian Warner
d14d6d0985
copy debian/sid changes to debian/feisty
2008-07-14 12:56:38 -07:00
Brian Warner
7eaead0fcc
debian/sid: add more docs to package, including munin plugins
2008-07-14 12:55:34 -07:00
Brian Warner
b2f062ab82
misc/munin: add server_latency plugin
2008-07-14 12:29:19 -07:00
Zooko O'Whielacronx
0e77fe1e92
misc/simulate_load.py: fix bug in which only K shares were uploaded instead of N, and fix the x axis in place so that successive runs can be compared
2008-07-12 16:54:29 -07:00
Zooko O'Whielacronx
f969c5f80e
misc/simulate_load.py: use a more realistic distribution of file sizes, and automate the formatting of the ascii art so that it fits in 70 columns and the number of files uploaded is properly marked
2008-07-12 15:37:27 -07:00
Zooko O'Whielacronx
b483c4710d
add misc/simulate_load.py in an attempt to understand why permuting the peerlist per each storage index matters
2008-07-12 14:26:22 -07:00
Brian Warner
f303670265
misc/munin: rename plugins to make munin happy: use underscores rather than hyphens, remove .py suffix
2008-07-11 15:21:13 -07:00
Brian Warner
503ce1cbd7
remove obsolete tahoe-sharesperfile munin plugin
2008-07-11 15:17:33 -07:00
Brian Warner
38252b6df1
remove tahoe-dirnodes.py munin plugin, it is way obsolete
2008-07-11 15:14:28 -07:00
Zooko O'Whielacronx
9bd1cdcdd8
setup: remove bundled darcsver-1.1.2.tar
2008-06-21 14:04:26 -07:00
Zooko O'Whielacronx
c151c13b5e
setup: bundle darcsver-1.1.5 into misc/dependencies
...
Once we implement #249 (move bundled dependencies out of revision control history and make them optional) then we can stop doing this. Until then we try not to do it unless we really need to...
2008-06-21 13:56:24 -07:00
Zooko O'Whielacronx
52a5651da2
setup: remove Nevow 0.9.18 tarball from misc/dependencies
...
The 0.9.18 version of Nevow doesn't declare its dependency on Twisted in a machine-readable way ( http://divmod.org/trac/ticket/2629 ). Neither does the current release of Nevow (0.9.31), but hopefully a future release of Nevow in the near future will fix this.
Also, we're going to be managing external dependencies like this in a separate darcs repository in the future instead of checking them into our Tahoe source tree.
2008-06-09 11:41:56 -07:00
Zooko O'Whielacronx
b06ba64214
setup: quote the results of misc/find_trial.py so that they can be passed through a shell even if they contain spaces
2008-06-05 15:59:45 -07:00
Brian Warner
c23f675095
misc/munin/tahoe_spacetime.py: add a munin plugin to estimate how much time remains before you run out of space
2008-05-28 11:33:54 -07:00
Brian Warner
15b373ad9c
misc/delete-old-helper.sh: simple script to delete old+abandoned helper files
2008-05-27 21:17:20 -07:00
Brian Warner
74df0b58b5
munin: add tahoe_cpu_watcher.py, to track the data from misc/cpu-watcher.tac
2008-05-07 13:19:08 -07:00
Brian Warner
79147a3f6a
misc/cpu-watcher*: add some tools to monitor CPU usage of arbitrary processes, like tahoe nodes
2008-05-07 12:34:29 -07:00
Zooko O'Whielacronx
b1583ac6a0
setup: remove bundled pycryptopp-0.3.0.tar
2008-05-06 08:24:46 -07:00
Zooko O'Whielacronx
045e2bcdf4
setup: bundle pycryptopp-0.5.1.tar
...
pycryptopp-0.3.0 incorrectly crypts AES (depending on compiler and version of Crypto++ used)
Very soon now we're going to set up an "ext" repository to hold all tarballs and no longer check them into our trunk source tree.
2008-05-06 08:23:36 -07:00
Brian Warner
773e9abe24
debian: add python-setuptools to the debian install-time dependencies. Should close #382 .
2008-04-24 16:01:04 -07:00
Brian Warner
d2a2b8a4ae
munin/tahoe_estimate_files.py: tool to estimate the total number of slots (mutable and immutable combined) in the grid, from a small sample
2008-04-24 11:28:35 -07:00
robk-tahoe
5f5ed6b08d
munin stats: fix typo in mutable file stats
2008-04-23 15:50:29 -07:00
robk-tahoe
f74042c75e
munin stats: add mutable/uploader traffic graphs
...
this adds munin graphs to present data already published by nodes to
the stats_gatherer, namely mutable files published/retrieved, and
immutable files uploaded, and the bytes thereof
2008-04-23 14:39:41 -07:00
Brian Warner
239c950810
munin/tahoe-stats.py: category is 'counters' not 'stats', use DERIVE
2008-04-23 14:03:23 -07:00
Zooko O'Whielacronx
1e2698713b
setup: remove the misc/hatch-eggs.py script, which we no longer use since [1937]
2008-04-23 13:41:56 -07:00
Zooko O'Whielacronx
ece902a4cf
setup: windows: make sub-ver.py treat None as 0
2008-04-21 06:37:13 -07:00
Brian Warner
5afc26f1d1
misc/sizes.py: update to match current defaults: 128KiB segsize, 3-of-10
2008-04-16 16:29:53 -07:00
Brian Warner
77c3c616ab
misc/boodlegrid.tac: tweak sounds a bit
2008-04-15 11:01:49 -07:00
Brian Warner
500934b72f
helper stats: fix the /helper_status page, the recent conflict merging missed some uses. Added tests, updated the munin plugins to match
2008-04-14 13:18:53 -07:00
robk-tahoe
766deaa9b6
stats_gatherer: reconcile helper stats gathering
...
I'd implemented stats gathering hooks in the helper a while back.
Brian did the same without reference to my changes. This reconciles
those two changes, encompassing all the stats in both changes,
implemented through the stats_provider interface.
this also provide templates for all 10 helper graphs in the
tahoe-stats munin plugin.
2008-04-10 17:25:44 -07:00
robk-tahoe
d8f3521a02
munin: added a series of munin graphs to report upload helper state
2008-03-25 18:30:46 -07:00
Brian Warner
623d82a130
debian: use our own /usr/bin/tahoe, remove runtime dependency on setuptools (since it required egg-aware versions of all dependencies too)
2008-04-10 16:29:59 -07:00
Brian Warner
5cfccbf44f
debian: we now require setuptools at build time, and that or pkg_resources at runtime
2008-04-10 15:43:56 -07:00
Brian Warner
3f61198042
debian: use setuptools-generated support/bin/tahoe instead of bin/tahoe, to match Zooko's change that makes our in-tree bin/tahoe spawn support/bin/tahoe
2008-04-10 14:36:27 -07:00
Brian Warner
d36d731752
oops, change debian dependency on zfec to 1.1, not 1.1.0
2008-04-09 17:45:52 -07:00
