Commit Graph

341 Commits

Author SHA1 Message Date
Brian Warner
ba904dfeb5 debian/control: update binary package deps to pycryptopp-0.5.15 2009-07-20 23:50:25 -04:00
Zooko O'Whielacronx
6cbaaf31b5 mac: emit the stdout and stderr from a failed call to Allmydata (this is very useful diagnostic info) 2009-07-14 18:43:38 -07:00
Zooko O'Whielacronx
d2132213e3 mac: improve shutdown and clean-up after the test of the macintosh packaging 2009-07-14 05:26:55 -07:00
Zooko O'Whielacronx
4a4a47a66d setup: add "test_mac_diskimage" command which attempts to mount and use a .dmg to make sure it has a good Tahoe distribution in it 2009-07-12 16:09:40 -07:00
Zooko O'Whielacronx
7682f6b120 setup: add sys.maxunicode to the show-tool-versions output in order to investigate http://bugs.python.org/setuptools/issue78 2009-07-08 17:45:33 -07:00
Brian Warner
d79b2a02b4 clean up debian packaging: we have control files for etch/lenny/sid, and
everything else uses one of those. Add dependency on python-pysqlite2 for
platforms that use py2.4 by default. Update foolscap dependency to 0.4.1.
2009-07-03 00:28:04 -07:00
Brian Warner
5626e17725 * find-trailing-spaces.py: exit rc=1 if whitespace found, to be a pre-commit hook 2009-06-29 15:46:58 -07:00
Zooko O'Whielacronx
18876466f5 setup: copy in misc/show-tools-version.py from zfec -- it prints out platform and setuptools versions 2009-06-20 22:58:46 -07:00
Zooko O'Whielacronx
2a51a7bb90 setup: run the same "make quicktest" on Windows as on non-Windows
I checked and it behaves about as well on Windows as the previous version did.
2009-06-11 12:32:14 -07:00
Brian Warner
8e25066753 misc/run-with-pythonpath.py: exec() the child (on unix), to remove the intermediate process 2009-06-01 14:01:37 -07:00
Brian Warner
a0e3c586b2 fix quicktest: stop using setuptools, add misc/run-with-pythonpath.py, to make it run faster 2009-04-14 13:14:00 -07:00
Zooko O'Whielacronx
55de7c3fed setup: specify in the debian/control files that tahoe is compatible with Python 2.6 2009-03-11 15:59:02 -07:00
Zooko O'Whielacronx
cc9adba8a3 setup: update the debian/copyright text to reflect the current licences 2009-03-11 08:29:52 -07:00
Brian Warner
247c23904c misc/*: remove RuntimeError too 2009-02-22 17:34:01 -07:00
Brian Warner
c2a2e93089 move show-tool-versions out of setup.py and into a separate script in misc/ , since setuptools is trying to build and install a bunch of stuff first 2009-02-19 01:35:58 -07:00
Zooko O'Whielacronx
5a21cecd67 setup: add new darcsver-1.2.1 which includes Brian's and Nils Durner's patch to ignore non-ascii chars in XML output 2009-02-11 15:52:53 -07:00
Zooko O'Whielacronx
912b4ebf13 setup: removed bundled darcsver-1.2.0
(I'm about to add a new bundled darcsver-1.2.1, but I want to see what the buildbots will do when there is no bundled darcsver present.)
2009-02-11 14:19:04 -07:00
Zooko O'Whielacronx
4d785cfe30 setup: bundle setuptools-0.6c12dev (our own toothpick of setuptools) this version completes my patch to fix http://bugs.python.org/setuptools/issue54 , which is necessary for tahoe to build with --prefix=support without doing a lot of PYTHONPATH gymnastics around the call to setup.py 2009-02-05 09:28:18 -07:00
Zooko O'Whielacronx
c900ed8e69 setup: remove old bundled setuptools-0.6c11dev (our own toothpick of setuptools) 2009-02-05 09:27:58 -07:00
Zooko O'Whielacronx
40179a0ed8 setup: merge recent patches that change the set of bundled tools in misc/dependencies/ 2009-02-04 13:32:22 -07:00
Zooko O'Whielacronx
7d22cd4547 setup: bundle new setuptools_trial 2009-02-04 13:24:54 -07:00
Zooko O'Whielacronx
4df4efbaf0 setup: remove old bundled setuptools_trial 2009-02-04 13:24:42 -07:00
Zooko O'Whielacronx
944aa25709 setup: bundle new setuptools_darcs 2009-02-04 13:24:29 -07:00
Zooko O'Whielacronx
a2c1a93822 setup: remove old bundled setuptools_darcs 2009-02-04 13:24:18 -07:00
Zooko O'Whielacronx
759698224a roll back the upgrade of the bundled setuptools_trial from 0.5 to 0.5.1
Upgrading setuptools trial in that way leads to a very tricky problem in setuptools's handling of recursive installation of the build-time dependencies of build-time dependencies...

rolling back:

Tue Feb  3 22:17:18 MST 2009  zooko@zooko.com
  * setup: bundle new setuptools_trial-0.5.1

    A ./misc/dependencies/setuptools_trial-0.5.1.tar
Tue Feb  3 22:17:32 MST 2009  zooko@zooko.com
  * setup: remove old bundled setuptools_trial

    R ./misc/dependencies/setuptools_trial-0.5.tar
2009-02-04 01:38:36 -07:00
Zooko O'Whielacronx
05030112e8 setup: remove old bundled setuptools_trial 2009-02-03 23:17:32 -07:00
Zooko O'Whielacronx
313080fbf0 setup: bundle new setuptools_trial-0.5.1 2009-02-03 23:17:18 -07:00
Zooko O'Whielacronx
4af8c8cd24 setup: bundle new setuptools_darcs-1.2.5 2009-02-03 23:17:04 -07:00
Zooko O'Whielacronx
4988d1e81c setup: remove old bundled setuptools_darcs 2009-02-03 23:16:40 -07:00
Zooko O'Whielacronx
6e10a9c499 setup: remove bundled darcsver in gzipped format 2009-02-03 23:16:28 -07:00
Zooko O'Whielacronx
c613660500 setup: bundle darcsver in ungzipped format 2009-02-03 23:16:17 -07:00
Zooko O'Whielacronx
0c91a467e8 setup: remove old bundled setuptools-0.6c10dev (our own toothpick of setuptools) 2009-02-02 22:23:04 -07:00
Zooko O'Whielacronx
5c0d937eec setup: bundle setuptools-0.6c11dev (our own toothpick of setuptools)
Hopefully this one fixes the issue with easy_install not searching the sys.path for packages that were requested to be installed, (setuptools #17), thus allowing us to do away with the "--site-dirs=" kludges, which are currently breaking some of our buildbots.
2009-02-02 22:19:50 -07:00
Brian Warner
d8d4070e98 misc/dependencies: update setuptools_trial from 0.4 to 0.5 2009-02-02 17:36:57 -07:00
Zooko O'Whielacronx
6a4d5abc1d setup: add new bundled darcsver-1.2.0 2009-01-29 12:51:15 -07:00
Zooko O'Whielacronx
20d2136e24 setup: remove old bundled darcsver-1.1.8 2009-01-29 12:51:02 -07:00
Zooko O'Whielacronx
16f0fef785 setup: bundle darcsver-1.1.8 2009-01-28 14:03:26 -07:00
Zooko O'Whielacronx
4945dd0b0a setup: remove old bundled dependency darcsver-1.1.5 2009-01-28 12:20:12 -07:00
Brian Warner
8d6bdb5856 diskwatcher: cache growth results (which take 30s to generate) for 3 minutes, to help munin, which invokes it 6 times in a row every 5 minutes 2009-01-25 17:06:39 -07:00
Zooko O'Whielacronx
0dbc0f1194 setup: add new bundled setuptools_trial-0.4 2009-01-20 17:40:12 -07:00
Zooko O'Whielacronx
8351d9d41e setup: remove old bundled setuptools_trial-0.2 2009-01-20 17:39:18 -07:00
Zooko O'Whielacronx
4cd02cc12f setup: bundle setuptools_trial in misc/dependencies/ 2008-12-01 11:44:38 -07:00
Brian Warner
6ec352fe92 misc/cpu-watcher.tac: tolerate disk-full errors when writing the pickle, and pickle corruption from earlier disk-full errors 2008-12-05 15:54:12 -07:00
Brian Warner
995a16e3b1 misc/spacetime/diskwatcher.tac: remove dead code 2008-11-19 14:05:52 -07:00
Brian Warner
d224d22cb7 munin/tahoe_disktotal: add a 'disk used' line, since it will always be less than disktotal 2008-11-18 15:44:31 -07:00
Brian Warner
1e024d5e82 munin/tahoe_introstats: add line for distinct-storage-hosts (which counts machines instead of nodes) 2008-11-18 15:32:38 -07:00
Brian Warner
7d68e4397b munin/tahoe_diskused: new plugin to show total disk space used across the grid 2008-11-18 01:25:25 -07:00
Brian Warner
3d03e5257c munin/tahoe_disktotal: new plugin to show total disk space (used and unused) in the grid 2008-11-18 00:51:01 -07:00
Brian Warner
0a819e2912 diskwatcher: record total-space (the size of the disk as reported by df) in the db, report it to HTTP clients. This will involve a 50-item-per-second upgrade process when it is first used on old data 2008-11-17 21:45:16 -07:00
Zooko O'Whielacronx
eae5403e5a shebang: replace "/usr/bin/python" with "/usr/bin/env python" 2008-11-04 18:03:06 -07:00
Zooko O'Whielacronx
24650490ed misc/fixshebangs.py 2008-11-04 18:01:30 -07:00
Zooko O'Whielacronx
9f299ad55b setup: include _pkgutil.py in setuptools bootstrap egg so that it will work on Python 2.4 2008-10-25 08:28:39 -07:00
Zooko O'Whielacronx
8f260826b4 setup: remove old bundled setuptools-0.6c9 2008-10-25 06:49:47 -07:00
Zooko O'Whielacronx
3c974763ab setup: bundle an SVN snapshot of setuptools instead of the most recent stable release of setuptools
This SVN snapshot fixes a problem that prevents the setting up of nevow:
http://bugs.python.org/setuptools/issue20
2008-10-25 06:48:37 -07:00
Zooko O'Whielacronx
cd015228d5 setup: bundle setuptools-0.6c9 2008-09-30 13:04:48 -07:00
Zooko O'Whielacronx
8cad310dc8 setup: remove bundled setuptools-0.6c8 2008-09-30 13:03:36 -07:00
Brian Warner
f3d730428f misc/incident-gatherer: add classify_tahoe.py: a foolscap incident-gatherer classification plugin 2008-10-15 15:09:40 -07:00
Brian Warner
06770f720e misc/cpu-watcher.tac: use writeaside-and-rename for the history.pickle file 2008-09-30 17:30:53 -07:00
Brian Warner
3aba70bbcf misc/spacetime: use async polling so we can add a 60-second timeout, add an index to the 'url' Axiom column for 2x speedup 2008-09-30 16:34:48 -07:00
Brian Warner
1a3f154c21 munin/tahoe_doomsday: oops, tolerate 'null' in the timeleft results, to unbreak the 2wk/4wk graphs 2008-09-30 13:20:51 -07:00
Brian Warner
1f9af40fd4 misc/make-canary-files.py: tool to create 'canary files', explained in the docstring 2008-09-24 17:47:16 -07:00
Brian Warner
d4b522bedf misc/make_umid: change docs, make elisp code easier to grab 2008-09-20 11:39:33 -07:00
Brian Warner
cf27f81a88 misc/check-build.py: ignore the 'Downloading file:..' line that occurs for the setup_requires= -triggered handling of the setuptools egg 2008-09-16 22:17:25 -07:00
Brian Warner
1853020a5f #249: add 'test-desert-island', to assert that a tahoe-deps.tar.gz -enabled build does not download anything 2008-09-16 18:37:02 -07:00
Brian Warner
fafdf58e41 #249: move dependent libs out of misc/dependencies/, get them from tahoe-deps.tar.gz instead 2008-09-16 18:25:45 -07:00
Brian Warner
7da70b8197 misc/xfer-client.py: small foolscap utility to transfer a file to a waiting server 2008-09-08 16:19:03 -07:00
Brian Warner
be11bfe812 munin: add tahoe_diskleft plugin, update spacetime/diskwatcher.tac to support it 2008-08-28 13:32:36 -07:00
Brian Warner
d47d19cbfb debian: include misc/cpu-watcher.tac in the debian package 2008-08-27 15:30:26 -07:00
Brian Warner
482b3e0939 munin/tahoe_doomsday: change the graph title, 'time predictor' is more accurate than 'space predictor' 2008-08-27 14:30:13 -07:00
Brian Warner
ba6e525952 munin/tahoe_diskusage: clip the graph at zero, to prevent transient negative excursions (such as when a lot of old logfiles are deleted from a storage server's disk) from scaling the graph into unusability 2008-08-27 12:35:43 -07:00
Brian Warner
96a1ec33b8 misc/make_umid: little script and elisp fragment to insert umid= arguments 2008-08-25 18:59:18 -07:00
Brian Warner
743ca91bcd munin diskusage/doomsday: oops, fix labels, everything was reported in the 1hr column 2008-08-11 13:34:31 -07:00
Brian Warner
8828fe8769 munin/tahoe_overhead: don't emit non-sensicial numbers 2008-08-07 14:40:08 -07:00
Brian Warner
f7ad0d2f6f munin: add tahoe_overhead plugin, to measure effectiveness of GC and deleting data from inactive accounts 2008-08-07 13:39:25 -07:00
Brian Warner
39db60cc2b diskwatcher.tac: include total-bytes-used 2008-08-07 13:12:14 -07:00
Brian Warner
1c36a52db5 misc/dependencies: remove the no-longer-useful foolscap-0.2.5 tarball 2008-08-07 11:45:46 -07:00
Brian Warner
f77af25ef7 diskwatcher.tac: don't report negative timeleft 2008-08-07 10:34:33 -07:00
Brian Warner
7502971df6 diskwatcher.tac: reduce the polling rate to once per hour 2008-08-06 23:20:21 -07:00
Brian Warner
e19564df59 misc/spacetime: add munin plugins, add everything to .deb 2008-08-06 23:00:03 -07:00
Brian Warner
7fbfbcbe4d diskwatcher.tac: hush pyflakes 2008-08-06 22:04:27 -07:00
Brian Warner
730a28aa0d diskwatcher.tac: add async-GET code, but leave it commented out: urlopen() seems to work better for now 2008-08-06 22:03:27 -07:00
Brian Warner
c90bc3ad71 cpu-watcher.tac: improve error message 2008-08-06 21:38:01 -07:00
Brian Warner
46d0c9c995 disk-watcher: first draft of a daemon to use the HTTP stats interface and its new storage_server.disk_avail feature, to track changes in disk space over time 2008-08-06 21:22:22 -07:00
Brian Warner
4863b17371 misc/cpu-watcher.tac: tolerate missing pidfiles, just skip over that sample 2008-08-06 21:17:05 -07:00
Brian Warner
027408b9d2 debian/control: update dependencies to match _auto_deps: foolscap-0.3.0, pycryptopp-0.5 2008-08-05 18:32:22 -07:00
Brian Warner
315a89f9d8 munin/tahoe_spacetime: show 2wk data even if 4wk data is unavailable 2008-07-28 12:42:33 -07:00
Zooko O'Whielacronx
497aedfab9 simulate_load: put it in friendnet mode and print out a sum of doubled shares 2008-07-21 14:11:06 -07:00
Brian Warner
870fb68620 munin/tahoe_server_latency: add percentile to graph title 2008-07-16 16:08:17 -07:00
Brian Warner
af0648c0f8 munin/serverops: improve graph title 2008-07-16 12:36:42 -07:00
Brian Warner
5b3868ae2e debian/rules: put munin plugins in /usr/share/PACKAGENAME/munin/, make them +x, remove packagename from rules to make branches easier to manage 2008-07-15 18:47:41 -07:00
Brian Warner
43b54c1abb sid/control: set python versions to 2.4,2.5 , to match feisty/control, since sid has had 2.5 available forever now 2008-07-15 18:42:38 -07:00
Brian Warner
340b7add4f debian/changelog: remove all versions but 0.0.1, so debchange can always override it. The 'deb-X' Makefile targets should not be used; run 'make deb-X-head' instead 2008-07-15 15:23:41 -07:00
Brian Warner
390c5c6ca5 munin/tahoe_stats: add server operations per second (allocate/get/writev/readv 2008-07-14 13:25:35 -07:00
Brian Warner
0f231e2e66 munin/tahoe_stats: rearrange config a bit, no functional changes 2008-07-14 13:25:01 -07:00
Brian Warner
6525742b37 munin/tahoe_server_operations: fix comments 2008-07-14 13:18:47 -07:00
Brian Warner
a72dfcc00d munin: add plugin for storage-server operations per second 2008-07-14 13:18:11 -07:00
Brian Warner
d14d6d0985 copy debian/sid changes to debian/feisty 2008-07-14 12:56:38 -07:00
Brian Warner
7eaead0fcc debian/sid: add more docs to package, including munin plugins 2008-07-14 12:55:34 -07:00
Brian Warner
b2f062ab82 misc/munin: add server_latency plugin 2008-07-14 12:29:19 -07:00
Zooko O'Whielacronx
0e77fe1e92 misc/simulate_load.py: fix bug in which only K shares were uploaded instead of N, and fix the x axis in place so that successive runs can be compared 2008-07-12 16:54:29 -07:00