Commit Graph

524 Commits

Author SHA1 Message Date
Brian Warner
c781fc188b run-deprecations: flush stdout before starting trial
This should get the notes printed in the right order.
2016-04-06 09:23:48 -10:00
Brian Warner
14c513db8a tox -e deprecations: add helper script to make it work
Tox doesn't run shell pipelines, and is unhappy about running tools that
it didn't install itself (including non-python things like "make"). So
this adds misc/build_helpers/run-deprecations.py, a python script that
runs a given command (i.e. trial) and writes stdout into a separate file
where the buildbot can see it, and counts the "DeprecationWarning" lines
from the file to decide the returncode.

This ought to improve the status display on the buildbot "test
deprecations" step.
2016-04-06 08:29:48 -10:00
Brian Warner
c545d5c0a1 add misc/coding_tools/graph-deps.py, to visualize dependencies
This builds and parses wheels for a given target, then renders a
DOT-format graph into a PNG file.
2016-03-25 14:50:16 -07:00
Brian Warner
23826b0224 fix OS-X package version
I changed the quotes in _version.py, and this script was sensitive to
them.
2016-03-23 02:32:48 -07:00
Brian Warner
831b39d8fb remove src/buildtest/ and related build_helper/ test files
This was used to exercise our old virtualenv-like scheme. Now that we
use virtualenv, they're unnecessary. Plus, removing it lets us stop
polluting end-user installs with the extra package (that might
conceivably conflict with some other project that names itself
"buildtest").
2016-03-22 22:56:03 -07:00
Brian Warner
1f712c8ddb Makefile: remove/deprecate old targets
This replaces the following targets with "echo this is obsolete":

* fetch-and-unpack-deps (used by the old 'tarballs' builder, for SUMO tarballs)
* test-desert-island (used by the old 'clean' builder)
* test-pip-install (used by 'new-pip' builder before we switched)

It also removes the test-pip-install.py helper script.
2016-03-22 14:12:45 -07:00
Brian Warner
16f07b34ce remove old misc/dependencies/ contents and references 2016-03-22 13:38:31 -07:00
Brian Warner
b5b2036d37 OS-X: fix package generation
The old scheme depended upon the bespoke pseudo-virtualenv scheme that
we cooked up long ago (it copied the entire source tree, bin/tahoe and
support/ and all, into the mac .pkg archive). When we moved to real
virtualenvs, that broke.

This new scheme only installs a populated virtualenv into the archive.
It replaces the entry-point bin/tahoe with a script that behaves a lot
like the old bespoke script: it inserts a relative site-packages/ into
sys.path before importing allmydata.scripts.runner and calling run().

This still depends upon the end-users $PATH having a python that is
compatible with the binary modules we've compiled here, and there are
three potentially-differing Pythons to worry about (homebrew, python.org
installers, and Apple's native /usr/bin/python). We'll have to see if
they tend to differ in ways that cause problems (I think the maintainers
generally try to avoid that). If that's an issue, the next level up is
to use bbfreeze or py2app or something in that category, to ship an
entire python, and not just a bundle of libraries.
2016-03-16 12:31:21 -07:00
Brian Warner
082bc3de6f OS-X installer license: wrap to fit, update CC 2016-03-16 12:23:44 -07:00
Brian Warner
be463cd36c OS-X: move Contents down into misc/ 2016-03-16 12:23:13 -07:00
Daira Hopwood
d8549a2c7f setuptools delenda est. fixes ticket:1582 :-D
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2016-03-15 17:19:10 +00:00
Brian Warner
eb0e786344 show-tool-versions.py: add tox
As we fix ticket:#1582, we'll move to 'tox' for running tests (which
creates its own virtualenv), so I'd like to see which buildslaves
currently have it installed, and which need to be updated.
2016-03-08 09:33:01 -08:00
Brian Warner
428ca04e2c show-tool-versions: add 'virtualenv' 2016-02-22 12:41:35 -08:00
Ramakrishnan Muthukrishnan
e92a9774fa OS-X package: add a preinstall script and copy the manpage into /etc/manpaths.d.
The preinstall script detects previous installation and removes it.

Author: Ramakrishnan Muthukrishnan <ram@leastauthority.com>
2015-09-03 15:18:08 +01:00
Brian Warner
d8e60f82a4 add test-pip-install 2015-06-16 13:46:43 -07:00
Brian Warner
cf9b382863 move Dockerfile back to root. DockerHub can't handle it elsewhere.
It looks like DockerHub's automated builds only have access to the
subtree of the source checkout at+below the Dockerfile. Putting the
Dockerfile in misc/build_helpers/ meant that the build process only had
access to misc/build_helpers/, not the full source tree.
2015-06-07 14:30:58 -07:00
Brian Warner
c79cda2c69 Dockerfile: fix ADD path to deal with non-root location 2015-06-07 14:24:04 -07:00
Brian Warner
ed7839b276 move Dockerfile down ito misc/build_helpers/ 2015-06-07 13:40:26 -07:00
Brian Warner
a517e00717 test-desert-island wasn't catching https downloads
I think the desert-island build is broken, but the automated test wasn't
catching it because of this bug.
2015-05-21 16:21:02 -07:00
Daira Hopwood
a2e116b330 Update copy of gen-package-table.py in source tree.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-05-13 13:36:04 +01:00
Ramakrishnan Muthukrishnan
96d2614266 fix OS X logo generation 2015-04-30 15:24:20 +01:00
Daira Hopwood
88b735b6be Build Tahoe-LAFS icon for OS X and Windows. refs ticket:2323
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-04-30 15:24:12 +01:00
Daira Hopwood
409cf22ee9 Bump zetuptoolz version (file changes).
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-04-28 18:52:59 +01:00
Ramakrishnan Muthukrishnan
c88deb40ba strip the single quotes around $VERSION
Without stripping the single quotes, the generated pagkage filename
also has the undesired single quotes around the version string.
(eg: tahoe-lafs-'1.10.0.post309'-osx.pkg).
2015-04-11 14:35:18 +05:30
Daira Hopwood
3f9c73bd68 Fix a missing import in test-osx-pkg.py. refs #2393
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:44:54 +00:00
Daira Hopwood
21204876ed More careful quoting in build-osx-pkg.sh. refs #2393
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:42:27 +00:00
Daira Hopwood
61f3d5ae13 Move computation of Tahoe version from Makefile to build-osx-pkg.sh. refs #2393
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:41:43 +00:00
Brian Warner
c12d49b54e create/test/upload tahoe-lafs-VERSION-osx.pkg, not tahoe-lafs-osx.pkg
Closes ticket:2393
2015-03-21 14:20:00 -07:00
Brian Warner
05c6966801 move build-osx-pkg out to a separate shell script
Also remove the duplicate test-osx-pkg (i.e. don't run the test as part
of the build, and have the caller do it themselves later).
2015-03-21 14:12:21 -07:00
Brian Warner
30987c1e7d remove stray trailing whitespace 2015-02-04 01:35:44 -08:00
Daira Hopwood
c60958e285 Update obsolete paths in munin plugin comments.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-12-05 17:52:13 +00:00
Daira Hopwood
cf0f64be98 misc/build_helpers/run_trial.py is no longer used.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-12-05 17:50:59 +00:00
Brian Warner
5218e87ed1 test-osx-pkg.py: remove unused import 2014-10-26 11:56:57 -07:00
Daira Hopwood
f4d40ffcbf misc/build_helpers/test-osx-pkg.py: script to test the OS X pkg.
After extracting the contents of the package, this script looks at the
output of 'tahoe --version-and-path' to see if the modules are installed
and invoked from the right path.

Author: Ramakrishnan Muthukrishnan <ram@leastauthority.com>
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-10-20 17:52:46 +01:00
Ramakrishnan Muthukrishnan
b07446ffc6 Distribution.xml file and scripts for building the OSX package. 2014-10-20 17:52:46 +01:00
Daira Hopwood
e0c9088757 Delete the obsolete misc/build_helpers/test_mac_diskimage.py script.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-10-13 18:50:01 +01:00
Zooko
f0ef82bfac remove all the unused scripts from build_helpers
Fixes #2305.
2014-09-30 03:54:55 +00:00
Brian Warner
5ddbf288b8 coverage2el.py: update to current coverage-3.7.1 API 2014-09-09 09:47:13 -07:00
Daira Hopwood
4f51040313 Update coverage-related targets in Makefile. refs #1698
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-09-08 22:49:23 +01:00
Brian Warner
a1cc7df23d remove obsolete debian-package building tools
setup.py: stop sometimes-depending upon 'stdeb'
setup.cfg: don't try to alias 'sdist_dsc'
misc/build_helpers/build-deb.py: delete this, it was really old anyways

Closes ticket:2282 (trac).
2014-09-04 22:05:08 -07:00
Brian Warner
99479226ed hush current pyflakes warnings (list comprehensions)
closes #2245
2014-06-23 13:54:07 -07:00
Zooko Wilcox-O'Hearn
f3a1107aab add print_py_pkg_ver for all deps
Including probable-near-future-transitive deps due to the new pyOpenSSL…
2014-05-12 21:51:03 +00:00
Zooko Wilcox-O'Hearn
17736575f4 remove lzip, add cffi, cryptography.io 2014-04-15 16:24:36 +00:00
Zooko Wilcox-O'Hearn
77b536c7a4 remove darcs tools from show-tool-versions 2014-04-11 14:34:01 +00:00
Daira Hopwood
3719978215 misc/simulators/hashbasedsig.py: revert last patch; the original code was correct.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-02-25 16:57:57 +00:00
Daira Hopwood
40c12fc736 misc/simulators/hashbasedsig.py: fix minor miscalculation bug.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-02-25 16:55:19 +00:00
Daira Hopwood
b262f656f4 misc/simulators/hashbasedsig.py: the cost of labels was being double-counted.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-02-25 01:04:03 +00:00
Daira Hopwood
946a9f9ddd misc/simulators/hashbasedsig.py: fix an incorrect comment.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-02-25 00:58:54 +00:00
Daira Hopwood
a0f477618d misc/build_helpers/gen-package-table.py: show Python 2.6 as unsupported on Windows.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2013-09-09 23:18:18 +01:00
Brian Warner
80b43b409f resurrect provisioning.py
It looks like commit 916d26e710, in
addition to making a one-line fix for #1681, also deleted
misc/operations_helpers/provisioning/provisioning.py entirely. This
brings it back.
2013-03-25 17:57:01 -07:00
Zooko O'Whielacronx
52571f469e add alternating grey-background to make it easier to scan across the table left to right 2012-10-08 12:08:50 -07:00
Zooko O'Whielacronx
63b24152a7 link from the tahoe-lafs-dep-eggs/README.html to the relevant wiki pages 2012-10-08 10:49:42 -07:00
david-sarah
28069a9641 misc/coding_tools/check-interfaces.py: clean-ups (warnings about Windows-specific modules and error stream handling). 2012-06-14 21:28:29 +00:00
david-sarah
97d6a162e0 misc/build_helpers/check-interfaces.py: avoid spurious warnings about ignored exceptions on shutdown. Also make the check function able to write errors to an arbitrary stream. 2012-05-18 02:12:52 +00:00
Brian Warner
488b6f8ccd test-dont-use-too-old-dep.py: fix tarfile timestamps
It turns out that TarFile.addfile() doesn't provide a reasonable default
timestamp, resulting in files dated to 1970 (they're probably wearing
bell-bottoms and listening to disco too). Then, when the bdist_egg command
tries to create a *zip*file with those files, it explodes because zipfiles
cannot handle timestamps before 1980 (it prefers boomboxes and jackets with
straps on the shoulders, thank you very much).

This puts a modern time.time() on the members of the tarfile, allowing future
cryptocoderarchaeologists the opportunity to make fun of fashion trends from
the user's chosen era, rather than an artificially older one.

refs #1342
2012-05-12 23:34:03 -07:00
Zooko
d867765604 modify build_helpers files
Should close #1342. This makes the actual changes to the two test
files (separated from the 'rename' patch to avoid VC complications).
2012-05-12 20:47:24 -07:00
Zooko
533e4bc813 rename build_helpers files
This is from the darcs patch for #1342, which failed to apply on my darcs
tree, so I'm landing it from git. I'm landing the rename-files part
separately from the modify-those-files part to avoid VC complications.
2012-05-12 20:47:01 -07:00
david-sarah
c7038d1807 misc/build_helpers/show-tool-versions.py: s/print_stderr/print_stdout/ 2012-04-01 02:28:26 +00:00
Zooko O'Whielacronx
4ead889f03 setup: show-tool-versions: report cl only on windows, report buildslave, git, openssl, and lzip, but not 7za 2012-04-01 00:59:25 +00:00
david-sarah
916d26e710 Suppress a warning from win32eventreactor on Windows (patch v2). fixes #1681 2012-02-27 19:03:17 +00:00
Brian Warner
fe1df149e1 make provisioning/reliability work in the new location, fix tests 2012-02-16 22:29:05 +00:00
Brian Warner
11f9394704 remove 'provisioning'/'reliability' from WUI, add to misc/operations_helpers
Also remove docs related to reliability/provisioning pages
2012-02-16 22:29:05 +00:00
Brian Warner
d887782418 add test-git-ignore.py, to port the 'clean' buildbot test to git
add .gitignore to match .darcs-boringfile, mostly
2012-01-08 14:12:32 -08:00
Brian Warner
37c0f2395d minor cleanup: remove trailing spaces in misc/ 2011-12-18 12:18:41 -08:00
david-sarah
4d6260d6ad check-miscaptures.py: report the number of files that were not analysed due to syntax errors (and don't count them in the number of suspicious captures). refs #1555 2011-10-09 05:03:01 +00:00
david-sarah
efd3c8b113 check-miscaptures.py: handle corner cases around default arguments correctly. Also make a minor optimization when there are no assigned variables to consider. refs #1555 2011-10-09 04:50:23 +00:00
david-sarah
5359c24e99 check-miscaptures.py: Python doesn't really have declarations; report the topmost assignment. refs #1555 2011-10-09 04:48:00 +00:00
david-sarah
1c6fe1d230 check-miscaptures.py: handle destructuring function arguments correctly. refs #1555 2011-10-09 04:47:10 +00:00
david-sarah
d2f3ef9714 check-miscaptures.py: check while loops and list comprehensions as well as for loops. Also fix a pyflakes warning. refs #1555 2011-10-09 04:40:22 +00:00
david-sarah
be1c94893f Add misc/coding_tools/check-miscaptures.py to detect incorrect captures of variables declared in a for loop, and a 'make check-miscaptures' Makefile target to run it. (It is also run by 'make code-checks'.) This is a rewritten version that reports much fewer false positives, by determining captured variables more accurately. fixes #1555 2011-10-07 07:41:21 +00:00
david-sarah
bac24aee0d Fix pyflakes warnings in misc/ directories other than misc/build_helpers. refs #1557 2011-10-07 03:30:31 +00:00
Brian Warner
1bbdec2a20 show-tool-versions: tolerate missing setuptools 2011-11-01 01:00:10 -07:00
Brian Warner
4baffeed1d show-tool-versions.py: condense output, hide file-not-found exceptions 2011-11-01 00:45:32 -07:00
Brian Warner
4952eef485 show-tool-versions.py: remove setuptools_trial, unused 2011-10-30 17:47:42 -07:00
david-sarah
3142538b0d misc/coding_tools/make-canary-files.py: fix a suspicious capture reported by check-miscaptures (although it happens not to be a bug because the callback will be processed synchronously). refs #1556 2011-10-08 22:05:31 -07:00
david-sarah
cbd0569e45 misc/check-interfaces.py: print a warning if a .pyc or .pyo file exists without a corresponding .py file. 2011-10-12 16:36:09 -07:00
david-sarah
bbb6e5d25e misc/simulators/hashbasedsig.py: simplify by removing unnecessary local function that captured a variable declared in a for loop (this was not a bug, but the code was unclear). Also fix a pyflakes warning about an import. refs #1556 2011-10-06 19:30:01 -07:00
david-sarah
32262239e5 misc/coding_tools/check_interfaces.py: report all violations rather than only one for a given class, by including a forked version of verifyClass. refs #1474 2011-09-16 15:34:50 -07:00
david-sarah
9ca8ff7bfc misc/coding_tools/check_interfaces.py: use os.walk instead of FilePath, since this script shouldn't really depend on Twisted. refs #1474 2011-09-16 14:26:33 -07:00
david-sarah
f1445ce0b2 misc/coding_tools/check-interfaces.py: reduce false-positives by adding Dummy* to the set of excluded classnames, and bench-* to the set of excluded basenames. refs #1474 2011-09-16 14:26:24 -07:00
david-sarah
417054aaba Add a script 'misc/coding_tools/check-interfaces.py' that checks whether zope interfaces are enforced. Also add 'check-interfaces', 'version-and-path', and 'code-checks' targets to the Makefile. fixes #1474 2011-09-15 09:15:32 -07:00
Brian Warner
37cd111009 remove misc/debian[_helpers], rely upon official packaging instead. fixes #1454 2011-08-11 11:27:05 -07:00
david-sarah
91c7cf9007 misc/build_helpers/run_trial.py: undo change to block pywin32 (it didn't work because run_trial.py is no longer used). refs #1334 2011-07-21 20:54:02 -07:00
david-sarah
6e0607f4e0 misc/build_helpers/run_trial.py: ensure that pywin32 is not on the sys.path when running the test suite. Includes some temporary debugging printouts that will be removed. refs #1334 2011-07-21 19:49:07 -07:00
Zooko O'Whielacronx
4f8e3e5ae8 contrib: remove the contributed fuse modules and the entire contrib/ directory, which is now empty
Also remove a couple of vestigial references to figleaf, which is long gone.
fixes #1409 (remove contrib/fuse)
2011-07-12 08:32:29 -07:00
david-sarah
a817163cc6 docs: convert NEWS to NEWS.rst and change all references to it. 2011-05-16 18:02:55 -07:00
francois
58af7c8f69 munin tahoe_files plugin: fix incorrect file count
fixes #1391
2011-04-27 22:53:12 -07:00
david-sarah
ae3373188c misc/build_helpers/run-with-pythonpath.py: fix pyflakes unused import warning. 2011-01-21 17:50:50 -08:00
david-sarah
06e0d13451 Apply pyflakes to more files and fix the resulting warnings. 2011-01-20 18:10:11 -08:00
david-sarah
5a7c99d29d Change misc/build_helpers/test-with-fake-pkg to use 'setup.py trial'. refs #1296 2011-01-18 20:24:01 -08:00
Brian Warner
1e377c2225 debian/control: add python-twisted-conch to dependencies. Closes #1095. 2011-01-16 23:12:06 -08:00
david-sarah
60d32bb7f7 misc/build_helpers/run_trial.py: fix pyflakes warning. 2011-01-15 00:04:56 -08:00
david-sarah
e2b564024b misc/build_helpers/test-with-fake-dists.py: clean up directories and files only if they exist. 2011-01-14 21:30:11 -08:00
david-sarah
089b27d9f8 misc/build_helpers/test-with-fake-dists.py: wrong arguments in comment. 2011-01-14 20:53:25 -08:00
david-sarah
33786a6d55 Attempt to fix test-with-fake-dist build step. 2011-01-14 18:26:51 -08:00
david-sarah
3ad08e6d2f misc/build_helpers/show-tool-versions.py: remove attempts to show stdout.encoding and stderr.encoding that always printed None due to redirection. Also remove code to show os.path.supports_unicode_filenames which is not useful. refs #1251 2011-01-02 17:51:44 -08:00
Brian Warner
1f0e2574cc update Makefile and coverage2el.py to coverage-3.4
It might still work with coverage-3.3 if you run with COVERAGE_OMIT=""
2010-11-25 12:38:32 -08:00
david-sarah
41e96b3e5a misc/build_helpers/run_trial.py: allow the module argument to specify a leaf module rather than a directory. This fixes false positive wrong-source errors in the test-from-prefixdir step when we test only allmydata.test.test_runner. 2010-11-21 15:39:57 -08:00
Zooko O'Whielacronx
f606ce068b misc: gen-package-table: show only the highest-numbered package for each platform and each library 2010-11-19 21:39:05 -08:00
Zooko O'Whielacronx
62af525179 tests: test-with-fake-dists: clean up *just* the pycryptopp-0.5.24 eggs when exiting
also don't set the PATH and PYTHONPATH, which is unnecessary for this test
also wrap the behavior in a couple of functions, just for tidiness
2010-11-17 22:31:09 -08:00