Brian Warner
9d20de3db9
improve run-deprecations script
...
Rewrote in Twisted, which lets us read/scan/print all log lines in
realtime. The output is now correctly interleaved (as well as
maintaining the stdout-vs-stderr of each message). The renamed
--warnings= logfile records all relevant lines from *both* stdout and
stderr (i.e. any that includes "DeprecationWarning"), which handles a
change (perhaps in recent Twisteds?) that emits these warnings on stdout
instead of stderr.
2016-04-06 11:07:06 -10:00
Brian Warner
c781fc188b
run-deprecations: flush stdout before starting trial
...
This should get the notes printed in the right order.
2016-04-06 09:23:48 -10:00
Brian Warner
14c513db8a
tox -e deprecations: add helper script to make it work
...
Tox doesn't run shell pipelines, and is unhappy about running tools that
it didn't install itself (including non-python things like "make"). So
this adds misc/build_helpers/run-deprecations.py, a python script that
runs a given command (i.e. trial) and writes stdout into a separate file
where the buildbot can see it, and counts the "DeprecationWarning" lines
from the file to decide the returncode.
This ought to improve the status display on the buildbot "test
deprecations" step.
2016-04-06 08:29:48 -10:00
Brian Warner
c545d5c0a1
add misc/coding_tools/graph-deps.py, to visualize dependencies
...
This builds and parses wheels for a given target, then renders a
DOT-format graph into a PNG file.
2016-03-25 14:50:16 -07:00
Brian Warner
23826b0224
fix OS-X package version
...
I changed the quotes in _version.py, and this script was sensitive to
them.
2016-03-23 02:32:48 -07:00
Brian Warner
831b39d8fb
remove src/buildtest/ and related build_helper/ test files
...
This was used to exercise our old virtualenv-like scheme. Now that we
use virtualenv, they're unnecessary. Plus, removing it lets us stop
polluting end-user installs with the extra package (that might
conceivably conflict with some other project that names itself
"buildtest").
2016-03-22 22:56:03 -07:00
Brian Warner
1f712c8ddb
Makefile: remove/deprecate old targets
...
This replaces the following targets with "echo this is obsolete":
* fetch-and-unpack-deps (used by the old 'tarballs' builder, for SUMO tarballs)
* test-desert-island (used by the old 'clean' builder)
* test-pip-install (used by 'new-pip' builder before we switched)
It also removes the test-pip-install.py helper script.
2016-03-22 14:12:45 -07:00
Brian Warner
16f07b34ce
remove old misc/dependencies/ contents and references
2016-03-22 13:38:31 -07:00
Brian Warner
b5b2036d37
OS-X: fix package generation
...
The old scheme depended upon the bespoke pseudo-virtualenv scheme that
we cooked up long ago (it copied the entire source tree, bin/tahoe and
support/ and all, into the mac .pkg archive). When we moved to real
virtualenvs, that broke.
This new scheme only installs a populated virtualenv into the archive.
It replaces the entry-point bin/tahoe with a script that behaves a lot
like the old bespoke script: it inserts a relative site-packages/ into
sys.path before importing allmydata.scripts.runner and calling run().
This still depends upon the end-users $PATH having a python that is
compatible with the binary modules we've compiled here, and there are
three potentially-differing Pythons to worry about (homebrew, python.org
installers, and Apple's native /usr/bin/python). We'll have to see if
they tend to differ in ways that cause problems (I think the maintainers
generally try to avoid that). If that's an issue, the next level up is
to use bbfreeze or py2app or something in that category, to ship an
entire python, and not just a bundle of libraries.
2016-03-16 12:31:21 -07:00
Brian Warner
082bc3de6f
OS-X installer license: wrap to fit, update CC
2016-03-16 12:23:44 -07:00
Brian Warner
be463cd36c
OS-X: move Contents down into misc/
2016-03-16 12:23:13 -07:00
Daira Hopwood
d8549a2c7f
setuptools delenda est. fixes ticket:1582 :-D
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2016-03-15 17:19:10 +00:00
Brian Warner
eb0e786344
show-tool-versions.py: add tox
...
As we fix ticket:#1582, we'll move to 'tox' for running tests (which
creates its own virtualenv), so I'd like to see which buildslaves
currently have it installed, and which need to be updated.
2016-03-08 09:33:01 -08:00
Brian Warner
428ca04e2c
show-tool-versions: add 'virtualenv'
2016-02-22 12:41:35 -08:00
Ramakrishnan Muthukrishnan
e92a9774fa
OS-X package: add a preinstall script and copy the manpage into /etc/manpaths.d.
...
The preinstall script detects previous installation and removes it.
Author: Ramakrishnan Muthukrishnan <ram@leastauthority.com>
2015-09-03 15:18:08 +01:00
Brian Warner
d8e60f82a4
add test-pip-install
2015-06-16 13:46:43 -07:00
Brian Warner
cf9b382863
move Dockerfile back to root. DockerHub can't handle it elsewhere.
...
It looks like DockerHub's automated builds only have access to the
subtree of the source checkout at+below the Dockerfile. Putting the
Dockerfile in misc/build_helpers/ meant that the build process only had
access to misc/build_helpers/, not the full source tree.
2015-06-07 14:30:58 -07:00
Brian Warner
c79cda2c69
Dockerfile: fix ADD path to deal with non-root location
2015-06-07 14:24:04 -07:00
Brian Warner
ed7839b276
move Dockerfile down ito misc/build_helpers/
2015-06-07 13:40:26 -07:00
Brian Warner
a517e00717
test-desert-island wasn't catching https downloads
...
I think the desert-island build is broken, but the automated test wasn't
catching it because of this bug.
2015-05-21 16:21:02 -07:00
Daira Hopwood
a2e116b330
Update copy of gen-package-table.py in source tree.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-05-13 13:36:04 +01:00
Ramakrishnan Muthukrishnan
96d2614266
fix OS X logo generation
2015-04-30 15:24:20 +01:00
Daira Hopwood
88b735b6be
Build Tahoe-LAFS icon for OS X and Windows. refs ticket:2323
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-04-30 15:24:12 +01:00
Daira Hopwood
409cf22ee9
Bump zetuptoolz version (file changes).
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-04-28 18:52:59 +01:00
Ramakrishnan Muthukrishnan
c88deb40ba
strip the single quotes around $VERSION
...
Without stripping the single quotes, the generated pagkage filename
also has the undesired single quotes around the version string.
(eg: tahoe-lafs-'1.10.0.post309'-osx.pkg).
2015-04-11 14:35:18 +05:30
Daira Hopwood
3f9c73bd68
Fix a missing import in test-osx-pkg.py. refs #2393
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:44:54 +00:00
Daira Hopwood
21204876ed
More careful quoting in build-osx-pkg.sh. refs #2393
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:42:27 +00:00
Daira Hopwood
61f3d5ae13
Move computation of Tahoe version from Makefile to build-osx-pkg.sh. refs #2393
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:41:43 +00:00
Brian Warner
c12d49b54e
create/test/upload tahoe-lafs-VERSION-osx.pkg, not tahoe-lafs-osx.pkg
...
Closes ticket:2393
2015-03-21 14:20:00 -07:00
Brian Warner
05c6966801
move build-osx-pkg out to a separate shell script
...
Also remove the duplicate test-osx-pkg (i.e. don't run the test as part
of the build, and have the caller do it themselves later).
2015-03-21 14:12:21 -07:00
Brian Warner
30987c1e7d
remove stray trailing whitespace
2015-02-04 01:35:44 -08:00
Daira Hopwood
c60958e285
Update obsolete paths in munin plugin comments.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-12-05 17:52:13 +00:00
Daira Hopwood
cf0f64be98
misc/build_helpers/run_trial.py is no longer used.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-12-05 17:50:59 +00:00
Brian Warner
5218e87ed1
test-osx-pkg.py: remove unused import
2014-10-26 11:56:57 -07:00
Daira Hopwood
f4d40ffcbf
misc/build_helpers/test-osx-pkg.py: script to test the OS X pkg.
...
After extracting the contents of the package, this script looks at the
output of 'tahoe --version-and-path' to see if the modules are installed
and invoked from the right path.
Author: Ramakrishnan Muthukrishnan <ram@leastauthority.com>
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-10-20 17:52:46 +01:00
Ramakrishnan Muthukrishnan
b07446ffc6
Distribution.xml file and scripts for building the OSX package.
2014-10-20 17:52:46 +01:00
Daira Hopwood
e0c9088757
Delete the obsolete misc/build_helpers/test_mac_diskimage.py script.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-10-13 18:50:01 +01:00
Zooko
f0ef82bfac
remove all the unused scripts from build_helpers
...
Fixes #2305 .
2014-09-30 03:54:55 +00:00
Brian Warner
5ddbf288b8
coverage2el.py: update to current coverage-3.7.1 API
2014-09-09 09:47:13 -07:00
Daira Hopwood
4f51040313
Update coverage-related targets in Makefile. refs #1698
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-09-08 22:49:23 +01:00
Brian Warner
a1cc7df23d
remove obsolete debian-package building tools
...
setup.py: stop sometimes-depending upon 'stdeb'
setup.cfg: don't try to alias 'sdist_dsc'
misc/build_helpers/build-deb.py: delete this, it was really old anyways
Closes ticket:2282 (trac).
2014-09-04 22:05:08 -07:00
Brian Warner
99479226ed
hush current pyflakes warnings (list comprehensions)
...
closes #2245
2014-06-23 13:54:07 -07:00
Zooko Wilcox-O'Hearn
f3a1107aab
add print_py_pkg_ver for all deps
...
Including probable-near-future-transitive deps due to the new pyOpenSSL…
2014-05-12 21:51:03 +00:00
Zooko Wilcox-O'Hearn
17736575f4
remove lzip, add cffi, cryptography.io
2014-04-15 16:24:36 +00:00
Zooko Wilcox-O'Hearn
77b536c7a4
remove darcs tools from show-tool-versions
2014-04-11 14:34:01 +00:00
Daira Hopwood
3719978215
misc/simulators/hashbasedsig.py: revert last patch; the original code was correct.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-02-25 16:57:57 +00:00
Daira Hopwood
40c12fc736
misc/simulators/hashbasedsig.py: fix minor miscalculation bug.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-02-25 16:55:19 +00:00
Daira Hopwood
b262f656f4
misc/simulators/hashbasedsig.py: the cost of labels was being double-counted.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-02-25 01:04:03 +00:00
Daira Hopwood
946a9f9ddd
misc/simulators/hashbasedsig.py: fix an incorrect comment.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-02-25 00:58:54 +00:00
Daira Hopwood
a0f477618d
misc/build_helpers/gen-package-table.py: show Python 2.6 as unsupported on Windows.
...
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2013-09-09 23:18:18 +01:00
Brian Warner
80b43b409f
resurrect provisioning.py
...
It looks like commit 916d26e710
, in
addition to making a one-line fix for #1681 , also deleted
misc/operations_helpers/provisioning/provisioning.py entirely. This
brings it back.
2013-03-25 17:57:01 -07:00
Zooko O'Whielacronx
52571f469e
add alternating grey-background to make it easier to scan across the table left to right
2012-10-08 12:08:50 -07:00
Zooko O'Whielacronx
63b24152a7
link from the tahoe-lafs-dep-eggs/README.html to the relevant wiki pages
2012-10-08 10:49:42 -07:00
david-sarah
28069a9641
misc/coding_tools/check-interfaces.py: clean-ups (warnings about Windows-specific modules and error stream handling).
2012-06-14 21:28:29 +00:00
david-sarah
97d6a162e0
misc/build_helpers/check-interfaces.py: avoid spurious warnings about ignored exceptions on shutdown. Also make the check function able to write errors to an arbitrary stream.
2012-05-18 02:12:52 +00:00
Brian Warner
488b6f8ccd
test-dont-use-too-old-dep.py: fix tarfile timestamps
...
It turns out that TarFile.addfile() doesn't provide a reasonable default
timestamp, resulting in files dated to 1970 (they're probably wearing
bell-bottoms and listening to disco too). Then, when the bdist_egg command
tries to create a *zip*file with those files, it explodes because zipfiles
cannot handle timestamps before 1980 (it prefers boomboxes and jackets with
straps on the shoulders, thank you very much).
This puts a modern time.time() on the members of the tarfile, allowing future
cryptocoderarchaeologists the opportunity to make fun of fashion trends from
the user's chosen era, rather than an artificially older one.
refs #1342
2012-05-12 23:34:03 -07:00
Zooko
d867765604
modify build_helpers files
...
Should close #1342 . This makes the actual changes to the two test
files (separated from the 'rename' patch to avoid VC complications).
2012-05-12 20:47:24 -07:00
Zooko
533e4bc813
rename build_helpers files
...
This is from the darcs patch for #1342 , which failed to apply on my darcs
tree, so I'm landing it from git. I'm landing the rename-files part
separately from the modify-those-files part to avoid VC complications.
2012-05-12 20:47:01 -07:00
david-sarah
c7038d1807
misc/build_helpers/show-tool-versions.py: s/print_stderr/print_stdout/
2012-04-01 02:28:26 +00:00
Zooko O'Whielacronx
4ead889f03
setup: show-tool-versions: report cl only on windows, report buildslave, git, openssl, and lzip, but not 7za
2012-04-01 00:59:25 +00:00
david-sarah
916d26e710
Suppress a warning from win32eventreactor on Windows (patch v2). fixes #1681
2012-02-27 19:03:17 +00:00
Brian Warner
fe1df149e1
make provisioning/reliability work in the new location, fix tests
2012-02-16 22:29:05 +00:00
Brian Warner
11f9394704
remove 'provisioning'/'reliability' from WUI, add to misc/operations_helpers
...
Also remove docs related to reliability/provisioning pages
2012-02-16 22:29:05 +00:00
Brian Warner
d887782418
add test-git-ignore.py, to port the 'clean' buildbot test to git
...
add .gitignore to match .darcs-boringfile, mostly
2012-01-08 14:12:32 -08:00
Brian Warner
37c0f2395d
minor cleanup: remove trailing spaces in misc/
2011-12-18 12:18:41 -08:00
david-sarah
4d6260d6ad
check-miscaptures.py: report the number of files that were not analysed due to syntax errors (and don't count them in the number of suspicious captures). refs #1555
2011-10-09 05:03:01 +00:00
david-sarah
efd3c8b113
check-miscaptures.py: handle corner cases around default arguments correctly. Also make a minor optimization when there are no assigned variables to consider. refs #1555
2011-10-09 04:50:23 +00:00
david-sarah
5359c24e99
check-miscaptures.py: Python doesn't really have declarations; report the topmost assignment. refs #1555
2011-10-09 04:48:00 +00:00
david-sarah
1c6fe1d230
check-miscaptures.py: handle destructuring function arguments correctly. refs #1555
2011-10-09 04:47:10 +00:00
david-sarah
d2f3ef9714
check-miscaptures.py: check while loops and list comprehensions as well as for loops. Also fix a pyflakes warning. refs #1555
2011-10-09 04:40:22 +00:00
david-sarah
be1c94893f
Add misc/coding_tools/check-miscaptures.py to detect incorrect captures of variables declared in a for loop, and a 'make check-miscaptures' Makefile target to run it. (It is also run by 'make code-checks'.) This is a rewritten version that reports much fewer false positives, by determining captured variables more accurately. fixes #1555
2011-10-07 07:41:21 +00:00
david-sarah
bac24aee0d
Fix pyflakes warnings in misc/ directories other than misc/build_helpers. refs #1557
2011-10-07 03:30:31 +00:00
Brian Warner
1bbdec2a20
show-tool-versions: tolerate missing setuptools
2011-11-01 01:00:10 -07:00
Brian Warner
4baffeed1d
show-tool-versions.py: condense output, hide file-not-found exceptions
2011-11-01 00:45:32 -07:00
Brian Warner
4952eef485
show-tool-versions.py: remove setuptools_trial, unused
2011-10-30 17:47:42 -07:00
david-sarah
3142538b0d
misc/coding_tools/make-canary-files.py: fix a suspicious capture reported by check-miscaptures (although it happens not to be a bug because the callback will be processed synchronously). refs #1556
2011-10-08 22:05:31 -07:00
david-sarah
cbd0569e45
misc/check-interfaces.py: print a warning if a .pyc or .pyo file exists without a corresponding .py file.
2011-10-12 16:36:09 -07:00
david-sarah
bbb6e5d25e
misc/simulators/hashbasedsig.py: simplify by removing unnecessary local function that captured a variable declared in a for loop (this was not a bug, but the code was unclear). Also fix a pyflakes warning about an import. refs #1556
2011-10-06 19:30:01 -07:00
david-sarah
32262239e5
misc/coding_tools/check_interfaces.py: report all violations rather than only one for a given class, by including a forked version of verifyClass. refs #1474
2011-09-16 15:34:50 -07:00
david-sarah
9ca8ff7bfc
misc/coding_tools/check_interfaces.py: use os.walk instead of FilePath, since this script shouldn't really depend on Twisted. refs #1474
2011-09-16 14:26:33 -07:00
david-sarah
f1445ce0b2
misc/coding_tools/check-interfaces.py: reduce false-positives by adding Dummy* to the set of excluded classnames, and bench-* to the set of excluded basenames. refs #1474
2011-09-16 14:26:24 -07:00
david-sarah
417054aaba
Add a script 'misc/coding_tools/check-interfaces.py' that checks whether zope interfaces are enforced. Also add 'check-interfaces', 'version-and-path', and 'code-checks' targets to the Makefile. fixes #1474
2011-09-15 09:15:32 -07:00
Brian Warner
37cd111009
remove misc/debian[_helpers], rely upon official packaging instead. fixes #1454
2011-08-11 11:27:05 -07:00
david-sarah
91c7cf9007
misc/build_helpers/run_trial.py: undo change to block pywin32 (it didn't work because run_trial.py is no longer used). refs #1334
2011-07-21 20:54:02 -07:00
david-sarah
6e0607f4e0
misc/build_helpers/run_trial.py: ensure that pywin32 is not on the sys.path when running the test suite. Includes some temporary debugging printouts that will be removed. refs #1334
2011-07-21 19:49:07 -07:00
Zooko O'Whielacronx
4f8e3e5ae8
contrib: remove the contributed fuse modules and the entire contrib/ directory, which is now empty
...
Also remove a couple of vestigial references to figleaf, which is long gone.
fixes #1409 (remove contrib/fuse)
2011-07-12 08:32:29 -07:00
david-sarah
a817163cc6
docs: convert NEWS to NEWS.rst and change all references to it.
2011-05-16 18:02:55 -07:00
francois
58af7c8f69
munin tahoe_files plugin: fix incorrect file count
...
fixes #1391
2011-04-27 22:53:12 -07:00
david-sarah
ae3373188c
misc/build_helpers/run-with-pythonpath.py: fix pyflakes unused import warning.
2011-01-21 17:50:50 -08:00
david-sarah
06e0d13451
Apply pyflakes to more files and fix the resulting warnings.
2011-01-20 18:10:11 -08:00
david-sarah
5a7c99d29d
Change misc/build_helpers/test-with-fake-pkg to use 'setup.py trial'. refs #1296
2011-01-18 20:24:01 -08:00
Brian Warner
1e377c2225
debian/control: add python-twisted-conch to dependencies. Closes #1095 .
2011-01-16 23:12:06 -08:00
david-sarah
60d32bb7f7
misc/build_helpers/run_trial.py: fix pyflakes warning.
2011-01-15 00:04:56 -08:00
david-sarah
e2b564024b
misc/build_helpers/test-with-fake-dists.py: clean up directories and files only if they exist.
2011-01-14 21:30:11 -08:00
david-sarah
089b27d9f8
misc/build_helpers/test-with-fake-dists.py: wrong arguments in comment.
2011-01-14 20:53:25 -08:00
david-sarah
33786a6d55
Attempt to fix test-with-fake-dist build step.
2011-01-14 18:26:51 -08:00
david-sarah
3ad08e6d2f
misc/build_helpers/show-tool-versions.py: remove attempts to show stdout.encoding and stderr.encoding that always printed None due to redirection. Also remove code to show os.path.supports_unicode_filenames which is not useful. refs #1251
2011-01-02 17:51:44 -08:00
Brian Warner
1f0e2574cc
update Makefile and coverage2el.py to coverage-3.4
...
It might still work with coverage-3.3 if you run with COVERAGE_OMIT=""
2010-11-25 12:38:32 -08:00
david-sarah
41e96b3e5a
misc/build_helpers/run_trial.py: allow the module argument to specify a leaf module rather than a directory. This fixes false positive wrong-source errors in the test-from-prefixdir step when we test only allmydata.test.test_runner.
2010-11-21 15:39:57 -08:00
Zooko O'Whielacronx
f606ce068b
misc: gen-package-table: show only the highest-numbered package for each platform and each library
2010-11-19 21:39:05 -08:00