Commit Graph

581 Commits

Author SHA1 Message Date
Itamar Turner-Trauring
5568693666 More passing tests. 2020-07-21 14:38:01 -04:00
Itamar Turner-Trauring
37fa687d4b More passing tests for the ratchet. 2020-07-16 14:42:49 -04:00
Itamar Turner-Trauring
58c4908d46 More tests are passing. 2020-07-16 14:36:49 -04:00
Chad Whitacre
3f887f9279 Respond to review
- Use the subunitv2-file reporter to allow for nicer error handling
- Undo the depgraph.sh change, see if it really matters
- Rename passing -> ratchet-passing to distinguish from ported modules
  tracker
- Misc. documentation and ratchet.sh improvements
2020-07-14 20:11:58 -04:00
Chad Whitacre
e2d6b353e8 Tighten up condition in depgraph.sh
I ran into a circumstance where it appears that there were changes other
than to the two files we care about, leading to an empty commit and a CI
failure:

https://app.circleci.com/pipelines/github/tahoe-lafs/tahoe-lafs/320/workflows/7d045f5f-1536-4cfa-b232-42837d4c9334/jobs/22127/steps
2020-07-14 06:42:45 -04:00
Chad Whitacre
d25c8b1a25 Start ratcheting up passing tests under Python 3 2020-07-13 22:42:48 -04:00
Itamar Turner-Trauring
28f219ad3e Update to version that supports _python3.py variant of port list. 2020-07-08 16:46:54 -04:00
Jean-Paul Calderone
1de51cd24d follow the renaming 2019-09-17 11:36:09 -04:00
Jean-Paul Calderone
98b3a644da add some tests 2019-09-17 11:35:37 -04:00
Jean-Paul Calderone
c09f61e966 Point at our own tahoe-depgraph.py 2019-09-17 10:21:46 -04:00
Jean-Paul Calderone
f421ce6fc7 import tahoe-depgraph.py from tahoe-depgraph project
it's easier to version it alongside tahoe itself
2019-09-17 10:20:26 -04:00
Jean-Paul Calderone
43610b8605 Always *build* it.
Just decline to push sometimes.

This way, if it's broken, you'll see that it's broken when working on your
branch.
2019-09-16 10:22:56 -04:00
Jean-Paul Calderone
880920e1de Correct the filename 2019-09-16 10:21:15 -04:00
Jean-Paul Calderone
7bfef2d6e0 Tell git about the changed files specifically. 2019-09-16 09:21:05 -04:00
Jean-Paul Calderone
32492ec28a Only run for master from now on 2019-09-13 13:10:02 -04:00
Jean-Paul Calderone
e51de52542 should be done already 2019-09-13 13:01:34 -04:00
Jean-Paul Calderone
00394de676 This should report the tahoe-depgraph revision. 2019-09-13 12:52:11 -04:00
Jean-Paul Calderone
227451732f Get the git config into the right repository 2019-09-13 12:51:06 -04:00
Jean-Paul Calderone
bfa2cb8816 Close paren needed 2019-09-13 12:50:05 -04:00
Jean-Paul Calderone
0daefad3a9 It's okay. Ask the filesystem. 2019-09-13 12:48:42 -04:00
Jean-Paul Calderone
5fd44f1914 Start from the right branch 2019-09-13 12:28:55 -04:00
Jean-Paul Calderone
fae2fa4bef This looks Python 3 compatible to me. 2019-09-13 12:25:03 -04:00
Jean-Paul Calderone
4dda91df0e Add a list of modules already ported to Python 3. 2019-09-13 11:38:30 -04:00
Jean-Paul Calderone
a3bb83221a Get a dependency 2019-09-13 11:27:00 -04:00
Jean-Paul Calderone
dd673a7862 Get the path to env right 2019-09-13 11:24:10 -04:00
Jean-Paul Calderone
ce0d595185 Make it executable. 2019-09-13 11:23:19 -04:00
Jean-Paul Calderone
42a01f0046 Add a CI job which runs depgraph.
It can also push the results to GitHub pages.
2019-09-13 11:05:05 -04:00
Jean-Paul Calderone
9788857df6 Turn the comment into a docstring 2019-08-07 15:57:06 -04:00
Jean-Paul Calderone
856b3782ea add a --package option to run-deprecations so we can restrict to our own errors 2019-08-02 18:28:36 -06:00
heartsucker
33090ef6e2 remove last remaining references to pycryptopp 2019-06-13 22:19:28 -06:00
heartsucker
44b268fee6 removed pycryptopp dependency 2019-06-13 22:19:28 -06:00
tpltnt
c8f11dc2d3 ported old-style classes to new-style 2019-05-26 08:28:18 +02:00
heartsucker
ae5e282e2f
update raise syntax for python3 compatibility 2019-04-05 11:39:10 +02:00
heartsucker
0750dbac38
updated all python files to use pep-3110 exception syntax for python3 compatibility 2019-04-04 11:57:58 +02:00
meejah
6970c2cc6d
Merge pull request #579 from tahoe-lafs/3001-python3-syntax-check
python3 syntax check
2019-03-28 19:14:59 +00:00
heartsucker
5adde83acf
python3 compatibility for show-tool-versions.py for CI 2019-03-28 12:32:13 +01:00
heartsucker
dbfcf8ae00
replaced StringIO imports with six.moves 2019-03-28 12:31:37 +01:00
heartsucker
55f8408718
use print function over print statement in ./misc/ directory 2019-03-22 11:41:16 +01:00
Jean-Paul Calderone
922554cd28 Probably some test cruft screws up the package 2019-01-26 10:02:08 -05:00
Jean-Paul Calderone
4f119c876c what's coming out of this 2019-01-26 10:02:08 -05:00
Jean-Paul Calderone
d790d3d325 report more about the failed process 2019-01-26 10:02:08 -05:00
Jean-Paul Calderone
41fe2189dd whitespace cleanup 2019-01-26 10:02:08 -05:00
Jean-Paul Calderone
0f5d0e3131 Comment out "testing" code... 2018-04-26 15:07:09 -04:00
Jean-Paul Calderone
206ab732e6 Replace use of deprecated sha module 2018-04-26 15:00:36 -04:00
Jean-Paul Calderone
f99b3bdbda Remove complicated and dead code 2018-04-26 14:58:40 -04:00
Jean-Paul Calderone
cc6006dcb3 Replace use of deprecated sha module 2018-04-26 14:57:45 -04:00
Brian Warner
f155ade4ad misc/simulators/ringsim.py: fix LGTM nit
We haven't used this tool for a decade, but LGTM flagged a static-analysis
warning. Fixing it to see if the LGTM dashboard is looking at new builds.
2018-03-27 23:51:02 -07:00
Brian Warner
5e62118e14 hush somewhat-real problems found by static analysis
These would have caused problems if a certain unlikely code path was taken:
mostly error-handling pathways.
2017-12-31 00:23:43 +01:00
Brian Warner
da4e7dcfbe hush a bunch of not-really-problems caught by the lgtm.com static analyzer
This is all minor stuff: unreachable debug code (that should be commented-out
instead of in an 'if False:' block), unnecessary 'pass' and 'global'
statements, redundantly-initialized variables. No behavior changes. Nothing
here was actually broken, it just looked suspicious to the static analysis at
https://lgtm.com/projects/g/tahoe-lafs/tahoe-lafs/alerts/?mode=list .
2017-12-31 00:19:41 +01:00
Jean-Paul Calderone
695f40fb52 Get rid of unused names 2017-08-08 08:30:32 -04:00
Jean-Paul Calderone
95df32f9ed remove unused import 2017-08-08 08:29:57 -04:00
meejah
031a88c25f simplejson -> json 2017-02-23 15:21:36 -07:00
Brian Warner
36c57c74f4 make tox env for code-checks
This executes: check-debugging, check-interfaces, check-miscaptures,
find-trailing-spaces, check-umids, pyflakes.

Other changes:

* fix check-umids.py to take starting points. run it as `check-umids.py
  src` instead of `check-umids.py src/allmydata/*.py`
* check-debugging: rewrite in python to run from tox: tox doesn't like
  to run shell scripts.
* put check-interfaces.py last: it produces lots of warnings, but passes
  anyways. The others only produce significant output if they fail.
2016-08-19 17:42:05 -07:00
meejah
d641aef2a3 Simple test for defer.setDebugging(True) calls 2016-08-19 11:37:15 -06:00
Brian Warner
ea473cdc76 remove pickle-based stats output altogether
* update munin plugin to read JSON, not pickle
* update docs
2016-04-27 17:27:33 -07:00
Brian Warner
b81c6a7208 run-deprecations: supress duplicates
I thought 'warnings' or twisted.python.deprecate was supposed to do this
already, but it's clearly not working.
2016-04-06 13:37:52 -10:00
Brian Warner
9d20de3db9 improve run-deprecations script
Rewrote in Twisted, which lets us read/scan/print all log lines in
realtime. The output is now correctly interleaved (as well as
maintaining the stdout-vs-stderr of each message). The renamed
--warnings= logfile records all relevant lines from *both* stdout and
stderr (i.e. any that includes "DeprecationWarning"), which handles a
change (perhaps in recent Twisteds?) that emits these warnings on stdout
instead of stderr.
2016-04-06 11:07:06 -10:00
Brian Warner
c781fc188b run-deprecations: flush stdout before starting trial
This should get the notes printed in the right order.
2016-04-06 09:23:48 -10:00
Brian Warner
14c513db8a tox -e deprecations: add helper script to make it work
Tox doesn't run shell pipelines, and is unhappy about running tools that
it didn't install itself (including non-python things like "make"). So
this adds misc/build_helpers/run-deprecations.py, a python script that
runs a given command (i.e. trial) and writes stdout into a separate file
where the buildbot can see it, and counts the "DeprecationWarning" lines
from the file to decide the returncode.

This ought to improve the status display on the buildbot "test
deprecations" step.
2016-04-06 08:29:48 -10:00
Brian Warner
c545d5c0a1 add misc/coding_tools/graph-deps.py, to visualize dependencies
This builds and parses wheels for a given target, then renders a
DOT-format graph into a PNG file.
2016-03-25 14:50:16 -07:00
Brian Warner
23826b0224 fix OS-X package version
I changed the quotes in _version.py, and this script was sensitive to
them.
2016-03-23 02:32:48 -07:00
Brian Warner
831b39d8fb remove src/buildtest/ and related build_helper/ test files
This was used to exercise our old virtualenv-like scheme. Now that we
use virtualenv, they're unnecessary. Plus, removing it lets us stop
polluting end-user installs with the extra package (that might
conceivably conflict with some other project that names itself
"buildtest").
2016-03-22 22:56:03 -07:00
Brian Warner
1f712c8ddb Makefile: remove/deprecate old targets
This replaces the following targets with "echo this is obsolete":

* fetch-and-unpack-deps (used by the old 'tarballs' builder, for SUMO tarballs)
* test-desert-island (used by the old 'clean' builder)
* test-pip-install (used by 'new-pip' builder before we switched)

It also removes the test-pip-install.py helper script.
2016-03-22 14:12:45 -07:00
Brian Warner
16f07b34ce remove old misc/dependencies/ contents and references 2016-03-22 13:38:31 -07:00
Brian Warner
b5b2036d37 OS-X: fix package generation
The old scheme depended upon the bespoke pseudo-virtualenv scheme that
we cooked up long ago (it copied the entire source tree, bin/tahoe and
support/ and all, into the mac .pkg archive). When we moved to real
virtualenvs, that broke.

This new scheme only installs a populated virtualenv into the archive.
It replaces the entry-point bin/tahoe with a script that behaves a lot
like the old bespoke script: it inserts a relative site-packages/ into
sys.path before importing allmydata.scripts.runner and calling run().

This still depends upon the end-users $PATH having a python that is
compatible with the binary modules we've compiled here, and there are
three potentially-differing Pythons to worry about (homebrew, python.org
installers, and Apple's native /usr/bin/python). We'll have to see if
they tend to differ in ways that cause problems (I think the maintainers
generally try to avoid that). If that's an issue, the next level up is
to use bbfreeze or py2app or something in that category, to ship an
entire python, and not just a bundle of libraries.
2016-03-16 12:31:21 -07:00
Brian Warner
082bc3de6f OS-X installer license: wrap to fit, update CC 2016-03-16 12:23:44 -07:00
Brian Warner
be463cd36c OS-X: move Contents down into misc/ 2016-03-16 12:23:13 -07:00
Daira Hopwood
d8549a2c7f setuptools delenda est. fixes ticket:1582 :-D
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2016-03-15 17:19:10 +00:00
Brian Warner
eb0e786344 show-tool-versions.py: add tox
As we fix ticket:#1582, we'll move to 'tox' for running tests (which
creates its own virtualenv), so I'd like to see which buildslaves
currently have it installed, and which need to be updated.
2016-03-08 09:33:01 -08:00
Brian Warner
428ca04e2c show-tool-versions: add 'virtualenv' 2016-02-22 12:41:35 -08:00
Ramakrishnan Muthukrishnan
e92a9774fa OS-X package: add a preinstall script and copy the manpage into /etc/manpaths.d.
The preinstall script detects previous installation and removes it.

Author: Ramakrishnan Muthukrishnan <ram@leastauthority.com>
2015-09-03 15:18:08 +01:00
Brian Warner
d8e60f82a4 add test-pip-install 2015-06-16 13:46:43 -07:00
Brian Warner
cf9b382863 move Dockerfile back to root. DockerHub can't handle it elsewhere.
It looks like DockerHub's automated builds only have access to the
subtree of the source checkout at+below the Dockerfile. Putting the
Dockerfile in misc/build_helpers/ meant that the build process only had
access to misc/build_helpers/, not the full source tree.
2015-06-07 14:30:58 -07:00
Brian Warner
c79cda2c69 Dockerfile: fix ADD path to deal with non-root location 2015-06-07 14:24:04 -07:00
Brian Warner
ed7839b276 move Dockerfile down ito misc/build_helpers/ 2015-06-07 13:40:26 -07:00
Brian Warner
a517e00717 test-desert-island wasn't catching https downloads
I think the desert-island build is broken, but the automated test wasn't
catching it because of this bug.
2015-05-21 16:21:02 -07:00
Daira Hopwood
a2e116b330 Update copy of gen-package-table.py in source tree.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-05-13 13:36:04 +01:00
Ramakrishnan Muthukrishnan
96d2614266 fix OS X logo generation 2015-04-30 15:24:20 +01:00
Daira Hopwood
88b735b6be Build Tahoe-LAFS icon for OS X and Windows. refs ticket:2323
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-04-30 15:24:12 +01:00
Daira Hopwood
409cf22ee9 Bump zetuptoolz version (file changes).
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-04-28 18:52:59 +01:00
Ramakrishnan Muthukrishnan
c88deb40ba strip the single quotes around $VERSION
Without stripping the single quotes, the generated pagkage filename
also has the undesired single quotes around the version string.
(eg: tahoe-lafs-'1.10.0.post309'-osx.pkg).
2015-04-11 14:35:18 +05:30
Daira Hopwood
3f9c73bd68 Fix a missing import in test-osx-pkg.py. refs #2393
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:44:54 +00:00
Daira Hopwood
21204876ed More careful quoting in build-osx-pkg.sh. refs #2393
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:42:27 +00:00
Daira Hopwood
61f3d5ae13 Move computation of Tahoe version from Makefile to build-osx-pkg.sh. refs #2393
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2015-03-24 16:41:43 +00:00
Brian Warner
c12d49b54e create/test/upload tahoe-lafs-VERSION-osx.pkg, not tahoe-lafs-osx.pkg
Closes ticket:2393
2015-03-21 14:20:00 -07:00
Brian Warner
05c6966801 move build-osx-pkg out to a separate shell script
Also remove the duplicate test-osx-pkg (i.e. don't run the test as part
of the build, and have the caller do it themselves later).
2015-03-21 14:12:21 -07:00
Brian Warner
30987c1e7d remove stray trailing whitespace 2015-02-04 01:35:44 -08:00
Daira Hopwood
c60958e285 Update obsolete paths in munin plugin comments.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-12-05 17:52:13 +00:00
Daira Hopwood
cf0f64be98 misc/build_helpers/run_trial.py is no longer used.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-12-05 17:50:59 +00:00
Brian Warner
5218e87ed1 test-osx-pkg.py: remove unused import 2014-10-26 11:56:57 -07:00
Daira Hopwood
f4d40ffcbf misc/build_helpers/test-osx-pkg.py: script to test the OS X pkg.
After extracting the contents of the package, this script looks at the
output of 'tahoe --version-and-path' to see if the modules are installed
and invoked from the right path.

Author: Ramakrishnan Muthukrishnan <ram@leastauthority.com>
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-10-20 17:52:46 +01:00
Ramakrishnan Muthukrishnan
b07446ffc6 Distribution.xml file and scripts for building the OSX package. 2014-10-20 17:52:46 +01:00
Daira Hopwood
e0c9088757 Delete the obsolete misc/build_helpers/test_mac_diskimage.py script.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-10-13 18:50:01 +01:00
Zooko
f0ef82bfac remove all the unused scripts from build_helpers
Fixes #2305.
2014-09-30 03:54:55 +00:00
Brian Warner
5ddbf288b8 coverage2el.py: update to current coverage-3.7.1 API 2014-09-09 09:47:13 -07:00
Daira Hopwood
4f51040313 Update coverage-related targets in Makefile. refs #1698
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2014-09-08 22:49:23 +01:00
Brian Warner
a1cc7df23d remove obsolete debian-package building tools
setup.py: stop sometimes-depending upon 'stdeb'
setup.cfg: don't try to alias 'sdist_dsc'
misc/build_helpers/build-deb.py: delete this, it was really old anyways

Closes ticket:2282 (trac).
2014-09-04 22:05:08 -07:00
Brian Warner
99479226ed hush current pyflakes warnings (list comprehensions)
closes #2245
2014-06-23 13:54:07 -07:00
Zooko Wilcox-O'Hearn
f3a1107aab add print_py_pkg_ver for all deps
Including probable-near-future-transitive deps due to the new pyOpenSSL…
2014-05-12 21:51:03 +00:00
Zooko Wilcox-O'Hearn
17736575f4 remove lzip, add cffi, cryptography.io 2014-04-15 16:24:36 +00:00