Commit Graph

616 Commits

Author SHA1 Message Date
Jean-Paul Calderone
8d1798fbb6
is the pager screwing up? 2020-08-07 22:26:39 -04:00
Jean-Paul Calderone
9af1e741d8
that was kind of annoyingly non-illuminating 2020-08-07 22:21:53 -04:00
Jean-Paul Calderone
a758b84e15
handling this elsewhere 2020-08-07 22:21:53 -04:00
Jean-Paul Calderone
107861802b
idk maybe this 2020-08-07 21:18:29 -04:00
Jean-Paul Calderone
8b44b89f75
oi 2020-08-07 18:33:35 -04:00
Jean-Paul Calderone
7c92278524
getting ridiculous 2020-08-07 15:52:57 -04:00
Jean-Paul Calderone
b1e67774b4
Try getting the _trial_temp out of the working tree 2020-08-07 15:46:46 -04:00
Jean-Paul Calderone
1f3d246567
try to get more info 2020-08-07 15:13:33 -04:00
Jean-Paul Calderone
5736f9cdeb
Let's just see, for fun 2020-08-07 14:31:32 -04:00
Jean-Paul Calderone
d6a80c891a
try to understand the CI failures 2020-08-07 13:39:51 -04:00
Itamar Turner-Trauring
f53ea4579d Merge remote-tracking branch 'origin/master' into 3365.log-python-3 2020-08-06 17:03:27 -04:00
Itamar Turner-Trauring
d8f74770eb Port to Python 3. 2020-08-06 16:38:19 -04:00
Itamar Turner-Trauring
ff5cfe0c71 Update ratchet with new test. 2020-08-06 16:15:31 -04:00
Itamar Turner-Trauring
11c7841cd7
Merge pull request #760 from tahoe-lafs/3364.crypto-python-3
Fixes ticket:3364

Port allmydata.crypto to Python 3
2020-08-05 11:26:30 -04:00
Maciej Fijalkowski
aeb681a854 hopefully fix the ratchet files 2020-08-04 15:49:55 +02:00
Maciej Fijalkowski
5fcc8c65db add passing ratchet tests 2020-08-04 11:15:44 +02:00
Itamar Turner-Trauring
2a623e0b05 Port to Python 3. 2020-08-03 14:13:16 -04:00
Itamar Turner-Trauring
c0cabeaca0 Update ratchet. 2020-08-03 11:08:16 -04:00
Itamar Turner-Trauring
3a6587971a Ratchet. 2020-07-29 14:51:11 -04:00
Itamar Turner-Trauring
9e4eda6912
Merge pull request #756 from tahoe-lafs/3359.statistics-python-3
Port statistics and dictutil to Python 3

Fixes ticket:3359
2020-07-29 13:16:17 -04:00
Itamar Turner-Trauring
4fdcd06fbd Another passing test for the ratchet. 2020-07-28 10:48:17 -04:00
Itamar Turner-Trauring
058a76dc85 Ratchet, and news file. 2020-07-27 15:58:28 -04:00
Itamar Turner-Trauring
0071c1a48d More passing tests. 2020-07-27 13:08:25 -04:00
Itamar Turner-Trauring
e681ca1cb9
Merge pull request #754 from tahoe-lafs/3357.version_checks-py3
Port version_checks to Python 3

Fixes ticket:3357
2020-07-27 12:36:28 -04:00
Itamar Turner-Trauring
11cd30c425 Merge remote-tracking branch 'origin/master' into 3357.version_checks-py3 2020-07-24 14:50:39 -04:00
Itamar Turner-Trauring
e0d3e46683 Merge remote-tracking branch 'origin/master' into 3351.spans-python-3 2020-07-24 14:48:33 -04:00
Itamar Turner-Trauring
337a4381bb Finish port to Python 3. 2020-07-24 14:31:36 -04:00
Itamar Turner-Trauring
65500de72f Merge remote-tracking branch 'origin/master' into 3346.abbreviate-and-time_format-py3 2020-07-24 14:13:28 -04:00
Itamar Turner-Trauring
8bcd6dd34b
Merge branch 'master' into 3346.abbreviate-and-time_format-py3 2020-07-24 11:10:38 -04:00
Itamar Turner-Trauring
dd4737f20c
Merge branch 'master' into 3353.observer-and-pipeline-py3 2020-07-24 11:08:08 -04:00
Itamar Turner-Trauring
d23394b35c Merge remote-tracking branch 'origin/master' into 3346.abbreviate-and-time_format-py3 2020-07-23 12:27:06 -04:00
Itamar Turner-Trauring
64e4af2d05 Port to Python 3. 2020-07-22 13:17:49 -04:00
Itamar Turner-Trauring
691322764d Ratchet tests. 2020-07-22 10:37:30 -04:00
Itamar Turner-Trauring
2f608e8216 Merge remote-tracking branch 'origin/master' into 3346.abbreviate-and-time_format-py3 2020-07-22 10:11:27 -04:00
Itamar Turner-Trauring
bd53c8a05d Increase the Python 3 ratchet. 2020-07-22 09:59:26 -04:00
Itamar Turner-Trauring
5568693666 More passing tests. 2020-07-21 14:38:01 -04:00
Itamar Turner-Trauring
37fa687d4b More passing tests for the ratchet. 2020-07-16 14:42:49 -04:00
Itamar Turner-Trauring
58c4908d46 More tests are passing. 2020-07-16 14:36:49 -04:00
Chad Whitacre
3f887f9279 Respond to review
- Use the subunitv2-file reporter to allow for nicer error handling
- Undo the depgraph.sh change, see if it really matters
- Rename passing -> ratchet-passing to distinguish from ported modules
  tracker
- Misc. documentation and ratchet.sh improvements
2020-07-14 20:11:58 -04:00
Chad Whitacre
e2d6b353e8 Tighten up condition in depgraph.sh
I ran into a circumstance where it appears that there were changes other
than to the two files we care about, leading to an empty commit and a CI
failure:

https://app.circleci.com/pipelines/github/tahoe-lafs/tahoe-lafs/320/workflows/7d045f5f-1536-4cfa-b232-42837d4c9334/jobs/22127/steps
2020-07-14 06:42:45 -04:00
Chad Whitacre
d25c8b1a25 Start ratcheting up passing tests under Python 3 2020-07-13 22:42:48 -04:00
Itamar Turner-Trauring
28f219ad3e Update to version that supports _python3.py variant of port list. 2020-07-08 16:46:54 -04:00
Jean-Paul Calderone
1de51cd24d follow the renaming 2019-09-17 11:36:09 -04:00
Jean-Paul Calderone
98b3a644da add some tests 2019-09-17 11:35:37 -04:00
Jean-Paul Calderone
c09f61e966 Point at our own tahoe-depgraph.py 2019-09-17 10:21:46 -04:00
Jean-Paul Calderone
f421ce6fc7 import tahoe-depgraph.py from tahoe-depgraph project
it's easier to version it alongside tahoe itself
2019-09-17 10:20:26 -04:00
Jean-Paul Calderone
43610b8605 Always *build* it.
Just decline to push sometimes.

This way, if it's broken, you'll see that it's broken when working on your
branch.
2019-09-16 10:22:56 -04:00
Jean-Paul Calderone
880920e1de Correct the filename 2019-09-16 10:21:15 -04:00
Jean-Paul Calderone
7bfef2d6e0 Tell git about the changed files specifically. 2019-09-16 09:21:05 -04:00
Jean-Paul Calderone
32492ec28a Only run for master from now on 2019-09-13 13:10:02 -04:00
Jean-Paul Calderone
e51de52542 should be done already 2019-09-13 13:01:34 -04:00
Jean-Paul Calderone
00394de676 This should report the tahoe-depgraph revision. 2019-09-13 12:52:11 -04:00
Jean-Paul Calderone
227451732f Get the git config into the right repository 2019-09-13 12:51:06 -04:00
Jean-Paul Calderone
bfa2cb8816 Close paren needed 2019-09-13 12:50:05 -04:00
Jean-Paul Calderone
0daefad3a9 It's okay. Ask the filesystem. 2019-09-13 12:48:42 -04:00
Jean-Paul Calderone
5fd44f1914 Start from the right branch 2019-09-13 12:28:55 -04:00
Jean-Paul Calderone
fae2fa4bef This looks Python 3 compatible to me. 2019-09-13 12:25:03 -04:00
Jean-Paul Calderone
4dda91df0e Add a list of modules already ported to Python 3. 2019-09-13 11:38:30 -04:00
Jean-Paul Calderone
a3bb83221a Get a dependency 2019-09-13 11:27:00 -04:00
Jean-Paul Calderone
dd673a7862 Get the path to env right 2019-09-13 11:24:10 -04:00
Jean-Paul Calderone
ce0d595185 Make it executable. 2019-09-13 11:23:19 -04:00
Jean-Paul Calderone
42a01f0046 Add a CI job which runs depgraph.
It can also push the results to GitHub pages.
2019-09-13 11:05:05 -04:00
Jean-Paul Calderone
9788857df6 Turn the comment into a docstring 2019-08-07 15:57:06 -04:00
Jean-Paul Calderone
856b3782ea add a --package option to run-deprecations so we can restrict to our own errors 2019-08-02 18:28:36 -06:00
heartsucker
33090ef6e2 remove last remaining references to pycryptopp 2019-06-13 22:19:28 -06:00
heartsucker
44b268fee6 removed pycryptopp dependency 2019-06-13 22:19:28 -06:00
tpltnt
c8f11dc2d3 ported old-style classes to new-style 2019-05-26 08:28:18 +02:00
heartsucker
ae5e282e2f
update raise syntax for python3 compatibility 2019-04-05 11:39:10 +02:00
heartsucker
0750dbac38
updated all python files to use pep-3110 exception syntax for python3 compatibility 2019-04-04 11:57:58 +02:00
meejah
6970c2cc6d
Merge pull request #579 from tahoe-lafs/3001-python3-syntax-check
python3 syntax check
2019-03-28 19:14:59 +00:00
heartsucker
5adde83acf
python3 compatibility for show-tool-versions.py for CI 2019-03-28 12:32:13 +01:00
heartsucker
dbfcf8ae00
replaced StringIO imports with six.moves 2019-03-28 12:31:37 +01:00
heartsucker
55f8408718
use print function over print statement in ./misc/ directory 2019-03-22 11:41:16 +01:00
Jean-Paul Calderone
922554cd28 Probably some test cruft screws up the package 2019-01-26 10:02:08 -05:00
Jean-Paul Calderone
4f119c876c what's coming out of this 2019-01-26 10:02:08 -05:00
Jean-Paul Calderone
d790d3d325 report more about the failed process 2019-01-26 10:02:08 -05:00
Jean-Paul Calderone
41fe2189dd whitespace cleanup 2019-01-26 10:02:08 -05:00
Jean-Paul Calderone
0f5d0e3131 Comment out "testing" code... 2018-04-26 15:07:09 -04:00
Jean-Paul Calderone
206ab732e6 Replace use of deprecated sha module 2018-04-26 15:00:36 -04:00
Jean-Paul Calderone
f99b3bdbda Remove complicated and dead code 2018-04-26 14:58:40 -04:00
Jean-Paul Calderone
cc6006dcb3 Replace use of deprecated sha module 2018-04-26 14:57:45 -04:00
Brian Warner
f155ade4ad misc/simulators/ringsim.py: fix LGTM nit
We haven't used this tool for a decade, but LGTM flagged a static-analysis
warning. Fixing it to see if the LGTM dashboard is looking at new builds.
2018-03-27 23:51:02 -07:00
Brian Warner
5e62118e14 hush somewhat-real problems found by static analysis
These would have caused problems if a certain unlikely code path was taken:
mostly error-handling pathways.
2017-12-31 00:23:43 +01:00
Brian Warner
da4e7dcfbe hush a bunch of not-really-problems caught by the lgtm.com static analyzer
This is all minor stuff: unreachable debug code (that should be commented-out
instead of in an 'if False:' block), unnecessary 'pass' and 'global'
statements, redundantly-initialized variables. No behavior changes. Nothing
here was actually broken, it just looked suspicious to the static analysis at
https://lgtm.com/projects/g/tahoe-lafs/tahoe-lafs/alerts/?mode=list .
2017-12-31 00:19:41 +01:00
Jean-Paul Calderone
695f40fb52 Get rid of unused names 2017-08-08 08:30:32 -04:00
Jean-Paul Calderone
95df32f9ed remove unused import 2017-08-08 08:29:57 -04:00
meejah
031a88c25f simplejson -> json 2017-02-23 15:21:36 -07:00
Brian Warner
36c57c74f4 make tox env for code-checks
This executes: check-debugging, check-interfaces, check-miscaptures,
find-trailing-spaces, check-umids, pyflakes.

Other changes:

* fix check-umids.py to take starting points. run it as `check-umids.py
  src` instead of `check-umids.py src/allmydata/*.py`
* check-debugging: rewrite in python to run from tox: tox doesn't like
  to run shell scripts.
* put check-interfaces.py last: it produces lots of warnings, but passes
  anyways. The others only produce significant output if they fail.
2016-08-19 17:42:05 -07:00
meejah
d641aef2a3 Simple test for defer.setDebugging(True) calls 2016-08-19 11:37:15 -06:00
Brian Warner
ea473cdc76 remove pickle-based stats output altogether
* update munin plugin to read JSON, not pickle
* update docs
2016-04-27 17:27:33 -07:00
Brian Warner
b81c6a7208 run-deprecations: supress duplicates
I thought 'warnings' or twisted.python.deprecate was supposed to do this
already, but it's clearly not working.
2016-04-06 13:37:52 -10:00
Brian Warner
9d20de3db9 improve run-deprecations script
Rewrote in Twisted, which lets us read/scan/print all log lines in
realtime. The output is now correctly interleaved (as well as
maintaining the stdout-vs-stderr of each message). The renamed
--warnings= logfile records all relevant lines from *both* stdout and
stderr (i.e. any that includes "DeprecationWarning"), which handles a
change (perhaps in recent Twisteds?) that emits these warnings on stdout
instead of stderr.
2016-04-06 11:07:06 -10:00
Brian Warner
c781fc188b run-deprecations: flush stdout before starting trial
This should get the notes printed in the right order.
2016-04-06 09:23:48 -10:00
Brian Warner
14c513db8a tox -e deprecations: add helper script to make it work
Tox doesn't run shell pipelines, and is unhappy about running tools that
it didn't install itself (including non-python things like "make"). So
this adds misc/build_helpers/run-deprecations.py, a python script that
runs a given command (i.e. trial) and writes stdout into a separate file
where the buildbot can see it, and counts the "DeprecationWarning" lines
from the file to decide the returncode.

This ought to improve the status display on the buildbot "test
deprecations" step.
2016-04-06 08:29:48 -10:00
Brian Warner
c545d5c0a1 add misc/coding_tools/graph-deps.py, to visualize dependencies
This builds and parses wheels for a given target, then renders a
DOT-format graph into a PNG file.
2016-03-25 14:50:16 -07:00
Brian Warner
23826b0224 fix OS-X package version
I changed the quotes in _version.py, and this script was sensitive to
them.
2016-03-23 02:32:48 -07:00
Brian Warner
831b39d8fb remove src/buildtest/ and related build_helper/ test files
This was used to exercise our old virtualenv-like scheme. Now that we
use virtualenv, they're unnecessary. Plus, removing it lets us stop
polluting end-user installs with the extra package (that might
conceivably conflict with some other project that names itself
"buildtest").
2016-03-22 22:56:03 -07:00
Brian Warner
1f712c8ddb Makefile: remove/deprecate old targets
This replaces the following targets with "echo this is obsolete":

* fetch-and-unpack-deps (used by the old 'tarballs' builder, for SUMO tarballs)
* test-desert-island (used by the old 'clean' builder)
* test-pip-install (used by 'new-pip' builder before we switched)

It also removes the test-pip-install.py helper script.
2016-03-22 14:12:45 -07:00
Brian Warner
16f07b34ce remove old misc/dependencies/ contents and references 2016-03-22 13:38:31 -07:00
Brian Warner
b5b2036d37 OS-X: fix package generation
The old scheme depended upon the bespoke pseudo-virtualenv scheme that
we cooked up long ago (it copied the entire source tree, bin/tahoe and
support/ and all, into the mac .pkg archive). When we moved to real
virtualenvs, that broke.

This new scheme only installs a populated virtualenv into the archive.
It replaces the entry-point bin/tahoe with a script that behaves a lot
like the old bespoke script: it inserts a relative site-packages/ into
sys.path before importing allmydata.scripts.runner and calling run().

This still depends upon the end-users $PATH having a python that is
compatible with the binary modules we've compiled here, and there are
three potentially-differing Pythons to worry about (homebrew, python.org
installers, and Apple's native /usr/bin/python). We'll have to see if
they tend to differ in ways that cause problems (I think the maintainers
generally try to avoid that). If that's an issue, the next level up is
to use bbfreeze or py2app or something in that category, to ship an
entire python, and not just a bundle of libraries.
2016-03-16 12:31:21 -07:00