Commit Graph

559 Commits

Author SHA1 Message Date
Jean-Paul Calderone
07e33e78a5 Configure CI to use the py36-coverage tox env 2020-08-26 14:37:21 -04:00
Jean-Paul Calderone
60759597f3 Ask for a particular version of Python
In particular, a version Tahoe-LAFS supports.
2020-08-20 13:21:48 -04:00
Jean-Paul Calderone
6eba1469f3
Back out subunit2junitxml exit status change from ticket:3336
I don't know why I included this change.  It was certainly based on a faulty
assumption (that the tox command would exit with error if a test failed - it
won't).  Apart from that, the motivation was the Python 3.6 ratchet job.  The
test run was expected to fail but then the *ratchet* tool was in charge of
deciding if this indicated real failure or not.  Failing at this point
prevented that logic from running.  Now the ratchet is gone and we want CI to
turn red if anything fails.
2020-08-14 13:10:54 -04:00
Jean-Paul Calderone
0a7589f0c2
Update the CircleCI configuration to get the reporter working for py36 2020-08-14 11:24:42 -04:00
Jean-Paul Calderone
9695e87fbd
Revert to master version of these configs 2020-08-14 11:16:45 -04:00
Chad Whitacre
647ed5d6e1 Use BASH_ENV to avoid duplication of job steps 2020-08-14 08:33:00 -04:00
Chad Whitacre
ae87037e73 Filter tests we care about in CI for Python 3 2020-08-13 06:23:46 -04:00
Chad Whitacre
306df53012 Expose TAHOE_LAFS_TRIAL_ARGS to config
This allows for working around a bug in trial under Python 3 where
--reporter and --rterror collide.
2020-08-13 05:55:51 -04:00
Jean-Paul Calderone
513177c4b8
strace not used by anything now 2020-08-11 18:33:01 -04:00
Jean-Paul Calderone
b69287be4b
Merge remote-tracking branch 'origin/master' into 3336.py36-off-travis 2020-08-11 14:51:08 -04:00
Jean-Paul Calderone
a74ef86098
Remove the CI configuration 2020-08-11 13:25:16 -04:00
Jean-Paul Calderone
462e212a19
Revert "[drop] faster ci"
This reverts commit 65520786ca.
2020-08-10 09:16:19 -04:00
Jean-Paul Calderone
0c2cf9f0c5
Don't fail if subunit2junitxml fails 2020-08-10 09:11:14 -04:00
Jean-Paul Calderone
a927ebbafa
what's up 2020-08-08 00:04:13 -04:00
Jean-Paul Calderone
7ba6daeed5
maybe get some more visibility into errors 2020-08-07 23:58:24 -04:00
Jean-Paul Calderone
23d7ffa369
Check for subunit2 output here 2020-08-07 23:56:13 -04:00
Jean-Paul Calderone
65520786ca
[drop] faster ci 2020-08-07 23:26:15 -04:00
Jean-Paul Calderone
a60d4f7df4
get strace 2020-08-07 22:21:52 -04:00
Jean-Paul Calderone
c2b1fda4e7
Add Ubuntu 20.04 2020-08-07 15:40:10 -04:00
Jean-Paul Calderone
80136da0a6
This Fedora probably also has no Python version tag 2020-08-07 11:14:58 -04:00
Jean-Paul Calderone
1b0f83599d
See if we can get the image names right 2020-08-03 17:08:45 -04:00
Jean-Paul Calderone
ab9ccae1d1
try doing the pip wheel with the right LANG 2020-08-03 17:02:15 -04:00
Jean-Paul Calderone
8348e7032b
this is basically already set (LANG in UTF_8_ENVIRONMENT) 2020-08-03 17:02:15 -04:00
Jean-Paul Calderone
b99ec195cd
See if this helps the py36 zfec installation 2020-08-03 17:02:14 -04:00
Jean-Paul Calderone
3744b4d24c
FROM creates a new build stage which discards all prior ARGs 2020-08-03 17:02:14 -04:00
Jean-Paul Calderone
ee32b3555a
Burn the Python version into the Docker image tag 2020-08-03 17:02:14 -04:00
Jean-Paul Calderone
704f751b06
untabify 2020-08-03 17:02:14 -04:00
Jean-Paul Calderone
95050fefd6
do have line continuation 2020-08-03 17:02:14 -04:00
Jean-Paul Calderone
a2f78ca703
don't have a default 2020-08-03 17:02:14 -04:00
Jean-Paul Calderone
b0a5a65f4f
Attempt to enable a Python 3 CircleCI job 2020-07-17 16:23:42 -04:00
Jean-Paul Calderone
bd2f438843
Replace the TravisCI Python 3.6 config with CircleCI Python 3.6 config 2020-07-17 13:48:08 -04:00
meejah
825bc91256 mark PyPy as required in circle-ci 2020-05-06 17:17:23 -06:00
Sajith Sasidharan
4fc6840c10 Build Docker images for pypy 2.7-buster on CircleCI 2020-04-14 17:35:44 -04:00
Sajith Sasidharan
f89ad002f8 Use 2.7-buster Docker image for pypy
Fix failing PyPy CI job.

Fixes: ticket:3299
2020-04-14 16:14:07 -04:00
Jean-Paul Calderone
5ccc241990
no more libyaml-devel, maybe it was merged into libyaml 2020-04-13 11:04:11 -04:00
Jean-Paul Calderone
74f46b6686
this one renamed too 2020-04-13 11:04:11 -04:00
Jean-Paul Calderone
02ca2ad219
This package has been renamed 2020-04-13 11:04:10 -04:00
Jean-Paul Calderone
37af15c245
Bump CentOS from 7 to 8 on CI 2020-04-13 10:09:25 -04:00
Jean-Paul Calderone
03a4988346
Fix wording of comment 2020-01-13 20:12:43 -05:00
Jean-Paul Calderone
4078527ec9 It worked 2020-01-13 14:29:45 -05:00
Jean-Paul Calderone
3dc9eb7bef Ask for 44 by name 2020-01-13 14:16:24 -05:00
Jean-Paul Calderone
f86569b8e5 temporary circleci configuration hack to see if this helps
not sure how else to make these jobs run
2020-01-13 14:10:26 -05:00
Jean-Paul Calderone
d7a90b24c2 Try upgrading pip first 2020-01-13 10:56:55 -05:00
Jean-Paul Calderone
b6bc1302b0 Tweak the CircleCI build configuration for better performance 2019-12-18 09:31:04 -05:00
Jean-Paul Calderone
6d4044c7c1 Test the Nix packaging on CircleCI 2019-12-13 10:39:15 -05:00
Chris Wood
105ddc005e Add comment re. testing PyInstaller executables 2019-10-07 11:31:29 -04:00
Chris Wood
eef66e3ea3 Try testing PyInstaller builds on CircleCI 2019-10-04 11:39:14 -04:00
Jean-Paul Calderone
9c5dce3cc8 Largely done now so re-enable the rest of CI 2019-09-13 13:09:36 -04:00
Jean-Paul Calderone
151b7768c6 make the environment available to anything in the script 2019-09-13 13:02:55 -04:00
Jean-Paul Calderone
b462d294a5 Try it in a working environment ... ? 2019-09-13 13:00:35 -04:00
Jean-Paul Calderone
1fcf5051bd Guessed wrong - tahoe-depgraph is Python 2. 2019-09-13 11:25:30 -04:00
Jean-Paul Calderone
47e28d2e5d Grant the job push access to the repository with a GitHub deploy key. 2019-09-13 11:21:20 -04:00
Jean-Paul Calderone
42a01f0046 Add a CI job which runs depgraph.
It can also push the results to GitHub pages.
2019-09-13 11:05:05 -04:00
Jean-Paul Calderone
183385a94b Disable most of CI to speed up development on this branch 2019-09-13 11:04:28 -04:00
Jean-Paul Calderone
6508038a74 tor and i2p were already implied by test 2019-08-14 09:04:39 -04:00
Jean-Paul Calderone
fbe12ba748 Take a shot at really timing out the PyPy job. 2019-08-13 15:57:29 -04:00
Jean-Paul Calderone
10b9575350 It worked. Put it all back. 2019-06-26 13:32:35 -04:00
Jean-Paul Calderone
e40f46c4cf do a quick test with a new image 2019-06-26 13:00:14 -04:00
Jean-Paul Calderone
951f06f562 pyutil 3.3.0 released! 2019-06-26 13:00:09 -04:00
Jean-Paul Calderone
64e4cf5045 Only install custom pyutil for PyPy CI
And add a comment explaining it
2019-06-26 09:10:41 -04:00
Jean-Paul Calderone
c80a28c543 this was vaguely helpful sort of not really
it's definitely extremely noisy though
2019-06-26 08:50:13 -04:00
Jean-Paul Calderone
ba1bff529e re-enable everything 2019-06-26 08:50:04 -04:00
Jean-Paul Calderone
5a5b75b447 back to this 2019-06-26 07:59:53 -04:00
Jean-Paul Calderone
35b21916be use a different branch without versioneer
see if that gets us a decent version number
2019-06-25 19:53:51 -04:00
Jean-Paul Calderone
4b03b6e4d7 reenable the other things 2019-06-25 19:29:56 -04:00
Jean-Paul Calderone
0e76f31d23 apparently this is the spelling 2019-06-25 19:29:56 -04:00
Jean-Paul Calderone
56905270ab try the branch of pyutil 2019-06-25 19:20:59 -04:00
Jean-Paul Calderone
9ddadce376 Tell the rest of the platforms to keep using whatever "python2.7" is. 2019-06-25 19:07:00 -04:00
Jean-Paul Calderone
7b14b11063 just pypy 2019-06-25 18:53:34 -04:00
Jean-Paul Calderone
a3637c193d try telling the virtualenv to use pypy 2019-06-25 18:51:11 -04:00
Jean-Paul Calderone
6d7a9d8400 "debugging" 2019-06-25 18:39:42 -04:00
Jean-Paul Calderone
c94578d3ad "debugging" 2019-06-25 18:31:15 -04:00
Jean-Paul Calderone
a6b4bf55ba try to make subunit2 processing allowed-to-fail too 2019-06-25 15:20:55 -04:00
Jean-Paul Calderone
67d76a0cc5 it's shell, dude 2019-06-25 15:11:20 -04:00
Jean-Paul Calderone
7ace8ae40d can't require a job that isn't 2019-06-25 15:06:34 -04:00
Jean-Paul Calderone
d5c21adb43 correct shell syntax 2019-06-25 15:02:34 -04:00
Jean-Paul Calderone
a351256050 test even faster 2019-06-25 15:02:30 -04:00
Jean-Paul Calderone
32a9f9be0f Attempt to build an allowed failure mechanism
And use it to let the PyPy job fail.
2019-06-25 14:50:42 -04:00
Jean-Paul Calderone
1b29bc4105 speed up testing 2019-06-25 14:21:08 -04:00
Jean-Paul Calderone
da4a3fecb8 Attempt to make CircleCI run PyPy job with the right tox environment 2019-06-25 14:16:26 -04:00
Jean-Paul Calderone
0a761356d4 Put the job in the workflow 2019-06-25 13:34:33 -04:00
Jean-Paul Calderone
ec306663c9 Get a PyPy image 2019-06-25 13:20:04 -04:00
Jean-Paul Calderone
6f855cb328 Add a PyPy test job 2019-06-25 13:12:57 -04:00
Jean-Paul Calderone
3e0681e846 Build a Docker image we can use for PyPy CI 2019-06-25 13:12:42 -04:00
Jean-Paul Calderone
bdc169985f Stop setting PIP_NO_INDEX. 2019-04-07 17:01:17 -04:00
Jean-Paul Calderone
d5a9bc8c47 Restore the nobody user configuration 2019-04-07 11:53:03 -04:00
Jean-Paul Calderone
53ecb8bcc5 correct stupid editing mistake 2019-04-07 11:37:11 -04:00
Jean-Paul Calderone
fbea42c8db Revert the multi-stage changes.
It doesn't save much space.
It greatly complicates the Dockerfile.
It breaks the `upcoming-deprecations` job unless even more pains are taken.
2019-04-07 11:10:15 -04:00
Jean-Paul Calderone
de9d7082ea sigh 2019-04-06 15:18:38 -04:00
Jean-Paul Calderone
6360b4400a Fix tab indents 2019-04-06 11:13:59 -04:00
Jean-Paul Calderone
6be630c84e Let us have version infp 2019-04-06 11:12:27 -04:00
Jean-Paul Calderone
2f8e22f81e Fix the permissions ... twice. Thanks, COPY. 2019-04-06 10:00:19 -04:00
Jean-Paul Calderone
a36e70e133 Maybe this will clean up a little more 2019-04-06 10:00:02 -04:00
Jean-Paul Calderone
4a33d5b10e Get other dependencies we need, too. 2019-04-06 09:59:52 -04:00
Jean-Paul Calderone
8ea7b2c81c Try a multi-stage build to make a smaller image. 2019-04-06 09:41:57 -04:00
Jean-Paul Calderone
84da275427 Get a couple more basic deps in the wheelhouse 2019-04-06 09:41:47 -04:00
Jean-Paul Calderone
151e10fef0 Avoid the index 2019-04-06 09:41:31 -04:00
Jean-Paul Calderone
292668bf49 Make sure the wheelhouse is usable by nobody 2019-04-06 09:14:59 -04:00
Jean-Paul Calderone
4e56c249d2 tweak the comment x5 2019-04-05 08:15:24 -04:00
Jean-Paul Calderone
a7fb7c21e3 Probably isn't 2019-04-05 08:06:41 -04:00
Jean-Paul Calderone
70e7ce6c3c filters are, apparently, required 2019-04-04 17:05:41 -04:00
Jean-Paul Calderone
ae4c8c6be1 This is no longer used. 2019-04-04 17:03:28 -04:00
Jean-Paul Calderone
bb491df969 Slackware is not a first-class image or whatever 2019-04-04 16:55:22 -04:00
Jean-Paul Calderone
83d91587c8 Build the images on a schedule 2019-04-04 16:54:22 -04:00
Jean-Paul Calderone
5a833ad152 Turns out that was redundant 2019-04-04 16:51:51 -04:00
Jean-Paul Calderone
c840938d27 Convert Slackware to the new pattern 2019-04-04 16:50:59 -04:00
Jean-Paul Calderone
b43d121b46 Fix naming snafu 2019-04-04 15:59:58 -04:00
Jean-Paul Calderone
9fc6d807d8 Let us figure out which release we're on 2019-04-04 15:59:07 -04:00
Jean-Paul Calderone
0cf600a27d Still a good idea to push the images 2019-04-04 15:41:22 -04:00
Jean-Paul Calderone
3fdc0e1ca2 Bind the variables in both branches 2019-04-04 15:36:08 -04:00
Jean-Paul Calderone
0d31003a63 Split the image build job into many 2019-04-04 15:34:34 -04:00
Jean-Paul Calderone
3f323c2c66 Drop the separate Tor-enabled Debian image.
Just install Tor on the other Debian image and re-use that.
2019-04-04 15:33:16 -04:00
Jean-Paul Calderone
e0eca8fc6c Parameterize the Fedora version 2019-04-04 14:29:05 -04:00
Jean-Paul Calderone
cc33115218 Parameterize the Debian version 2019-04-04 14:28:04 -04:00
Jean-Paul Calderone
7cfbc115a4 Parameterize the Ubuntu version 2019-04-04 14:26:47 -04:00
Jean-Paul Calderone
60f47759e2 Parameterize the CentOS version 2019-04-04 14:25:08 -04:00
Jean-Paul Calderone
a8f6ff6d36 Support a platform where the nobody group has a different name 2019-04-04 14:19:31 -04:00
Jean-Paul Calderone
16b13f6f0e Have a go at converting the Fedora jobs 2019-04-04 14:02:00 -04:00
Jean-Paul Calderone
0df1432592 Blargh should have checked this in with the other Tor changes 2019-04-04 14:00:27 -04:00
Jean-Paul Calderone
302292366a Have a go at converting CentOS 2019-04-04 14:00:19 -04:00
Jean-Paul Calderone
273e4ca226 A few comments scraped from config.yml's CentOS job 2019-04-04 13:59:28 -04:00
Jean-Paul Calderone
cb2c50fbf7 Install Tor in the Docker image and use it for integration job 2019-04-04 13:48:24 -04:00
Jean-Paul Calderone
ecaeedad84 This is baked into the Debian image we inherit 2019-04-04 13:34:41 -04:00
Jean-Paul Calderone
11dd42a3fa Remove one more sudo
Unnecessary and broken since we run this step as nobody now
2019-04-04 13:23:26 -04:00
Jean-Paul Calderone
679893d541 Also propagate the user config to the other jobs
It was not propagated because they each have their own distinct "docker"
section.
2019-04-04 13:16:28 -04:00
Jean-Paul Calderone
08693e79f8 Apply the various changes to the 3 other Debian-alikes 2019-04-04 13:12:29 -04:00
Jean-Paul Calderone
4d15504e4a Try avoiding some of the sudo'ing 2019-04-04 12:54:24 -04:00
Jean-Paul Calderone
2896370880 Factor some complexity out of the Dockerfile for easier reuse 2019-04-04 12:50:05 -04:00
Jean-Paul Calderone
99f0dad02b See if we can start with some source
And just let CircleCI update it
2019-04-04 12:38:48 -04:00
Jean-Paul Calderone
53b9e92901 Just inherit it 2019-04-04 12:38:27 -04:00
Jean-Paul Calderone
ebe5fba518 Follow the move 2019-04-04 12:24:16 -04:00
Jean-Paul Calderone
d19a9732e3 Try to get tox to use the wheelhouse too 2019-04-04 12:15:35 -04:00
Jean-Paul Calderone
b6233e0bef I assume checkout is re-screwing the permissions 2019-04-04 12:09:35 -04:00
Jean-Paul Calderone
904a175be4 Parameterize venv and source paths more 2019-04-04 12:07:32 -04:00
Jean-Paul Calderone
f5765acdb8 Just inherit the working directory 2019-04-04 12:07:08 -04:00
Jean-Paul Calderone
8bba0bfeaf "Directory (/tmp) you are trying to checkout to is not empty and not git repository" 2019-04-04 11:45:16 -04:00
Jean-Paul Calderone
ab5410f001 Try to get the project source into a better, predictable location 2019-04-04 11:44:27 -04:00
Jean-Paul Calderone
30a34d0b5d Move virtualenv and wheelhouse creation into the image 2019-04-04 11:26:10 -04:00
Jean-Paul Calderone
df1a51cb60 Have the project source available to the Docker build context 2019-04-04 10:49:39 -04:00
Jean-Paul Calderone
f39f6bf2f6 not sure why it doesn't work the other way 2019-04-04 10:45:17 -04:00
Jean-Paul Calderone
f794160dcf Split setup-virtualenv.sh into a few pieces
Some of the pieces may be usable in Docker image creation
2019-04-04 10:27:51 -04:00
Jean-Paul Calderone
c1e617abc9 Get rid of the CircleCI caches 2019-04-04 10:07:06 -04:00
Jean-Paul Calderone
19c7a2af85 and the other one 2019-04-03 15:58:41 -04:00
Jean-Paul Calderone
b484b8b1e0 Add the Dockerfile... 2019-04-03 15:58:14 -04:00
Jean-Paul Calderone
ca750dfd0e Build Ubuntu images and switch builders 2019-04-03 15:52:08 -04:00
Jean-Paul Calderone
fa09e7fa3d Stop pretending the username is a variable 2019-04-03 15:46:58 -04:00
Jean-Paul Calderone
57e261fbf8 we have no BASH_ENV I suppose 2019-04-03 15:37:21 -04:00
Jean-Paul Calderone
e911b0d958 Perhaps from this file... 2019-04-03 15:29:34 -04:00
Jean-Paul Calderone
02d91b5ea6 Factor openssl decryption and docker login into separate steps 2019-04-03 15:24:58 -04:00
Jean-Paul Calderone
b658b30b19 no longer supplied 2019-04-03 15:05:23 -04:00
Jean-Paul Calderone
e3d572b6b4 Get Debian 8 switched over as well 2019-04-03 14:41:50 -04:00
Jean-Paul Calderone
bf2c43a500 fix the Dockerfile syntax 2019-04-03 14:41:36 -04:00
Jean-Paul Calderone
3a01938159 Do some more package installation in the ci image 2019-04-03 14:34:13 -04:00
Jean-Paul Calderone
03d19dc93f Use the image we can build 2019-04-03 14:27:45 -04:00
Jean-Paul Calderone
67586c68db Get the image tagged with the right name for the push 2019-04-03 14:19:10 -04:00
Jean-Paul Calderone
3a20912ecf Re-generate with a new key because I leaked the old one 2019-04-03 14:18:19 -04:00
Jean-Paul Calderone
ff49e4e38f note a manual prereq 2019-04-03 14:18:13 -04:00
Jean-Paul Calderone
c55e2d141e be explicit about digest algorithm
it changes from version to version
2019-04-03 14:11:10 -04:00
Jean-Paul Calderone
c8d355326a okay I give, what the hell? 2019-04-03 14:05:12 -04:00
Jean-Paul Calderone
e7b7a6a836 Try using -pass instead of -k 2019-04-03 14:00:26 -04:00
Jean-Paul Calderone
8915f86233 Try re-encrypting with a new key
Previous build failed with:

bad decrypt
140431532411788:error:06065064:digital envelope routines:EVP_DecryptFinal_ex:bad decrypt:evp_enc.c:531:
Exited with code 1
2019-04-03 13:47:10 -04:00
Jean-Paul Calderone
1d8cf210e9 haha that's not debian. 2019-04-03 13:44:00 -04:00
Jean-Paul Calderone
59231d19ed Gotta have the decryption tool 2019-04-03 13:41:33 -04:00
Jean-Paul Calderone
e4607d2b21 Actually checking it in might help 2019-04-03 13:37:59 -04:00
Jean-Paul Calderone
81fbc1dfb5 maybe this will get the path right?
probably not
2019-04-03 13:37:38 -04:00
Jean-Paul Calderone
3cf9e05efd nope, that was wrong, but this seems to be right. 2019-04-03 13:28:42 -04:00
Jean-Paul Calderone
88f43ad413 perhaps use Docker correctly 2019-04-03 13:26:48 -04:00
Jean-Paul Calderone
f53e166803 Nope. Set via secret-env-cipher. 2019-04-03 13:22:16 -04:00
Jean-Paul Calderone
7f354abd63 Add the secret environment needed to push images to Dockerhub 2019-04-03 13:15:47 -04:00
Jean-Paul Calderone
bbb09178b3 Add a job for building pre-initialized Docker images for CI 2019-04-03 13:15:08 -04:00
Jean-Paul Calderone
4def49ed54 ask subunitreporter for progress reporting 2019-03-25 13:20:04 -04:00
Jean-Paul Calderone
7768d06b51 Set up a Latin 1 locale job 2019-03-20 15:56:01 -04:00
Jean-Paul Calderone
7783433369 Back off on the specificity for git installation
Version number got bumped, nothing was being installed.
2019-01-25 17:03:04 -05:00
Jean-Paul Calderone
1fb2809276 Additionally, disable the CircleCI artifact handling steps 2019-01-24 16:04:58 -05:00
Jean-Paul Calderone
6ee727d67e Avoid the artifact steps for integration tests
Integration tests produce none and trying to do these things breaks.
2019-01-24 16:04:26 -05:00
Jean-Paul Calderone
ec99e7138d Block integration tests on debian-9 results 2019-01-24 10:20:47 -05:00
Jean-Paul Calderone
25719ca1cb Invoke install-tor.sh with the correct path. 2019-01-24 10:04:07 -05:00
Jean-Paul Calderone
f534d3c34f Attempt to configure CircleCI for integration tests 2019-01-24 09:02:27 -05:00
Jean-Paul Calderone
9c359681f2 Flip Debian 8 and 9 definitions
More things want Debian 9.  This reduces duplication.
2019-01-23 18:15:25 -05:00
Jean-Paul Calderone
bd8e4b21b6 Of course, assume yes.
I don't even care what the question is.  Whatever the question is, please just
assume yes.
2019-01-23 11:32:03 -05:00
Jean-Paul Calderone
c053cec465 Switch back to yum
Turns out yum can install by path, too.  And dnf is not readily available on
CentOS (which shares this configuration).
2019-01-23 11:22:53 -05:00
Jean-Paul Calderone
0640cfbb8b Bump Fedora to 28/29 and fix virtualenv install
Fedora python-virtualenv package no longer provides the /usr/bin/virtualenv
executable!  Switch to using dnf to install it so we don't have to guess the
right package name.
2019-01-23 11:14:58 -05:00
Jean-Paul Calderone
841326ed4b Try less aggressive version pinning
Old versions are removed from the package repository, as far as I can
tell.  This happened to curl and broke the build.
2018-07-24 13:14:31 -04:00
Jean-Paul Calderone
93881f34a7 consistent indentation 2018-07-10 15:43:30 -04:00
Jean-Paul Calderone
a1196fccdb Prevent retrieval of source packages for test step 2018-07-10 15:23:16 -04:00
Jean-Paul Calderone
b57fe7635f sudo blocks PIP_FIND_LINKS, explicitly propagate
:(
2018-07-10 15:22:37 -04:00
Jean-Paul Calderone
4fcbfd7158 Get wheels for these external dependencies as well
Particularly because they have their own dependencies and we install
this set of things before we install Tahoe-LAFS.
2018-07-10 15:18:09 -04:00
Jean-Paul Calderone
150ce7d91f Look at the wheelhouse!
Otherwise all non-wheels are rebuilt every time anyway!
2018-07-10 15:05:51 -04:00
Jean-Paul Calderone
a3f9361c86 already running as root 2018-07-10 14:10:46 -04:00
Jean-Paul Calderone
63f1f3139f pretty labels 2018-07-10 14:03:57 -04:00
Jean-Paul Calderone
b9008f13a2 Handle the case where there's not yet a cache 2018-07-10 13:32:10 -04:00
Jean-Paul Calderone
f3df99f470 desired information has been extracted 2018-07-10 13:28:55 -04:00
Jean-Paul Calderone
e8af01db1a Bust the cache again. 2018-07-10 13:24:55 -04:00
Jean-Paul Calderone
e3aa349a71 The group is named differently on different OS.
Maybe this is good enough?
2018-07-10 13:24:17 -04:00
Jean-Paul Calderone
6e5d11dbd0 Attempt to fix the pip cache 2018-07-10 12:59:33 -04:00
Jean-Paul Calderone
606cea7db5 see what the deal is with the pip cache 2018-07-10 12:47:48 -04:00
Jean-Paul Calderone
3c9b85809d explicitly bring in the wheel package too
to support `bdist_wheel`
2018-07-10 12:08:40 -04:00
Jean-Paul Calderone
524a6ef217 Use the moved project paths now
because the bootstrap step is what does the moving
2018-07-10 11:59:04 -04:00
Jean-Paul Calderone
21edff4a09 get some more debug info 2018-07-10 11:46:02 -04:00
Jean-Paul Calderone
0d209c0af4 Manage the cache around *only* virtualenv setup
We don't need anything from the cache in the bootstrap step and
Slackware cannot interact with the cache until after the bootstrap step
anyway.
2018-07-10 11:42:53 -04:00
Jean-Paul Calderone
b99120048f Get a new version of setuptools as well
This whole stack is so fragile, running any non-latest packaging package
is fraught.  In particular, without this change, Debian 8 job is
failing.
2018-07-10 11:16:24 -04:00
Jean-Paul Calderone
f7e0ecbe3f exclude the internal pip wheel cache
this was meant to be a download cache only
2018-07-10 10:38:03 -04:00
Jean-Paul Calderone
b981b2eb47 "Invalidate" current caches
Necessary because mistakes in caching configuration in previous pushed
revisions populated some caches with invalid state which now persists
and causes some jobs to fail.  This wipes the slate clean.
2018-07-10 09:46:17 -04:00
Jean-Paul Calderone
b731ffffa4 Avoid the most general wheelhouse cache key
It usually contains stuff we often can't use.
2018-07-10 09:24:09 -04:00
Jean-Paul Calderone
38c8afc6f7 Use the job name instead of the arch
arch is only the hardware architecture.  this is not sufficient to
differentiate between platforms with ABI incompatibilities.  job name
should be good enough (maybe more fine-grained than we really want but
easy to express and maintain).
2018-07-10 08:56:28 -04:00
Jean-Paul Calderone
f15257d9dc Actually, it's not clear why branch would matter
If setup.py and _auto_deps.py are the same, the python dependencies will
be the same, surely.
2018-07-10 08:55:45 -04:00
Jean-Paul Calderone
a667066348 fix typos :( 2018-07-09 15:58:56 -04:00
Jean-Paul Calderone
c07b8e32a4 back to the full test suite 2018-07-09 15:55:32 -04:00
Jean-Paul Calderone
9c1dc47f37 upgrade pip 2018-07-09 15:54:57 -04:00
Jean-Paul Calderone
24dfce49eb Add caching for RedHat and Slackware 2018-07-09 15:51:10 -04:00
Jean-Paul Calderone
a5c0995b96 absolute path to the relocated source
but only for the save cache step because it hasn't been relocated by the
time of restore cache
2018-07-09 15:44:24 -04:00
Jean-Paul Calderone
99edbfaa5e Cannot build the wheelhouse before getting certifi 2018-07-09 15:27:20 -04:00
Jean-Paul Calderone
ab7652bcf2 it is just arch 2018-07-09 15:05:01 -04:00
Jean-Paul Calderone
12a36abf63 Attempt to have a cached wheelhouse for pip 2018-07-09 13:36:40 -04:00
Jean-Paul Calderone
a6fd0453fe fix bogus key in some "run" steps 2018-07-09 13:36:40 -04:00
Jean-Paul Calderone
412899174b partially valid optimization mistakenly snuck in 2018-07-09 13:34:29 -04:00
Jean-Paul Calderone
3623ed49f8 Perhaps this will fix the Slackware TLS errors 2018-07-09 11:02:29 -04:00
Jean-Paul Calderone
e1686cd891 let the test suite complete 2018-07-08 19:06:34 -04:00
Jean-Paul Calderone
97bc77d96b Go straight to a file with the subunit2 output.
It's just too hard otherwise.
2018-07-08 18:49:45 -04:00
Jean-Paul Calderone
869a6ad390 Go straight to subunit v2 2018-07-06 16:55:19 -04:00
Jean-Paul Calderone
4b98440e6a Try harder to find the right output from Tox 2018-07-06 12:49:19 -04:00
Jean-Paul Calderone
fcf4480cbc use TOX_JSON where it is appropriate 2018-07-06 12:06:46 -04:00
Jean-Paul Calderone
305d16af69 move path var definition higher up 2018-07-06 12:06:38 -04:00
Jean-Paul Calderone
da007ef21d make sure nobody owns the artifacts directory 2018-07-06 12:06:21 -04:00
Jean-Paul Calderone
61f88c5359 nothing else will create it, I think 2018-07-06 11:32:19 -04:00
Jean-Paul Calderone
90ef111964 formatting 2018-07-06 11:32:12 -04:00
Jean-Paul Calderone
a23fc6b006 Make more intermediate state visible as artifacts 2018-07-06 11:28:52 -04:00
Jean-Paul Calderone
d074d52b48 Get junitxml uploaded as an artifact as well 2018-07-06 10:59:10 -04:00
Jean-Paul Calderone
79bea48b58 Get setup and build to agree on tox workdir 2018-07-06 10:54:31 -04:00
Jean-Paul Calderone
a47877891b Account for comma-separated tox env list 2018-07-06 10:47:28 -04:00
Jean-Paul Calderone
4e0863436f Perhaps do a better job of generating junitxml 2018-07-06 10:15:52 -04:00
Jean-Paul Calderone
8300891ca2 Use a slightly better tox working directory 2018-07-06 10:15:32 -04:00
Jean-Paul Calderone
0ff1e100e1 Probably has to have this specific name
Or it won't be used
2018-07-05 19:47:11 -04:00
Jean-Paul Calderone
cead72ac58 Generate subunit1 and then junitxml test results
Successfully this time, perhaps.
2018-07-05 16:03:37 -04:00
Jean-Paul Calderone
16e4370630 Generate junitxml and give it to CircleCI 2018-07-05 14:19:23 -04:00
Jean-Paul Calderone
98cc14c622 misc cleanups 2018-07-05 14:00:36 -04:00
Jean-Paul Calderone
52ac1462c9 whitespace 2018-07-05 09:56:47 -04:00
Jean-Paul Calderone
dd9acf25c8 Only run the older if the newer succeeds
Spreads the initial builds across different platforms more effectively
and avoids potential redundant failing builds on different versions of a
single platform.
2018-07-05 09:07:10 -04:00
Jean-Paul Calderone
b9278cd25a Remove the magic-folder "machine" configuration
Ubuntu 14.04 is so ooooold.  It doesn't like the way we're installing
Python packages now.
2018-07-05 08:54:02 -04:00
Jean-Paul Calderone
eb55b6ad32 Add a couple more dependencies of sqlite3 2018-07-04 20:46:46 -04:00
Jean-Paul Calderone
531ac8474b Get certifi to fix the underlying problem
Having certifi magically makes setuptools able to talk to PyPI.  Whew!
2018-07-04 20:14:29 -04:00
Jean-Paul Calderone
6a0fda7ae5 the real package name 2018-07-04 16:02:01 -04:00
Jean-Paul Calderone
b2a3a38bdd linux/limits.h 2018-07-04 16:01:54 -04:00
Jean-Paul Calderone
f7e62b7e26 make sure we can build gmpy for twisted 2018-07-04 11:44:20 -04:00
Jean-Paul Calderone
f474789e40 make sure we have boring build tools like as 2018-07-04 11:43:49 -04:00
Jean-Paul Calderone
78a31960fa make sure we have boring headers like limits.h 2018-07-04 11:42:06 -04:00
Jean-Paul Calderone
4f3809ed7f Attempt to get setuptools SSL client working 2018-07-04 11:19:50 -04:00
Jean-Paul Calderone
9525198cdd Apparently the upgrade command works differently.
It doesn't find anything if we spell out the full package name and
version.  If we drop the last segment, however...
2018-07-04 09:07:46 -04:00
Jean-Paul Calderone
11fa6303e9 try upgrading the installed package instead 2018-07-03 16:10:07 -04:00
Jean-Paul Calderone
e42d330baa perhaps this is the maintained package? 2018-07-03 16:05:08 -04:00
Jean-Paul Calderone
0f7b075db0 add cyrus-sasl, secret curl dependency 2018-07-03 15:40:48 -04:00
Jean-Paul Calderone
a8b02d2240 Attempt better slackpkg usage
Package matching seems to be by substring.  Avoid getting a ton of
useless packages by making more precise substrings.

Also, there is no distro virtualenv package.  Get it another way.
2018-07-03 15:36:26 -04:00
Jean-Paul Calderone
bf4aee0858 Also install an ssh client 2018-07-03 15:23:48 -04:00
Jean-Paul Calderone
b8e369e85f Avoid the Y/n prompt 2018-07-03 15:21:50 -04:00
Jean-Paul Calderone
301e8d321f Configure a Slackware job 2018-07-03 14:52:10 -04:00
Jean-Paul Calderone
2deb0a4b26 Add a "C" locale testing configuration 2018-06-19 08:37:18 -04:00
Jean-Paul Calderone
35996ef90f Re-enable the rest of the jobs 2018-06-16 16:06:14 -04:00
Jean-Paul Calderone
329cf46403 Help codecov find the coverage data 2018-06-16 10:19:45 -04:00
Jean-Paul Calderone
1102a2f4fc hilarious how hard it is to just pass an argument 2018-06-15 16:07:24 -04:00
Jean-Paul Calderone
3837fd880c make test args optional 2018-06-15 16:02:49 -04:00
Jean-Paul Calderone
a4fb33c235 debug output 2018-06-15 16:00:27 -04:00
Jean-Paul Calderone
d84773702d And these 2018-06-15 15:54:47 -04:00
Jean-Paul Calderone
054bb0ee6f pass arg in both places 2018-06-15 15:52:59 -04:00
Jean-Paul Calderone
9abb323d31 try passing positional args instead 2018-06-15 15:40:50 -04:00
Jean-Paul Calderone
7d74e042a3 Thanks, sudo. 2018-06-15 15:37:08 -04:00
Jean-Paul Calderone
13214437bf Get the right virtualenv package 2018-06-15 15:34:21 -04:00
Jean-Paul Calderone
0aab633db9 do the right thing 2018-06-15 15:33:13 -04:00
Jean-Paul Calderone
00fa08b7cf bootstrap moves the source 2018-06-15 15:26:19 -04:00
Jean-Paul Calderone
fd26551c17 _not available_ in the build environment! 2018-06-15 15:17:32 -04:00
Jean-Paul Calderone
9ad7257614 find the project 2018-06-15 15:14:55 -04:00
Jean-Paul Calderone
182d6aec94 necessary but not sufficient 2018-06-15 15:13:17 -04:00
Jean-Paul Calderone
02c5a72924 the env var has an unexpanded ~ in it
more trouble than it is worth
2018-06-15 15:00:47 -04:00
Jean-Paul Calderone
0abb7cf350 need sudo here 2018-06-15 14:55:57 -04:00
Jean-Paul Calderone
82b07f3714 not installed yet 2018-06-15 14:55:16 -04:00
Jean-Paul Calderone
dd1d934b25 What is going on with not being able to run these? 2018-06-15 14:53:19 -04:00
Jean-Paul Calderone
7dda09bb20 Cannot use an in-repo script to install git... 2018-06-15 14:51:11 -04:00
Jean-Paul Calderone
00e3a04c7e Factor steps out for use by machine executer 2018-06-15 14:21:33 -04:00
Jean-Paul Calderone
414c0907a7 Give test_system an ip executable
Same as the net-tools fix for CentOS 7, basically.
2018-06-15 14:01:42 -04:00
Jean-Paul Calderone
f39a85dbd8 Add a VM-based magic-folder test job 2018-06-15 13:46:58 -04:00
Jean-Paul Calderone
a4ac9ba9ce Upload the deprecation warning logs as artifacts 2018-06-15 13:20:46 -04:00
Jean-Paul Calderone
be8dca9f58 remove debug env 2018-06-15 13:20:18 -04:00
Jean-Paul Calderone
b109850683 A better comment about the deprecations job. 2018-06-15 11:36:15 -04:00
Jean-Paul Calderone
69a7573745 Use yaml merge mapping correctly
At least, correctly as far as Ruby is concerned...
2018-06-15 11:07:56 -04:00
Jean-Paul Calderone
03bb4ef1a9 Add a deprecations job 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
663f98101c Put more of the Tox setup in the setup step
This will give more accurate test step timings.
2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
83cb49e83d Clean up the CircleCI presentation a bit 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
66903ba3d7 Make the environment a mapping
The documentation explains it as a list of single mappings.  That makes
no sense but "no sense" is par for the course.  However, "circleci
config validate" is happy if it is merely a mapping.

Making it a mapping lets us do a yaml mapping merge later and reduce
duplication.
2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
7cd387bf5b Specify tox environment with an env var
This will make it easier to override.
2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
e9cddda898 Always run coverage
If you do not always run coverage, how will you know what the coverage is?

Also remove some duplication in the environment setup.
2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
9d9a725794 Avoid yaml merge map in one place where possible 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
e5e5bde7b6 Make the test log available as an artifact 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
ea046cd30f Add a locale env var 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
f51e6da9d2 Factor out the duplicate environment config 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
afa321ae5f Factor out more of the test suite run config 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
30380a0d18 Add an Ubuntu 16.04 job 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
72fb92a045 whitespace 2018-06-15 10:58:51 -04:00
Jean-Paul Calderone
70c9973b8e Add an Ubuntu 18.04 job 2018-06-15 10:58:50 -04:00
Jean-Paul Calderone
9cd41b900f Add a Fedora 28 job 2018-06-15 08:44:52 -04:00
Jean-Paul Calderone
dc1f6d3fec Add a Fedora 27 job 2018-06-15 08:44:52 -04:00
Jean-Paul Calderone
d728c245f3 Factor out the duplicate test step command 2018-06-15 08:44:52 -04:00