Itamar Turner-Trauring
a6b66dd331
Merge pull request #1294 from tahoe-lafs/4018-better-integration-logging
...
Better integration test logging
Fixes ticket:4018
2023-05-02 09:46:07 -04:00
Itamar Turner-Trauring
bc2506c3e2
Merge remote-tracking branch 'origin/master' into 3999.structure-config-manipulation
2023-05-01 12:52:18 -04:00
Itamar Turner-Trauring
c15dd6c9f0
This wasn't the issue.
2023-04-28 11:43:48 -04:00
Itamar Turner-Trauring
0f200e422e
Give it more time.
2023-04-27 15:48:49 -04:00
Itamar Turner-Trauring
86a513282f
Include Foolscap logging in node output in integration tests.
2023-04-27 10:36:39 -04:00
Itamar Turner-Trauring
8f1d1cc1a0
Include node name in the logging output from subprocesses.
2023-04-27 10:23:06 -04:00
Jean-Paul Calderone
c0e49064ce
Attempt to get more information about client unready state
2023-04-27 09:50:02 -04:00
Itamar Turner-Trauring
f9a1eedaea
Make timeout optional, enable it only for integration tests.
2023-04-25 12:31:37 -04:00
Jean-Paul Calderone
fbb5f4c359
slightly clarified comment
2023-04-25 09:31:10 -04:00
Jean-Paul Calderone
825bcf3f3b
revert reformatting
2023-04-25 09:31:04 -04:00
Jean-Paul Calderone
c595eea33e
always set the "start time" timeout
...
in both the "we installed it ourselves" and the "we found an existing
installation" cases.
2023-04-25 09:27:51 -04:00
Jean-Paul Calderone
3d2e4d0798
note about port selection
2023-04-25 09:26:58 -04:00
meejah
b5f6fa8933
skip properly
2023-04-14 19:07:27 -06:00
meejah
8652bb71ad
skip i2p tests again?
2023-04-14 17:05:57 -06:00
meejah
8b81bd7ebe
remove more debug
2023-04-14 16:33:52 -06:00
meejah
3ccb7c4d1c
re-enable i2p tests
2023-04-14 15:45:17 -06:00
meejah
34cee7ff73
missing import
2023-04-14 15:44:52 -06:00
meejah
d3c39f8604
fix i2p introducer, different ports
2023-04-14 15:27:19 -06:00
meejah
abfca04af5
turn off i2p tests for now
2023-04-14 13:24:22 -06:00
meejah
76ce54ea53
remove debugging
2023-04-14 13:23:28 -06:00
meejah
250efe7d24
leftover
2023-04-13 16:42:02 -06:00
meejah
175473df40
longer timeouts, forget less
2023-04-13 00:37:32 -06:00
meejah
507d1f8394
Fix some Chutney things (and a couple cleanups): wait for bootstrap, increase timeout
2023-04-12 22:34:45 -06:00
Itamar Turner-Trauring
7b94324827
More debugging.
2023-04-07 15:23:51 -04:00
Itamar Turner-Trauring
13e9f88309
Add necessary config option to ensure it listens on Tor, and also give correct
...
Tor control port.
2023-04-07 15:23:20 -04:00
Itamar Turner-Trauring
b1f5201ef2
Merge remote-tracking branch 'exarkun/3999.structure-config-manipulation' into 3999.structure-config-manipulation
2023-04-05 11:42:31 -04:00
Itamar Turner-Trauring
812458699d
The tcp listening port needs to match the onion local port, or you get
...
connection refused when you try to connect to the hidden service.
2023-04-05 11:38:28 -04:00
Jean-Paul Calderone
76873e5901
Merge remote-tracking branch 'origin/master' into 3999.structure-config-manipulation
2023-04-05 08:43:24 -04:00
Itamar Turner-Trauring
efa51d41dc
Newer chutney.
2023-04-04 10:58:28 -04:00
Itamar Turner-Trauring
1de8e811b5
Tweaks.
2023-04-04 10:58:22 -04:00
Jean-Paul Calderone
28e442a4f5
Merge pull request #1280 from exarkun/4001.propagate-parent-process-env
...
Propagate parent environment to children in the integration tests
Fixes: ticket:4001
2023-04-03 12:16:58 -04:00
Jean-Paul Calderone
0b5c96e762
Merge pull request #1281 from exarkun/4002.reuse-chutney
...
Use an existing Chutney, if there is one
Fixes: ticket:4002
2023-03-28 13:24:14 -04:00
Jean-Paul Calderone
4232c7f142
remove unused binding
2023-03-27 14:55:10 -04:00
Jean-Paul Calderone
d3d94937be
Nothing uses the return value of this fixture
2023-03-27 14:42:32 -04:00
Jean-Paul Calderone
fb8c10c55f
Use an already-installed Chutney if there is one
2023-03-27 14:42:32 -04:00
Jean-Paul Calderone
8613e36bae
Propagate parent environment to children in the integration tests
2023-03-27 14:06:16 -04:00
Jean-Paul Calderone
1c99817e1b
Safely customize the client node's configuration
...
This is similar to the fix to the `tor_introducer` fixture.
2023-03-27 13:59:32 -04:00
Jean-Paul Calderone
1c11f9e7d4
Add a little more debug info to the integration test suite output
2023-03-27 13:59:32 -04:00
Jean-Paul Calderone
fbcef2d1ae
Safely customize the Tor introducer's configuration
...
Previously we clobbered the whole generated configuration and potentially
wiped out additional important fields.
Now we modify the configuration by just changing the fields we need to change.
2023-03-27 13:59:30 -04:00
Jean-Paul Calderone
b65e8c72df
Skip the tor integration tests if any needed tor tools are missing
2023-03-27 13:57:09 -04:00
Itamar Turner-Trauring
815066c4de
Just use the utility.
2023-03-20 15:25:52 -04:00
Itamar Turner-Trauring
ded5b20924
Lint fix.
2023-03-20 15:20:39 -04:00
Itamar Turner-Trauring
aba60d2719
Run blocking tests in a thread.
2023-03-20 15:14:01 -04:00
Itamar Turner-Trauring
61d9d82c55
Make await_client_ready() non-blocking.
2023-03-20 15:02:35 -04:00
Jean-Paul Calderone
e6832dd71c
another one
2023-03-16 09:37:54 -04:00
Jean-Paul Calderone
c9dba4d0a4
Fix a couple other _protocol
attributes
2023-03-16 09:09:25 -04:00
Jean-Paul Calderone
58e0e3def7
see if this fixes the AttributeError
2023-03-16 08:52:15 -04:00
Jean-Paul Calderone
35525bc10e
Merge remote-tracking branch 'origin/master' into 2916.grid-manager-integration-tests.2
2023-03-16 08:33:16 -04:00
Itamar Turner-Trauring
c97e07dc63
Merge pull request #1263 from tahoe-lafs/3959-more-end-to-end-tests
...
More end to end tests
Fixes ticket:3959
2023-03-14 11:31:41 -04:00
Itamar Turner-Trauring
d7018905b9
Switch away from using stdin, it's flaky on Windows.
2023-03-14 09:57:29 -04:00
Itamar Turner-Trauring
db445af1c4
Separate flags for forcing foolscap between client and server.
2023-03-09 09:59:36 -05:00
Itamar Turner-Trauring
5dc108dfe8
Test large immutable upload and download.
2023-03-08 11:38:31 -05:00
Itamar Turner-Trauring
c9d140b05d
Merge remote-tracking branch 'origin/master' into 3957-mutable-over-http-speed
2023-02-21 09:38:36 -05:00
Itamar Turner-Trauring
31024ceb4c
reconfigure() is only an issue if it changes something...
2023-02-20 12:44:03 -05:00
Itamar Turner-Trauring
e3ad50a084
Just skip usage of reconfigure() on Windows.
2023-02-20 11:54:50 -05:00
Itamar Turner-Trauring
3bc3cf39d0
Test using an integration test.
2023-02-07 09:45:50 -05:00
Itamar Turner-Trauring
ea052b3c80
Pass in missing argument.
2023-02-07 09:08:06 -05:00
Itamar Turner-Trauring
f4255cdaa3
More accurate names.
2023-02-07 09:03:45 -05:00
Itamar Turner-Trauring
b0f4e463eb
Work with newer i2pd.
2023-02-06 17:48:32 -05:00
Itamar Turner-Trauring
921a2083dc
Make sure (immutable) test vectors are run with the segment size that was used
...
to generate them.
2023-01-25 15:47:35 -05:00
Jean-Paul Calderone
58f20ff9c7
advertise all the names
2023-01-20 19:50:57 -05:00
Jean-Paul Calderone
f4e3e08e38
re-generate with a case using an exact segment size multiple
...
all of the mutables totally change because we don't try to re-use existing rsa
keys (yet...?)
2023-01-20 16:27:13 -05:00
Jean-Paul Calderone
ed7bb1b41f
expose the persistence api
2023-01-20 16:27:05 -05:00
Jean-Paul Calderone
781f4486ac
Get the segment size parameter right
2023-01-20 16:26:23 -05:00
Jean-Paul Calderone
c46ab2d88b
Hit a multiple of SEGMENT_SIZE on the nose
2023-01-20 15:20:02 -05:00
Jean-Paul Calderone
4664bcb321
These didn't end up being used
2023-01-20 15:15:44 -05:00
Jean-Paul Calderone
9581eeebe5
explain the repeated save_capabilities calls
2023-01-20 15:14:18 -05:00
Jean-Paul Calderone
129c6ec11a
Factor more infrastructure code out of the test module
...
Test vector saving implementation can go near loading implementation. Also we
can separate out some simple types from the more complex logic. Initially
this was to resolve a circular dependency but that ended up being resolved
mostly by treatming SEGMENT_SIZE more like a parameter than a global. Still,
smaller modules are okay...
2023-01-18 13:52:11 -05:00
Jean-Paul Calderone
4e2c685a12
Fix test_directory_deep_check by having it re-assert its preferred config
...
Previously the changes test_vectors.py made to Alice's configuration
invalidated test_directory_deep_check's assumptions.
2023-01-18 13:28:24 -05:00
Jean-Paul Calderone
e53f68f4d7
Move parameter definitions to their own module, away from test implementation
2023-01-17 10:59:00 -05:00
Jean-Paul Calderone
290bb5297f
lint
2023-01-17 10:19:37 -05:00
Jean-Paul Calderone
1d32326659
Simpler, more correct process lifecycle handling.
...
The previous version included a bogus hack where we just passed
`allow_missing=True` when finalization was requested of `_run_node`. This was
clearly wrong since if the caller asked for finalization, it's a programming
error for it to already have been done.
Fortunately we have a perfectly good finalizer already, `TahoeProcess.kill`,
which we can use instead of trying to craft a finalizer out of the various
pieces that make up that value.
Also, nothing seems to use the `_protocol` attribute set by `got_proto` so
let's just drop that.
2023-01-17 10:06:14 -05:00
Jean-Paul Calderone
eb630c391f
"Parametrize" in a way that gives us better test names.
...
The old way just put sequence numbers into the name. This way puts expected
capability strings in.
2023-01-17 10:03:54 -05:00
Jean-Paul Calderone
f2989c0a4f
Correct the ProcessExitedAlready exception handling
...
It's always okay to get ProcessExitedAlready from signalProcess. It just
means we haven't handled the SIGCHLD yet.
2023-01-17 09:46:22 -05:00
Jean-Paul Calderone
5424aa9737
Only run the very slow new integration test in one CI job
2023-01-17 09:27:17 -05:00
Jean-Paul Calderone
3ab7fc3853
Be able to load the data
2023-01-17 08:45:38 -05:00
Jean-Paul Calderone
d14ba09dbb
Some flake fixes
2023-01-17 08:41:31 -05:00
Jean-Paul Calderone
c28f10057b
Move some more pieces into the subdirectory
2023-01-16 16:01:11 -05:00
Jean-Paul Calderone
4eec8113ee
reproducible ssk vectors
2023-01-16 15:53:24 -05:00
Jean-Paul Calderone
1827834434
Re-generate vectors with a very small CHK
2023-01-13 21:14:37 -05:00
Jean-Paul Calderone
312513587f
Switch to FilePath, regenerate w/o "max"
2023-01-12 17:27:37 -05:00
Jean-Paul Calderone
ed74fdc746
write the data file more safely
2023-01-12 16:56:20 -05:00
Jean-Paul Calderone
dd51c7a3f1
Handle an empty test vectors file
2023-01-12 15:19:01 -05:00
Jean-Paul Calderone
fa55956d29
Always write an int to the test vectors file
2023-01-12 15:18:54 -05:00
Jean-Paul Calderone
bbd3e74a5f
Always place an int in the parameters total field
2023-01-12 15:17:08 -05:00
Jean-Paul Calderone
c211731c5f
Merge remote-tracking branch 'origin/master' into 3961.test-vectors
2023-01-10 09:57:48 -05:00
Jean-Paul Calderone
fb70ba1867
Generate and consumer the new structure properly
2023-01-03 19:22:38 -05:00
Jean-Paul Calderone
ca00adf2b4
regenerated test vectors with a more convenient format
...
It's more verbose but it's easier to load and interpret.
2023-01-03 18:50:07 -05:00
Jean-Paul Calderone
40eff1523e
The retry logic was removed a few revisions ago
...
The uploads failed because of the zfec parameters, not because of unreliable
localhost networking that might go away when retried.
2023-01-02 16:23:06 -05:00
Jean-Paul Calderone
77e5357a04
note to self
2022-12-27 09:12:56 -05:00
Jean-Paul Calderone
3f8f715aa2
Be consistent between the test and the data source
2022-12-27 09:12:34 -05:00
Jean-Paul Calderone
13a9ed0202
clarify what reliability we hope for
2022-12-27 09:03:24 -05:00
Jean-Paul Calderone
6a1a2fb705
we support other capability types now
2022-12-27 09:03:01 -05:00
Jean-Paul Calderone
e11b589eba
typo
2022-12-27 09:02:43 -05:00
Jean-Paul Calderone
aecaaa2426
in general, do not regenerate the test vectors
2022-12-27 09:01:33 -05:00
Jean-Paul Calderone
4a39c4b7ec
Add SDMF and MDMF
2022-12-26 17:08:36 -05:00
Jean-Paul Calderone
39b3f19c0e
Put the generator inputs into the output file
...
This should make it easier for other implementations to use the test data, I
think.
Also put a version in there so we can change inputs in the future but still
talk about results meaningfully. And some other minor refactoring
2022-12-26 12:06:34 -05:00
Jean-Paul Calderone
5af6fc0f9d
reconfigure() only needs to restart the node if something changed
2022-12-22 20:53:49 -05:00
Jean-Paul Calderone
8a42720301
Move some general utility functions into the util module
2022-12-22 17:02:42 -05:00
Jean-Paul Calderone
43388ee711
Comments and minor factoring improvements and such
2022-12-22 16:52:00 -05:00