Commit Graph

8959 Commits

Author SHA1 Message Date
dlee
1c926aeb86 Add space to return type 2023-03-13 16:23:28 -05:00
dlee
f1be1ca1de Added more elements to export list in wormholetesting.py 2023-03-13 14:53:25 -05:00
dlee
041a634d27 Fix private interface import to test_invite 2023-03-13 13:08:32 -05:00
dlee
61c835c8a0 Added missing space between return type 2023-03-13 11:17:01 -05:00
dlee
74ff8cd080 Per-file configuration for wormholetesting.py moved from inline mypy configuration moved to mypy.ini file 2023-03-13 11:04:52 -05:00
Fon E. Noel NFEBE
f9acb56e82 Fix wrong expected val in assertion
This is a follow up to 7a387a054e

Signed-off-by: Fon E. Noel NFEBE <fenn25.fn@gmail.com>
2023-03-12 00:16:41 +01:00
Fon E. Noel NFEBE
7a387a054e Fix more inverted assertions
Just like in 7c3f6cb4c7
This commit corrects some wronly inverted assertions inside
`test/test_storage.py`

Signed-off-by: Fon E. Noel NFEBE <fenn25.fn@gmail.com>
2023-03-11 23:58:58 +01:00
Fon E. Noel NFEBE
3ae574ddef Merge branch '3917-refactor-test-storage-py' of github.com:Fenn-CS/tahoe-lafs into 3917-refactor-test-storage-py 2023-03-11 20:55:40 +01:00
Fon E. Noel NFEBE
4e6e78f19c Merge branch 'master' into 3917-refactor-test-storage-py 2023-03-11 20:54:12 +01:00
Jean-Paul Calderone
374d2fc499
Merge pull request #1266 from tahoe-lafs/3965.better-max-size
Add more restrictive CBOR content limits to server

Fixes: ticket:3965
2023-03-10 11:13:15 -05:00
Itamar Turner-Trauring
aa18c3418f Merge remote-tracking branch 'origin/master' into 3935-happy-eyeballs 2023-03-10 09:10:02 -05:00
Itamar Turner-Trauring
584127ba10
Merge pull request #1264 from tahoe-lafs/3936.client-can-disable-foolscap
Make the client respect the force_foolscap flag

Fixes ticket:3936
2023-03-10 09:04:15 -05:00
Itamar Turner-Trauring
ccf12897f2 Add content limits to server. 2023-03-10 09:02:08 -05:00
Itamar Turner-Trauring
5d7d387593 Pacify mypy. 2023-03-09 13:45:50 -05:00
Itamar Turner-Trauring
56b6dd86c3 Add unit test for client foolscap config flag. 2023-03-09 10:33:21 -05:00
Itamar Turner-Trauring
db445af1c4 Separate flags for forcing foolscap between client and server. 2023-03-09 09:59:36 -05:00
Itamar Turner-Trauring
b43150ba85 Add future import. 2023-03-08 16:48:08 -05:00
Itamar Turner-Trauring
708d54b5fd Fix use of API removed in 3.11. 2023-03-08 16:42:41 -05:00
dlee
4f47a18c6a Comments added for inline mypy config. Individual flags used as --strict flag can only be used on a per-module basis. 2023-03-08 15:29:50 -06:00
dlee
10b3eabed4 Apply per file flags corresponding to --strict to wormholetesting.py 2023-03-08 15:19:08 -06:00
dlee
8ccbd37d29 Fix implicit re-export error by importing IWormhole from wormhole library directly 2023-03-08 15:16:03 -06:00
Itamar Turner-Trauring
a61e41d5f9 Document the motivation. 2023-03-08 14:58:52 -05:00
Itamar Turner-Trauring
3702ad6233 Fix indentation. 2023-03-08 14:54:53 -05:00
Itamar Turner-Trauring
4db65ea936 Make tests test _pick_a_http_server more directly. 2023-03-08 14:53:43 -05:00
Itamar Turner-Trauring
0093edcd93 Refactor to use race(). 2023-03-08 14:36:37 -05:00
Itamar Turner-Trauring
75da037d67 Add race() implementation from https://github.com/twisted/twisted/pull/11818 2023-03-08 14:25:04 -05:00
Itamar Turner-Trauring
e9c3a227a1 File follow-up ticket. 2023-03-08 14:17:25 -05:00
Itamar Turner-Trauring
9663db522c Make the client respect the force_foolscap flag, and default to Foolscap-only
for now.
2023-03-08 14:03:32 -05:00
Itamar Turner-Trauring
450eed7868 Test writing at an offset. 2023-03-08 11:31:58 -05:00
Itamar Turner-Trauring
cf00c6918c Merge remote-tracking branch 'origin/master' into 3935-happy-eyeballs 2023-03-08 10:45:55 -05:00
meejah
6c0c9470cf
Merge pull request #1206 from tahoe-lafs/2916.grid-manager-proposal.6
Grid Manager: more control over which storage-servers a client uploads to
2023-02-28 19:05:32 +00:00
meejah
8e7f2cd3ea unused 2023-02-28 10:47:17 -07:00
meejah
5672a28350 more-specific error 2023-02-28 10:43:55 -07:00
meejah
b28ac6118b different way to say 'all items okay' 2023-02-28 10:43:49 -07:00
Jean-Paul Calderone
7c3f6cb4c7
Fix inverted assertion 2023-02-28 07:55:43 -05:00
meejah
d55a4a1e65
whitespace
Co-authored-by: Jean-Paul Calderone <exarkun@twistedmatrix.com>
2023-02-27 17:32:16 -07:00
meejah
9f63441af6
types
Co-authored-by: Jean-Paul Calderone <exarkun@twistedmatrix.com>
2023-02-27 17:31:39 -07:00
meejah
1587a71bba
spelling
Co-authored-by: Jean-Paul Calderone <exarkun@twistedmatrix.com>
2023-02-27 17:26:06 -07:00
dlee
582876197a Added default check to verify to ensure strictness 2023-02-27 15:14:58 -06:00
dlee
af51b02228 Revert wait_for_wormhole function return type back to Awaitable for forward compatibility when we move to async def 2023-02-27 15:05:52 -06:00
Itamar Turner-Trauring
3d0b17bc1c Make cancellation more likely to happen. 2023-02-27 12:10:56 -05:00
Itamar Turner-Trauring
5640b6b5e7 Apparently tests can be async now. 2023-02-24 10:59:59 -05:00
Itamar Turner-Trauring
2f6632ecb9 Improve type checking. 2023-02-24 10:58:22 -05:00
Itamar Turner-Trauring
e09d19463d Logging errors breaks some tests. 2023-02-24 09:53:28 -05:00
Itamar Turner-Trauring
96e1e9ffac Move where choosing a NURL happens. 2023-02-23 19:45:01 -05:00
meejah
a6a2eb1c93
export it too
Co-authored-by: Jean-Paul Calderone <exarkun@twistedmatrix.com>
2023-02-23 15:37:46 -07:00
Itamar Turner-Trauring
b95a1d2b79 Nicer type annotations. 2023-02-23 13:27:41 -05:00
Itamar Turner-Trauring
b6e20dfa81 Slightly longer timeout. 2023-02-23 13:27:33 -05:00
Itamar Turner-Trauring
99de5fa54c Link to follow-up ticket. 2023-02-23 10:12:25 -05:00
Itamar Turner-Trauring
f41f4a5e0c Correct type. 2023-02-23 10:10:25 -05:00
Itamar Turner-Trauring
74e77685a3 Get rid of DeferredList. 2023-02-23 10:07:57 -05:00
meejah
6aff94dd8f flake8, more frozen 2023-02-22 00:15:32 -07:00
meejah
c587c9ed19 Merge branch '2916.grid-manager-proposal.6' of https://github.com/tahoe-lafs/tahoe-lafs into 2916.grid-manager-proposal.6 2023-02-21 23:21:09 -07:00
meejah
0ae7da7352 prop up the fragile scaffolding 2023-02-21 23:20:28 -07:00
meejah
69a480dc08 rewrite test 2023-02-21 18:44:09 -07:00
meejah
fb10e13c68 might want to use these at parse time 2023-02-21 18:16:45 -07:00
meejah
70459cfbf1 use possibly-overriden stderr 2023-02-21 16:47:58 -07:00
meejah
6ee5c75880 comment -> ticket 2023-02-21 16:13:11 -07:00
meejah
00ef4661a6 ISO dates, not seconds 2023-02-21 16:06:24 -07:00
meejah
d91bfcb1d2 clarify 2023-02-21 14:38:43 -07:00
meejah
82045b4298 store signature as raw bytes, not base32 2023-02-21 14:19:44 -07:00
meejah
1b6d5e1bda Revert "use attrs directly"
This reverts commit 5b14561ec0.
2023-02-21 11:56:46 -07:00
Itamar Turner-Trauring
32768e310a Unit test for _pick_a_http_server. 2023-02-21 11:30:47 -05:00
Itamar Turner-Trauring
2ac6580c26 Welcome to the world of tomorrow. 2023-02-21 11:00:14 -05:00
Itamar Turner-Trauring
95bb7afba7 Sketch of happy eyeballs. 2023-02-21 10:42:06 -05:00
Itamar Turner-Trauring
2811c80dc3 Fix timeout in parallel benchmark. 2023-02-21 09:57:21 -05:00
Itamar Turner-Trauring
154f1ce143 No need for sleep. 2023-02-21 09:38:54 -05:00
Itamar Turner-Trauring
c9d140b05d Merge remote-tracking branch 'origin/master' into 3957-mutable-over-http-speed 2023-02-21 09:38:36 -05:00
meejah
38669cc3ce define -> frozen 2023-02-21 02:15:20 -07:00
meejah
032b852bab define -> frozen 2023-02-21 01:51:13 -07:00
meejah
43d29986a6
Update src/allmydata/cli/grid_manager.py
Co-authored-by: Jean-Paul Calderone <exarkun@twistedmatrix.com>
2023-02-21 00:04:03 -07:00
meejah
affe0cb37b fine? 2023-02-21 00:02:53 -07:00
meejah
bdf4c49a34 fine, move the if statement 2023-02-20 22:57:15 -07:00
meejah
a6cf06cc6d http needs access to GridManager 2023-02-20 12:26:44 -07:00
meejah
5b14561ec0 use attrs directly 2023-02-20 12:02:34 -07:00
meejah
464498f6bf Merge branch 'master' into 2916.grid-manager-proposal.6 2023-02-20 11:24:20 -07:00
Itamar Turner-Trauring
acc9cd2f9f Merge remote-tracking branch 'origin/master' into 3946-less-chatty-downloads 2023-02-20 12:45:27 -05:00
Itamar Turner-Trauring
b14b2d0409 Use a nicer shutdown mechanism. 2023-02-20 12:01:14 -05:00
dlee
86dbcb21ce Refactored verify function to update deprecated getargspec function with getfullargspec and maintained strictness 2023-02-17 16:24:32 -06:00
dlee
badba97ff2 Type annotations added for wormholetesting.py 2023-02-17 16:20:29 -06:00
Itamar Turner-Trauring
3686fe7fa3 Merge remote-tracking branch 'origin/master' into 3946-less-chatty-downloads 2023-02-14 14:46:36 -05:00
dlee
a7ddcbf868 Changes requested 2023-02-14 12:50:37 -06:00
dlee
b7cadfc53a Fixes bad practice of naming variable a built-in type 2023-02-14 11:38:35 -06:00
dlee
19e58f19ca Fixes truthy conditional 2023-02-14 11:21:57 -06:00
Jean-Paul Calderone
97686f6d42 Merge remote-tracking branch 'origin/master' into 3957-mutable-over-http-speed 2023-02-13 09:19:49 -05:00
Itamar Turner-Trauring
3bc3cf39d0 Test using an integration test. 2023-02-07 09:45:50 -05:00
Itamar Turner-Trauring
51d44ba676 Document. 2023-02-07 09:06:57 -05:00
Itamar Turner-Trauring
f4255cdaa3 More accurate names. 2023-02-07 09:03:45 -05:00
dlee
eb26c97ef7 implicit_optional flag added and errors related to flag fixed 2023-02-06 15:29:53 -06:00
Itamar Turner-Trauring
c4114e032e Fix type signature. 2023-02-06 15:33:08 -05:00
Itamar Turner-Trauring
4576d10915 Add an explanation. 2023-02-06 13:57:33 -05:00
Itamar Turner-Trauring
5909f451e3 Use the CPU thread pool for CBOR validation. 2023-02-06 13:54:47 -05:00
Itamar Turner-Trauring
b221954946 A working thread pool. 2023-02-06 13:09:22 -05:00
dlee
31c5b78e6a Add back rsa.py accidentally removed file on website 2023-02-03 21:35:55 -06:00
Daniel
80db4a9de4
Delete rsa.py 2023-02-03 21:25:24 -06:00
dlee
e2e33933a8 Forgot to push newsfragment 2023-02-03 16:48:06 -06:00
Itamar Turner-Trauring
b477c59e15 Actually have a working run-in-thread code path 2023-01-31 15:53:16 -05:00
Itamar Turner-Trauring
921a2083dc Make sure (immutable) test vectors are run with the segment size that was used
to generate them.
2023-01-25 15:47:35 -05:00
Itamar Turner-Trauring
28ca5abe3c Merge remote-tracking branch 'origin/master' into 3957-mutable-over-http-speed 2023-01-25 10:53:15 -05:00
Itamar Turner-Trauring
af53f5b8b9 Merge remote-tracking branch 'origin/master' into 3946-less-chatty-downloads 2023-01-25 10:12:20 -05:00
Itamar Turner-Trauring
cf4d767535 Fix whitespace. 2023-01-24 13:28:24 -05:00
Itamar Turner-Trauring
6ccccde9e0 Increase the max default segment size. 2023-01-24 13:15:55 -05:00
Itamar Turner-Trauring
d5f5d394dd Test changes in max default segment size (both directions). 2023-01-24 13:15:40 -05:00
Itamar Turner-Trauring
ba793e2c16 Make it actually work. 2023-01-24 11:10:50 -05:00
Itamar Turner-Trauring
3e6778268f Merge remote-tracking branch 'origin/master' into 3957-mutable-over-http-speed 2023-01-23 11:39:54 -05:00
Itamar Turner-Trauring
1f3993b689 Don't block on CDDL validation. 2023-01-23 11:37:13 -05:00
Jean-Paul Calderone
e2eac5855c Remove handling for older versions of pycddl
>=0.4 is now a hard-requirement
2023-01-23 08:52:00 -05:00
Jean-Paul Calderone
1a807a0232 mollify the type checker 2023-01-12 16:32:32 -05:00
Jean-Paul Calderone
d5628f9c84 Merge remote-tracking branch 'origin/master' into 3962.pre-determined-rsa-keys 2023-01-12 16:17:09 -05:00
Jean-Paul Calderone
c856f1aa29 Censor private key values in the HTTP log, too. 2023-01-12 16:16:55 -05:00
Jean-Paul Calderone
47ec418f7a Test that we can also download the mutable data via the web interface 2023-01-12 16:09:29 -05:00
Jean-Paul Calderone
e6ef45d337 test that we can also download the mutable 2023-01-12 15:37:12 -05:00
Jean-Paul Calderone
2d23e2e640 some doc improvements 2023-01-12 15:37:07 -05:00
Jean-Paul Calderone
2490f0f58a some minor rationalization of the return type 2023-01-12 15:33:37 -05:00
Itamar Turner-Trauring
828fc588c5 Add minimal docstrings. 2023-01-10 11:10:31 -05:00
Itamar Turner-Trauring
ccb5956645 0 is also valid FD. 2023-01-10 11:04:22 -05:00
Itamar Turner-Trauring
7c506057b5 Merge remote-tracking branch 'origin/master' into 3956-mutable-uploads 2023-01-09 17:05:31 -05:00
Itamar Turner-Trauring
f6d9c5a1b2 Fix PyInstaller. 2023-01-09 10:46:09 -05:00
Itamar Turner-Trauring
22227c7094 Support old pycddl too so nix can keep working. 2023-01-09 10:31:48 -05:00
Jean-Paul Calderone
3ce5ee6f03 get Literal from somewhere it is more likely to be 2023-01-07 07:17:40 -05:00
Jean-Paul Calderone
e893d06cb3 RSAPrivateKey certainly does have this method
I don't know why mypy fails to see it.
2023-01-06 21:00:21 -05:00
Jean-Paul Calderone
8c56ccad72 fall back to *with* validation, not without 2023-01-06 21:00:10 -05:00
Jean-Paul Calderone
85234b07a0 load the right kind of key! 2023-01-06 21:00:04 -05:00
Jean-Paul Calderone
c9e23dea13 we should always be able to get these
and we always need overload now
2023-01-06 20:59:48 -05:00
Jean-Paul Calderone
a806b2faba Fix some more mypy errors 2023-01-06 18:11:47 -05:00
Jean-Paul Calderone
01b14fe05c Merge remote-tracking branch 'origin/master' into 3962.pre-determined-rsa-keys 2023-01-06 17:30:01 -05:00
Jean-Paul Calderone
2dc6466ef5 fix some errors reported by mypy 2023-01-06 17:12:59 -05:00
Jean-Paul Calderone
e829b891b3 important data file ... 2023-01-06 15:51:59 -05:00
Jean-Paul Calderone
3ff9c45e95 expose the private-key feature in the tahoe put cli 2023-01-06 15:40:48 -05:00
Jean-Paul Calderone
e236cc95a5 Move get_keypair to a shared location 2023-01-06 15:36:08 -05:00
Itamar Turner-Trauring
3de5ebde48 Merge branch '3956-mutable-uploads' into 3957-mutable-over-http-speed 2023-01-06 11:05:11 -05:00
Jean-Paul Calderone
3423bfb351 Expose the pre-constructed keypair functionality to the HTTP API 2023-01-03 11:31:29 -05:00
Jean-Paul Calderone
c7bb190290 Factor some SSK "signature" key handling code into a more reusable shape
This gives the test suite access to the derivation function so it can
re-derive certain values to use as expected results to compare against actual
results.
2023-01-03 10:38:18 -05:00
Jean-Paul Calderone
5bad92cfc5 Another Python 2 remnant cleanup 2023-01-03 10:34:39 -05:00
Jean-Paul Calderone
a58d8a567a Clean up some more Python 2 remnants 2023-01-03 10:33:37 -05:00
Jean-Paul Calderone
6b58b66677 Clean up some Python 2 remnants 2023-01-03 10:32:03 -05:00
Jean-Paul Calderone
f6d9c33526 Give slightly better error messages from rsa key validation failure 2023-01-03 10:28:59 -05:00
Jean-Paul Calderone
23f2d8b019 add some type annotations to allmydata.crypto.rsa 2023-01-03 10:28:32 -05:00
Jean-Paul Calderone
15e22dcc52 Add keypair to NodeMaker.create_mutable_file
Previously `NodeMaker` always took responsibility for generating a keypair to
use.  Now the caller may supply one.
2023-01-02 19:29:13 -05:00
Jean-Paul Calderone
3f8bec0ecc Merge remote-tracking branch 'origin/master' into 3914.faster-rsa-tests 2023-01-02 11:46:10 -05:00
Jean-Paul Calderone
1c643ebbaf
Merge pull request #1237 from tahoe-lafs/3954.faster-http
Faster HTTP for immutable downloads

Fixes: ticket:3954
2023-01-02 10:09:55 -05:00
Itamar Turner-Trauring
d1b464d0d8 Writing large files can involve many writes. 2022-12-21 09:35:10 -05:00
Itamar Turner-Trauring
54da6eb60a Remove unneeded imports. 2022-12-21 09:34:25 -05:00
Itamar Turner-Trauring
1a4dcc70e2 Support large mutable uploads in a memory-efficient manner. 2022-12-21 09:24:31 -05:00
Jean-Paul Calderone
6b57b03157 Merge remote-tracking branch 'origin/master' into 3942.missing-authorization-handling 2022-12-21 05:51:39 -05:00
Jean-Paul Calderone
80caf04966
Merge pull request #1234 from tahoe-lafs/3947.mutable-test_version-async-def
Convert some tests for mutables to use `async def`

Fixes: ticket:3947
2022-12-21 05:50:07 -05:00
Itamar Turner-Trauring
1d3464a430 Add end-to-end MDMF test. 2022-12-19 13:37:20 -05:00
Itamar Turner-Trauring
96347e22e2 Make a test demonstrating the problem. 2022-12-15 13:14:49 -05:00
Jean-Paul Calderone
c014ad55b1 remove Python 2 boilerplate 2022-12-14 08:48:02 -05:00
Jean-Paul Calderone
05c7450376 Try to use an upcoming python-cryptography feature to avoid some costs
If the key is the wrong number of bits then we don't care about any other
validation results because we're just going to reject it.  So, check that
before applying other validation, if possible.

This is untested since the version of python-cryptography that supports it is
not released yet and I don't feel like setting up a Rust build tool chain at
the moment.
2022-12-14 08:47:05 -05:00
Itamar Turner-Trauring
6ae40a932d A much more reasonable number of HTTP connections. 2022-12-13 15:54:19 -05:00
Itamar Turner-Trauring
1eba202c08
Merge pull request #1231 from tahoe-lafs/3939-faster-http-protocol
Faster http protocol, part 1 (and maybe faster Foolscap too, while we're at it)

Fixes ticket:3939
2022-12-05 14:05:55 -05:00
Jean-Paul Calderone
daecfc63b9
Merge pull request #1233 from tahoe-lafs/3874.fix-testing-helper-encoding
Fix a testing helper
2022-12-02 10:27:58 -05:00
Jean-Paul Calderone
c542b84637 remove the annotations
everything is broken on older pythons
2022-12-02 08:47:07 -05:00
Jean-Paul Calderone
c6cc3708f4 Fixup the annotations a bit 2022-12-02 08:38:46 -05:00
Jean-Paul Calderone
b40d882fce remove unused import 2022-12-02 08:28:22 -05:00
Jean-Paul Calderone
a84b278ecd support older pythons 2022-12-02 08:26:15 -05:00
Jean-Paul Calderone
9619e286f4 Switch the web testing double to BytesKeyDict
This will catch more str/bytes errors by default than `dict`
2022-12-02 08:16:02 -05:00
meejah
20b3594d12 exarkun wants a helper 2022-12-01 17:05:58 -07:00
meejah
36ed554627 proto -> transport 2022-12-01 17:03:48 -07:00
meejah
3d43cbccc9 log less-specific failures 2022-12-01 17:01:38 -07:00
meejah
c57d1aa8a9 Merge branch 'master' into 3921.exit-on-stdin-close 2022-12-01 16:58:37 -07:00
meejah
7ffcfcdb67
Update src/allmydata/test/test_runner.py
Co-authored-by: Jean-Paul Calderone <exarkun@twistedmatrix.com>
2022-12-01 16:47:40 -07:00
Itamar Turner-Trauring
c93ff23da7 Don't send empty string writes. 2022-12-01 14:54:28 -05:00
Itamar Turner-Trauring
8ed333b171 Correct explanation. 2022-12-01 14:45:45 -05:00
Itamar Turner-Trauring
0ba58070cd Tweaks. 2022-12-01 14:45:39 -05:00
Itamar Turner-Trauring
d4c202307c Better method name. 2022-12-01 14:43:49 -05:00
Itamar Turner-Trauring
17dfda6b5a More direct API. 2022-12-01 14:42:52 -05:00
Fon E. Noel NFEBE
b193ad3ed4 Correct addCleanup reference
Some test_storage.py classes contain calls to cleanup methods
instead of references. This commit fixes that.

Signed-off-by: Fon E. Noel NFEBE <fenn25.fn@gmail.com>
2022-11-30 16:53:22 +01:00
Jean-Paul Calderone
05dfa875a7 Quite a mypy warning about formatting bytes into a string 2022-11-30 09:46:13 -05:00
Jean-Paul Calderone
156954c621 no longer any need to "daisy chain" this value 2022-11-30 09:43:01 -05:00
Jean-Paul Calderone
a11eeaf240 Convert all of the asynchronous functions to use async and await 2022-11-30 09:30:37 -05:00
Jean-Paul Calderone
1acf8604ef Remove the Py2/Py3 compatibility header 2022-11-30 09:30:08 -05:00
Jean-Paul Calderone
5cebe91406 update the module docstring 2022-11-30 09:29:57 -05:00
Jean-Paul Calderone
02aeb68f17 Take care with str vs bytes in the implementation
Also replace the intentional BAD_REQUEST with GONE for this case.
2022-11-29 10:51:07 -05:00
Jean-Paul Calderone
d7fe25f7c7 Correct the assertion about how "not found" should be handled
Behavior verified visually against a live client node:

```
❯ curl -v 'http://localhost:3456/uri/URI:CHK:cmtcxq7hwxvfxan34yiev6ivhy:qvcekmjtoetdcw4kmi7b3rtblvgx7544crnwaqtiewemdliqsokq:1:1:1'
*   Trying 127.0.0.1:3456...
* Connected to localhost (127.0.0.1) port 3456 (#0)
> GET /uri/URI:CHK:cmtcxq7hwxvfxan34yiev6ivhy:qvcekmjtoetdcw4kmi7b3rtblvgx7544crnwaqtiewemdliqsokq:1:1:1 HTTP/1.1
> Host: localhost:3456
> User-Agent: curl/7.83.1
> Accept: */*
>
* Mark bundle as not supporting multiuse
< HTTP/1.1 410 Gone
< X-Frame-Options: DENY
< Referrer-Policy: no-referrer
< Server: TwistedWeb/22.10.0
< Date: Tue, 29 Nov 2022 15:39:47 GMT
< Content-Type: text/plain;charset=utf-8
< Accept-Ranges: bytes
< Content-Length: 294
< ETag: ui2tnwl5lltj5clzpyff42jdce-
<
NoSharesError: no shares could be found. Zero shares usually indicates a corrupt URI, or that no servers were connected, but it might also indicate severe corruption. You should perform a filecheck on this object to learn more.

The full error message is:
* Connection #0 to host localhost left intact
no shares (need 1). Last failure: None
```
2022-11-29 10:49:20 -05:00
Jean-Paul Calderone
920467dcea Treat missing Authorization as the same as empty Authorization 2022-11-29 10:19:01 -05:00
Jean-Paul Calderone
f5b24d51e9 Add a test for missing Authorization 2022-11-29 10:18:57 -05:00
Itamar Turner-Trauring
06b57cd835 Merge remote-tracking branch 'origin/master' into 3939-faster-http-protocol 2022-11-28 11:07:01 -05:00
Itamar Turner-Trauring
aa80c9ef47 Be more robust. 2022-11-28 10:21:59 -05:00
Itamar Turner-Trauring
3ba166c2cb A bit more robust code. 2022-11-28 10:20:12 -05:00
Itamar Turner-Trauring
0f4dc91295 Refactor so internal attributes needn't leak. 2022-11-28 10:12:08 -05:00
Itamar Turner-Trauring
38d7430c57 Simplify. 2022-11-28 10:03:42 -05:00
Itamar Turner-Trauring
2ab8e3e8d2 Cancel timeout on failures too. 2022-11-28 10:02:56 -05:00
Fon E. Noel NFEBE
6b0fa64236 Clean up test_storage.py after refactor
This PR cleans up errorneous changes resulting from
1d85a2c5cf and adds a
few improvements such as calling `super` implementations.

Making sure classes with functions returning deferreds
use `AsyncTestCase`

Signed-off-by: Fon E. Noel NFEBE <fenn25.fn@gmail.com>
2022-11-25 13:36:22 +01:00
Itamar Turner-Trauring
41533f162e Not used anymore. 2022-11-23 10:20:32 -05:00
Itamar Turner-Trauring
3790280264 Documentation. 2022-11-23 10:16:49 -05:00
Itamar Turner-Trauring
fd9e50adf1 Simplify _WriteBuffer slightly. 2022-11-23 10:13:18 -05:00
Itamar Turner-Trauring
d1deda5fdd Unit tests for _WriteBuffer. 2022-11-23 10:09:53 -05:00
Itamar Turner-Trauring
7f1d7d4f46 Better explanation. 2022-11-23 09:53:07 -05:00
Itamar Turner-Trauring
d86d578034 Refactor to make core data structure easier to test in isolation. 2022-11-22 15:17:56 -05:00
Itamar Turner-Trauring
f638aec0af Refactor to use BytesIO. 2022-11-22 14:22:54 -05:00
Itamar Turner-Trauring
a4787ca45e Batch writes much more aggressively. 2022-11-22 14:12:14 -05:00
Itamar Turner-Trauring
c80469b50b Handle the Windows waker too. 2022-11-22 11:55:56 -05:00
Itamar Turner-Trauring
3a613aee70 Try a different approach to timeouts: dynamic, instead of hardcoded. 2022-11-21 12:24:50 -05:00
Fon E. Noel NFEBE
1d85a2c5cf Refactor more test_storage.py classes
As a follow up to commit fbc8baa238
this refactor continues to remove deprecated methods and ensures
test classes either extend `SyncTestCase` or `AsyncTestCase`

Classes refactored:

- `MutableServer`
- `MDMFProxies`
- `Stats`
- `MutableShareFileTests`

Signed-off-by: Fon E. Noel NFEBE <fenn25.fn@gmail.com>
2022-11-20 15:38:08 +01:00
Fon E. Noel NFEBE
4c18890e84 Merge branch 'master' into 3917-refactor-test-storage-py 2022-11-19 23:35:59 +01:00
Itamar Turner-Trauring
8cfdae2ab4 sigh 2022-11-18 15:26:02 -05:00
Itamar Turner-Trauring
aeaced848d Merge remote-tracking branch 'origin/master' into 3940-http-timeouts 2022-11-18 15:25:44 -05:00
Itamar Turner-Trauring
4c0c75a034 Fix DelayedCall leak in tests. 2022-11-18 13:56:54 -05:00
Itamar Turner-Trauring
9b21f1da90 Increase how many statuses are stored. 2022-11-17 11:35:10 -05:00
Itamar Turner-Trauring
d182a2f186 Add the delay to appropriate test. 2022-11-17 11:01:12 -05:00
Itamar Turner-Trauring
097d918a24 Sigh 2022-11-16 13:37:50 -05:00
Itamar Turner-Trauring
3531737347 Make timeouts less aggressive, CI machines are slow? 2022-11-16 10:36:11 -05:00
Itamar Turner-Trauring
2ab172ffca Try to set more aggressive timeouts when testing. 2022-11-16 10:26:29 -05:00
Itamar Turner-Trauring
9f5f287473 Nope, not helpful. 2022-11-16 09:57:39 -05:00
Itamar Turner-Trauring
a20943e10c As an experiment, see if this fixes failing CI. 2022-11-16 09:33:01 -05:00
Itamar Turner-Trauring
2a5e8e5971 Better cleanup. 2022-11-15 15:05:27 -05:00
Itamar Turner-Trauring
30a9877236 Merge branch '3783-storage-client-http' into 3940-http-timeouts 2022-11-15 14:38:48 -05:00
Itamar Turner-Trauring
f3fc426830 Switch to [storage] force_foolscap. 2022-11-15 14:36:14 -05:00
Itamar Turner-Trauring
fb52b4d302 Delete some garbage. 2022-11-15 14:22:30 -05:00
Itamar Turner-Trauring
8e4ac69032 Stop test mode when done. 2022-11-15 14:21:31 -05:00
Itamar Turner-Trauring
4aeb62b66c Use a constant. 2022-11-15 14:16:41 -05:00
Itamar Turner-Trauring
d700163aec Remove no-longer-relevant comment. 2022-11-15 14:14:29 -05:00
Itamar Turner-Trauring
6c80ad5290 Not necessary. 2022-11-15 14:13:50 -05:00
Itamar Turner-Trauring
d1287df629 The short timeout should be specific to the storage client's needs. 2022-11-15 14:02:19 -05:00
meejah
039c1d8037
Update src/allmydata/grid_manager.py
Co-authored-by: Jean-Paul Calderone <exarkun@twistedmatrix.com>
2022-11-09 10:52:42 -07:00
meejah
b2431f3a89
Update src/allmydata/cli/grid_manager.py
Co-authored-by: Jean-Paul Calderone <exarkun@twistedmatrix.com>
2022-11-09 10:46:31 -07:00
Itamar Turner-Trauring
8d678fe3de Increase timeout. 2022-11-07 11:41:50 -05:00
Itamar Turner-Trauring
65a7945fd9 Don't need a connection timeout since we have request-level timeouts. 2022-11-07 11:39:45 -05:00
Itamar Turner-Trauring
2c911eeac1 Make sure everything is using the same clock. 2022-11-07 11:28:36 -05:00
Itamar Turner-Trauring
f8b9607fc2 Finish up limited_content() timeout code. 2022-11-07 11:26:11 -05:00
Itamar Turner-Trauring
ce59ddc1ea Merge branch '3783-storage-client-http' into 3940-http-timeouts 2022-11-07 11:20:54 -05:00
Itamar Turner-Trauring
c4772482ef WIP 2022-11-07 11:19:00 -05:00
Itamar Turner-Trauring
414b463556 Use built-in treq timeout feature. 2022-11-07 09:23:04 -05:00
Itamar Turner-Trauring
1e50e96e24 Update to new test API. 2022-11-03 15:04:41 -04:00
Itamar Turner-Trauring
8bebb09edd Less test-specific way to make test_rref pass. 2022-11-03 14:38:59 -04:00
Itamar Turner-Trauring
262d9d85b9 Switch to using persistent connections in tests too. 2022-11-03 14:32:43 -04:00
Itamar Turner-Trauring
e05136c238 Less aggressive timeout, to try to make tests pass on CI. 2022-11-02 13:13:21 -04:00
Itamar Turner-Trauring
48ae729c0d Don't reuse basedir across tests. 2022-11-02 10:18:23 -04:00
Itamar Turner-Trauring
73271afa65 Merge remote-tracking branch 'origin/master' into 3783-storage-client-http 2022-11-02 09:23:29 -04:00
Itamar Turner-Trauring
1a3e3a86c3 Require latest pycddl, and work around a regression. 2022-10-14 11:27:04 -04:00
Itamar Turner-Trauring
0febc87456 Don't include reactor in comparison. 2022-10-14 10:03:06 -04:00
Itamar Turner-Trauring
e409262e86 Fix some flakes. 2022-10-14 09:50:07 -04:00
Itamar Turner-Trauring
42d3843343 Run test_system with both Foolscap and HTTP storage protocols, plus some
resulting cleanups.
2022-10-14 09:16:59 -04:00
Itamar Turner-Trauring
0f31e3cd4b Leave HTTP off by default for now. 2022-10-13 14:41:59 -04:00
Itamar Turner-Trauring
b80a215ae1 test_rref passes now. 2022-10-13 14:15:10 -04:00
Itamar Turner-Trauring
0d23237b11 Some progress towards passing test_rref. 2022-10-13 13:44:49 -04:00
Itamar Turner-Trauring
435df4923f
Merge branch 'master' into 2916.grid-manager-proposal.6 2022-10-05 10:18:09 -04:00
Itamar Turner-Trauring
8b0ddf406e Make HTTP and Foolscap match in another edge case. 2022-10-04 11:17:19 -04:00
Itamar Turner-Trauring
8190eea489 Fix bug introduced in previous commit. 2022-10-04 11:02:36 -04:00
Itamar Turner-Trauring
ea1d248611 These objects get stored in a context where they need to be hashed, sometimes. 2022-10-04 10:51:43 -04:00
Itamar Turner-Trauring
1294baa82e LoopingCall may already have been stopped. 2022-10-04 10:30:27 -04:00
Itamar Turner-Trauring
fd07c092ed close() is called while writes are still happening. 2022-10-04 10:30:07 -04:00
Itamar Turner-Trauring
8b2884cf3a Make changes work again. 2022-10-04 09:44:30 -04:00
Itamar Turner-Trauring
1ea716c8bf Merge branch '3902-listen-storage-http' into 3783-storage-client-http 2022-10-04 09:22:49 -04:00
Itamar Turner-Trauring
c13be0c89b Try harder to cleanup. 2022-10-04 09:19:48 -04:00
Itamar Turner-Trauring
58247799c1 Fix remaining references to refactored-out-of-existence API. 2022-10-03 11:27:19 -04:00
Itamar Turner-Trauring
3034f35c7b Document type expectations. 2022-10-03 11:24:53 -04:00
Itamar Turner-Trauring
5d53cd4a17 Nicer API. 2022-10-03 11:16:30 -04:00