meejah
50cdd9bd96
unused
2021-12-04 17:20:10 -07:00
meejah
5bb6fbc51f
merge errors
2021-12-04 10:14:31 -07:00
meejah
18891d9e77
Merge remote-tracking branch 'security/master'
2021-12-02 14:44:59 -07:00
Itamar Turner-Trauring
e2636466b5
Fix a flake.
2021-11-18 15:47:25 -05:00
Itamar Turner-Trauring
5d915afe1c
Clean up BucketWriters on shutdown (also preventing DelayedCalls leaks in tests).
2021-11-18 15:42:54 -05:00
Itamar Turner-Trauring
45c00e93c9
Use clock in BucketWriter.
2021-11-17 11:12:40 -05:00
Itamar Turner-Trauring
92c36a67d8
Use IReactorTime instead of ad-hoc solutions.
2021-11-17 11:01:04 -05:00
meejah
f81e4e2d25
refactor to use serializers / pickle->json upgraders
2021-11-16 15:08:31 -07:00
Jean-Paul Calderone
84c19f5468
clarify renew_leases docs on slot_testv_and_readv_and_writev
2021-11-15 08:12:07 -05:00
Jean-Paul Calderone
ad6017e63d
clarify renew_leases docs on allocate_buckets
2021-11-15 08:11:53 -05:00
Jean-Paul Calderone
85977e48a7
put this comment back and merge info from the two versions
2021-11-12 16:23:15 -05:00
Jean-Paul Calderone
c3cb0ebaea
Switch to per-call parameter for controlling lease renewal behavior
...
This is closer to an implementation where you could have two frontends, say a
Foolscap frontend and an HTTP frontend or even just two different HTTP
frontends, which had different opinions about what the behaviour should be.
2021-11-12 16:20:27 -05:00
Jean-Paul Calderone
2742de6f7c
drop some ancient cruft
...
allocated_size not used anywhere, so why have it
2021-11-10 16:08:53 -05:00
Jean-Paul Calderone
9af81d21c5
add a way to turn off implicit bucket lease renewal too
2021-11-10 16:08:40 -05:00
Jean-Paul Calderone
a71b1d31bf
Merge remote-tracking branch 'upstream/master'
2021-11-04 10:02:54 -04:00
Jean-Paul Calderone
78dbe76994
remove unused import
2021-10-28 15:20:44 -04:00
Jean-Paul Calderone
1b46ac7a24
add MutableShareFile.is_valid_header and use it
2021-10-28 11:38:18 -04:00
Jean-Paul Calderone
66845c9a17
Add ShareFile.is_valid_header and use it instead of manual header inspection
2021-10-28 11:12:20 -04:00
Jean-Paul Calderone
470657b337
Drop corruption advisories if we don't have a matching share
2021-10-23 07:35:05 -04:00
Jean-Paul Calderone
194499aafe
remove unused import
2021-10-22 16:09:54 -04:00
Jean-Paul Calderone
6449ad03de
Do not record corruption advisories if there is no available space
2021-10-22 15:56:45 -04:00
Jean-Paul Calderone
4defc641a2
Have ShareFile only write a new lease if there is room for it
...
StorageServer passes available space down so it can make the decision.
ShareFile has to do it because `add_or_renew_lease` only *sometimes* adds a
lease and only ShareFile knows when that is.
2021-10-22 15:56:45 -04:00
Jean-Paul Calderone
1264c3be1e
Use _add_or_renew_leases helper consistently in StorageServer
...
This will make it easier to add a new argument to the underlying
`add_or_renew_lease` call.
2021-10-22 15:56:45 -04:00
Itamar Turner-Trauring
016d6b4530
Fix spurious type checking error.
2021-09-29 14:10:14 -04:00
Itamar Turner-Trauring
58d7e2f627
Simplify implementation.
2021-09-29 13:58:53 -04:00
Itamar Turner-Trauring
8fb6afee1b
Refactor BucketWriters such that disconnection can be limited Foolscap.
2021-09-29 13:42:17 -04:00
Itamar Turner-Trauring
148a0573de
Replace colon on filename only, not on whole path.
...
This would break Windows logging of corruption reports, since colon would be removed from e.g. "C:".
2021-09-03 13:11:02 -04:00
Itamar Turner-Trauring
7d32335353
Clarify and remove duplication.
2021-08-30 16:49:11 -04:00
Itamar Turner-Trauring
d599568c79
Tests validating that the operation for adding a lease will renew the lease
...
instead if it already exists.
2021-08-19 13:56:13 -04:00
Itamar Turner-Trauring
dfff187ad0
Make time pluggable to support better testing.
2021-08-19 13:23:01 -04:00
Itamar Turner-Trauring
c5a426b797
More unicode-of-bytes fixes.
2021-02-12 11:47:11 -05:00
Itamar Turner-Trauring
a06956632b
More unicode-of-bytes bug fixes.
2021-02-12 11:37:43 -05:00
Jason R. Coombs
5396f9f97e
Replace fixme with reference to foolscap issue.
2020-12-26 12:02:47 -05:00
Jason R. Coombs
6ba7533168
Ignore failure on StorageServer.slot_testv_and_readv_and_writev, the implementation of which deviates from the interface spec substantially.
2020-11-29 14:04:59 -05:00
Itamar Turner-Trauring
5cd00d6f2e
And even more tests passing in Python 3.
2020-09-24 10:55:47 -04:00
Itamar Turner-Trauring
03fd566e2c
Fix flake error.
2020-09-17 12:37:10 -04:00
Itamar Turner-Trauring
e8743a607f
Fix failing tests.
2020-09-16 14:37:16 -04:00
Itamar Turner-Trauring
31aa594290
Looks like float is fine for mean.
2020-09-14 14:47:26 -04:00
Itamar Turner-Trauring
d84a7a61f3
Port to Python 3.
2020-09-14 14:46:08 -04:00
Itamar Turner-Trauring
6957540156
Assert nodeid is bytes, to ease porting.
2020-09-08 14:10:13 -04:00
Itamar Turner-Trauring
1cfe58a52d
All of test_storage passes on Python 3.
2020-08-31 13:17:52 -04:00
Itamar Turner-Trauring
9ce43231b4
More passing tests.
2020-08-27 15:49:04 -04:00
Itamar Turner-Trauring
ff582c5129
Some progress towards running crawler on Python 3.
2020-08-19 11:38:59 -04:00
meejah
6eade15b4e
put WeakKeyDictionary use back
2020-05-05 14:49:16 -06:00
meejah
4c3d0ea6cc
use 'with open' for more file-opens
2020-05-04 21:59:15 -06:00
meejah
4928d62d66
use set instead of WeakKeyDictionary
2020-05-04 21:59:15 -06:00
Jean-Paul Calderone
de8199d3b0
Improve the behavior of get_slot_leases when no shares exist
2019-08-15 11:08:04 -04:00
Jean-Paul Calderone
fce9657ce3
it doesn't matter if any writes happen, only if the test vectors pass
2019-08-14 13:03:58 -04:00
Jean-Paul Calderone
bba8af6be1
note in the docstring about mutable shares
2019-08-14 12:29:26 -04:00
Jean-Paul Calderone
b3741ed3b5
Factor all of the logic into a helper with a flag controlling leases
2019-08-14 12:28:05 -04:00
