Itamar Turner-Trauring
5baf63219d
Always use UTF-8 for corruption reports.
2022-03-10 17:41:28 -05:00
Itamar Turner-Trauring
922ee4feb1
Sketch of advise_corrupt_share support for immutables.
2022-03-10 11:09:45 -05:00
Itamar Turner-Trauring
587a510b06
Note a better way to implement this.
2022-01-20 12:38:01 -05:00
Itamar Turner-Trauring
2b6e1285e7
Merge remote-tracking branch 'origin/master' into 3849-refactor-out-foolscap-in-storage-server
2021-12-09 13:37:37 -05:00
Jean-Paul Calderone
5f6579d446
hew closer to security/master version of these lines
2021-12-06 12:52:31 -05:00
meejah
50cdd9bd96
unused
2021-12-04 17:20:10 -07:00
meejah
5bb6fbc51f
merge errors
2021-12-04 10:14:31 -07:00
Itamar Turner-Trauring
90f8480cf0
Make more of the unittests pass again with the StorageServer factoring.
2021-12-03 13:39:53 -05:00
meejah
18891d9e77
Merge remote-tracking branch 'security/master'
2021-12-02 14:44:59 -07:00
Itamar Turner-Trauring
8c3d61a94e
Bit more backwards compatible.
2021-12-02 10:49:23 -05:00
Itamar Turner-Trauring
476c41e49e
Split out Foolscap code from BucketReader/Writer.
2021-12-02 10:29:52 -05:00
Itamar Turner-Trauring
f7cb4d5c92
Hook up the new FoolscapStorageServer, and fix enough bugs, such that almost all
...
end-to-end and integration tests pass.
2021-12-02 10:07:14 -05:00
Itamar Turner-Trauring
50e21a9034
Split StorageServer into generic part and Foolscap part.
2021-12-01 09:55:44 -05:00
Itamar Turner-Trauring
e2636466b5
Fix a flake.
2021-11-18 15:47:25 -05:00
Itamar Turner-Trauring
5d915afe1c
Clean up BucketWriters on shutdown (also preventing DelayedCalls leaks in tests).
2021-11-18 15:42:54 -05:00
Itamar Turner-Trauring
45c00e93c9
Use clock in BucketWriter.
2021-11-17 11:12:40 -05:00
Itamar Turner-Trauring
92c36a67d8
Use IReactorTime instead of ad-hoc solutions.
2021-11-17 11:01:04 -05:00
meejah
f81e4e2d25
refactor to use serializers / pickle->json upgraders
2021-11-16 15:08:31 -07:00
Jean-Paul Calderone
84c19f5468
clarify renew_leases docs on slot_testv_and_readv_and_writev
2021-11-15 08:12:07 -05:00
Jean-Paul Calderone
ad6017e63d
clarify renew_leases docs on allocate_buckets
2021-11-15 08:11:53 -05:00
Jean-Paul Calderone
85977e48a7
put this comment back and merge info from the two versions
2021-11-12 16:23:15 -05:00
Jean-Paul Calderone
c3cb0ebaea
Switch to per-call parameter for controlling lease renewal behavior
...
This is closer to an implementation where you could have two frontends, say a
Foolscap frontend and an HTTP frontend or even just two different HTTP
frontends, which had different opinions about what the behaviour should be.
2021-11-12 16:20:27 -05:00
Jean-Paul Calderone
2742de6f7c
drop some ancient cruft
...
allocated_size not used anywhere, so why have it
2021-11-10 16:08:53 -05:00
Jean-Paul Calderone
9af81d21c5
add a way to turn off implicit bucket lease renewal too
2021-11-10 16:08:40 -05:00
Jean-Paul Calderone
a71b1d31bf
Merge remote-tracking branch 'upstream/master'
2021-11-04 10:02:54 -04:00
Jean-Paul Calderone
78dbe76994
remove unused import
2021-10-28 15:20:44 -04:00
Jean-Paul Calderone
1b46ac7a24
add MutableShareFile.is_valid_header and use it
2021-10-28 11:38:18 -04:00
Jean-Paul Calderone
66845c9a17
Add ShareFile.is_valid_header and use it instead of manual header inspection
2021-10-28 11:12:20 -04:00
Jean-Paul Calderone
470657b337
Drop corruption advisories if we don't have a matching share
2021-10-23 07:35:05 -04:00
Jean-Paul Calderone
194499aafe
remove unused import
2021-10-22 16:09:54 -04:00
Jean-Paul Calderone
6449ad03de
Do not record corruption advisories if there is no available space
2021-10-22 15:56:45 -04:00
Jean-Paul Calderone
4defc641a2
Have ShareFile only write a new lease if there is room for it
...
StorageServer passes available space down so it can make the decision.
ShareFile has to do it because `add_or_renew_lease` only *sometimes* adds a
lease and only ShareFile knows when that is.
2021-10-22 15:56:45 -04:00
Jean-Paul Calderone
1264c3be1e
Use _add_or_renew_leases helper consistently in StorageServer
...
This will make it easier to add a new argument to the underlying
`add_or_renew_lease` call.
2021-10-22 15:56:45 -04:00
Itamar Turner-Trauring
016d6b4530
Fix spurious type checking error.
2021-09-29 14:10:14 -04:00
Itamar Turner-Trauring
58d7e2f627
Simplify implementation.
2021-09-29 13:58:53 -04:00
Itamar Turner-Trauring
8fb6afee1b
Refactor BucketWriters such that disconnection can be limited Foolscap.
2021-09-29 13:42:17 -04:00
Itamar Turner-Trauring
148a0573de
Replace colon on filename only, not on whole path.
...
This would break Windows logging of corruption reports, since colon would be removed from e.g. "C:".
2021-09-03 13:11:02 -04:00
Itamar Turner-Trauring
7d32335353
Clarify and remove duplication.
2021-08-30 16:49:11 -04:00
Itamar Turner-Trauring
d599568c79
Tests validating that the operation for adding a lease will renew the lease
...
instead if it already exists.
2021-08-19 13:56:13 -04:00
Itamar Turner-Trauring
dfff187ad0
Make time pluggable to support better testing.
2021-08-19 13:23:01 -04:00
Itamar Turner-Trauring
c5a426b797
More unicode-of-bytes fixes.
2021-02-12 11:47:11 -05:00
Itamar Turner-Trauring
a06956632b
More unicode-of-bytes bug fixes.
2021-02-12 11:37:43 -05:00
Jason R. Coombs
5396f9f97e
Replace fixme with reference to foolscap issue.
2020-12-26 12:02:47 -05:00
Jason R. Coombs
6ba7533168
Ignore failure on StorageServer.slot_testv_and_readv_and_writev, the implementation of which deviates from the interface spec substantially.
2020-11-29 14:04:59 -05:00
Itamar Turner-Trauring
5cd00d6f2e
And even more tests passing in Python 3.
2020-09-24 10:55:47 -04:00
Itamar Turner-Trauring
03fd566e2c
Fix flake error.
2020-09-17 12:37:10 -04:00
Itamar Turner-Trauring
e8743a607f
Fix failing tests.
2020-09-16 14:37:16 -04:00
Itamar Turner-Trauring
31aa594290
Looks like float is fine for mean.
2020-09-14 14:47:26 -04:00
Itamar Turner-Trauring
d84a7a61f3
Port to Python 3.
2020-09-14 14:46:08 -04:00
Itamar Turner-Trauring
6957540156
Assert nodeid is bytes, to ease porting.
2020-09-08 14:10:13 -04:00
