Commit Graph

7191 Commits

Author SHA1 Message Date
Jean-Paul Calderone
6e4c4b7abc Convert status.py over to MultiFormatPage 2017-07-27 13:57:02 -04:00
Jean-Paul Calderone
5a30bd6169 Convert introweb.py over to MultiFormatPage 2017-07-27 13:57:02 -04:00
Jean-Paul Calderone
0581ce7270 Convert directory.py over to MultiFormatPage 2017-07-27 13:57:02 -04:00
Jean-Paul Calderone
7c8c63a01f a helper for the ?t=json resources 2017-07-27 13:57:02 -04:00
Jean-Paul Calderone
7cad9e1b5d Merge PR432: improve servers of happiness integration test
The node creation helper used by the integration tests is now more careful about how it tweaks additional configuration file fields.  Previously, it could easily clobber certain settings.  Now it should only introduce the specific changes it intends.
Closes ticket:2895
2017-07-27 12:18:42 -04:00
Jean-Paul Calderone
b481fc46f6 go back to happy=7
now that there are only 5 storage servers instead of 8 as expected
2017-07-26 11:30:02 -04:00
Jean-Paul Calderone
86b48960e3 pyflakes cleanups 2017-07-26 11:29:47 -04:00
Jean-Paul Calderone
dece729857 refactor to remove unnecessary negation
also add missing import!
2017-07-26 11:29:15 -04:00
Jean-Paul Calderone
a8917d553c rewrite the config file more safely
use cli options for whatever we can
use the config apis for the other thing

this avoids clobbering configuration we don't know about -
such as the storage=False setting (which made all nodes storage servers).
2017-07-26 10:49:43 -04:00
Brian Warner
1d1653d361 Merge branch '2857-deprecations' 2017-07-23 12:00:03 -05:00
Brian Warner
ad92b2b9b2 test_web: replace HEAD/PUT/DELETE with treq 2017-07-12 17:10:49 -07:00
Brian Warner
486fca0d5c web.test_introducer: replace getPage with treq 2017-07-12 17:10:49 -07:00
Brian Warner
8be5072fca test_system: replace getPage with treq 2017-07-12 17:10:49 -07:00
Brian Warner
2ec3791411 test_deepcheck: replace t.w.client.getPage with treq 2017-07-12 17:10:46 -07:00
Brian Warner
dc6398d265 setup.py: depend on 'treq' for [test] 2017-07-12 17:07:27 -07:00
Brian Warner
74e7ef4b98 test_happiness: limit string sizes to 30 chars
I think these are supposed to represent share ids or server ids, so we don't
need to exercise them being too huge.
2017-07-12 16:37:44 -07:00
Brian Warner
11c39325fb test_happiness: suppress the hypothesis 'too_slow' check
I was seeing buildbot failures where the host machine was too busy, and
hypothesis was spooked into thinking that data generation was too slow.
2017-07-12 16:27:13 -07:00
Brian Warner
1f11679025 Merge PR 423: change travis to use 'trusty' instead of 'precise'
This should be good for another two years, until trusty (14.04 LTS) is
end-of-lifed in april 2019.
2017-07-12 11:38:05 -07:00
Brian Warner
e7deb2c80f integration/install-tor.sh: use trusty instead of precise 2017-07-12 09:36:50 -07:00
Brian Warner
14c03793b5 travis: switch from EOLed 'precise' to 'trusty'
closes ticket:2888
2017-07-12 09:10:10 -07:00
Brian Warner
11ae1dcc2b .gitignore: add .hypothesis/ 2017-06-06 19:04:58 +01:00
Brian Warner
b8010ad0a7 Merge PR403: test "tahoe list-aliases --readonly-uri"
Closes tahoe-lafs/tahoe-lafs#403
Closes ticket:2863
2017-06-06 18:04:57 +01:00
meejah
0977e52cbf Add a test for 'tahoe list-aliases --readonly-uri' 2017-06-06 18:03:05 +01:00
Brian Warner
2cad19961f Merge PR380: LAFS = "Least-Authority File Store"
Closes tahoe-lafs/tahoe-lafs#380
refs ticket:2345
2017-06-06 18:01:52 +01:00
Brian Warner
705dc856eb grammatical improvements 2017-06-06 11:28:23 +01:00
Daira Hopwood
eb1b51e263 Clean up some remaining obsolete terminology. refs #2345
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2017-06-06 11:20:49 +01:00
Daira Hopwood
d3acf82776 Rename FilesystemOptions to FileStoreOptions. refs #2345
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2017-06-06 11:20:49 +01:00
Daira Hopwood
2055a66cf2 Doc changes that require more careful review. refs #2345
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2017-06-06 11:20:49 +01:00
Daira Hopwood
4723af6e2f LAFS now stands for "Least-Authority File Store" rather than "Least-Authority File System". refs #2345
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
2017-06-06 11:20:49 +01:00
Brian Warner
958f79d47f Merge PR420: INSTALL.rst should suggest libyaml-dev
Ideally this wouldn't be necessary: PyYAML looks like it has a pure-python
implementation. But it also has a binding to the C libyaml library, and if it
decides to use that, then the headers need to be installed.

Closes tahoe-lafs/tahoe-lafs#420
2017-06-06 10:26:26 +01:00
Brian Warner
bc34556e1a INSTALL.rst: reorder deps 2017-06-06 10:26:11 +01:00
ValdikSS
718835e08c Update INSTALL.rst 2017-06-06 10:25:21 +01:00
Brian Warner
53130c69c0 Merge PR416: immutable upload now uses happiness-metric algorithm
Closes ticket:1382
2017-06-06 00:04:10 +01:00
meejah
05f48c3601 Various cleanups, fixes and improvements
Squashed all commits that were meejah's between
30d68fb499f300a393fa0ced5980229f4bb6efda
and
33c268ed3a8c63a809f4403e307ecc13d848b1ab
On the branch meejah:1382.markberger-rewrite-rebase.6 as
per review
2017-06-05 16:31:41 -06:00
David Stainton
19c5bbb43b Fix test test_lost_servers
Remove old hypothesis tests

Fix allmydata.test.cli.test_cli.Errors.test_get

this was broken due to differing share placements
whereas we need to allow this.

Fix test_5_overdue_immutable

This change makes the test not depend on the value
of PYTHONHASHSEED.

Revert "Fix test_5_overdue_immutable"

This reverts commit 5f3696d9a53e7df8781a2c463c7112282397cd69.

fix test to actually hang the first 5 *servers*

sort keys for stable output

use file-context-managers

remove probably-unneeded assert (that fails sometimes)

another non-deterministic test?
2017-06-05 16:26:46 -06:00
meejah
56f6dbd363 distribute only to read/write peers
correctly calculate happiness

guard with except

fix tests, and happiness calculation

remove debug

fix placements to None

happiness calc shouldn't have to filter None

WIP fixing some tests etc
2017-06-05 16:26:46 -06:00
David Stainton
a611673934 Make a correction to a hypothesis test comment
Comment out all debug print statements

Add hypothesis tests for the old servers of happiness implementation

Attempt to speed up meejah's servers of happiness

WIP

Fix test_calc_happy

WIP
2017-06-05 16:26:46 -06:00
meejah
b6d9945b95 default answer for every share
refactor hypothesis to be 'pytest style' and add another one

get rid of 'shares->set(1 thing)' in generate_mappings return

Add a unittest hypothesis came up with

fix tests since we return peers, not sets-of-1-peer

add more debug

add a unit-test that's like test_problem_layout_ticket_1128

fix bug

add a note

fix utest

unit-test for bigger numbers

re-insert markberger code for testing

results of pairing with david
2017-06-05 16:26:46 -06:00
David Stainton
e68b331bb1 Add servers of happiness hypothesis testing
Fix happiness test var names

Remove unused imports

Get rid of trailing whitespace
2017-06-05 16:26:46 -06:00
meejah
ef17ef2c62 fix happiness calculation
unit-test for happiness calculation

unused function

put old servers_of_happiness() calculation back for now

test for calculate_happiness

remove some redundant functions
2017-06-05 16:26:46 -06:00
David Stainton
42011e775d Make correction to docstring for Tahoe2ServerSelector's _handle_existing_response
Add comments 10 and 8 from the servers of happiness spec

Fix bug in _filter_g3 for servers of happiness

Remove usage of HappinessUpload class

here we modifying the PeerSelector class.
we make sure to correctly calculate the happiness value
by ignoring keys who's value are None...

Remove HappinessUpload and tests

Replace helper servers_of_happiness

we replace it's previous implementation with a new
wrapper function that uses share_placement
2017-06-05 16:26:46 -06:00
meejah
adb9a98383 WIP: refactoring (squahshed all meejah's commits) 2017-06-05 16:26:46 -06:00
Brian Warner
211dc602fa updates from summit 2017-06-05 16:26:46 -06:00
Mark Berger
17cff7a176 Implements 'Servers of Happiness' algorithm for upload
This is Mark Berger's original commits, from ticket #1382
2017-06-05 16:26:46 -06:00
Brian Warner
42d8a79c9d Merge PR419: update docs: OpenSolaris->Illumos
closes #419
2017-06-05 10:35:59 +01:00
tpltnt
2af8e69750 OpenSolaris is discontinued, naming illumos 2017-06-05 10:35:37 +01:00
meejah
b0e291b431 remove comment to kick builders 2017-04-26 15:27:06 -06:00
meejah
a5095bbce5 Merge pull request #414 from tpltnt/enforce-py2-setup
enforce Python 2.7 during installation
2017-04-25 14:57:01 -06:00
tpltnt
c0888de394 raise RuntimeError if not Python 2 2017-04-21 00:36:16 +02:00
meejah
7376e563ec Merge pull request #411 from tpltnt/packages-hint
added instruction for missing dependencies
2017-04-18 12:17:08 -06:00