[tahoe-lafs-trac-stream] [Tahoe-LAFS] #3882: Flaky hypothesis test in test_storage_http

[Tahoe-LAFS]

#3882: Flaky hypothesis test in test_storage_http
--------------------------+-----------------------------------
     Reporter:  itamarst  |      Owner:
         Type:  defect    |     Status:  new
     Priority:  normal    |  Milestone:  HTTP Storage Protocol
    Component:  unknown   |    Version:  n/a
   Resolution:            |   Keywords:
Launchpad Bug:            |
--------------------------+-----------------------------------
Description changed by itamarst:

Old description:

> {{{
> [ERROR]
> Traceback (most recent call last):
> Failure: testtools.testresult.real._StringException: Traceback (most
> recent call last):
>   File
> "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
> /site-packages/twisted/internet/defer.py", line 191, in maybeDeferred
>     result = f(*args, **kwargs)
>   File
> "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
> /site-packages/testtools/testcase.py", line 702, in _run_test_method
>     return self._get_test_method()()
>   File
> "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
> /site-packages/allmydata/test/eliotutil.py", line 171, in
> run_with_logging
>     return test_method(*args, **kwargs)
>   File
> "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
> /site-packages/allmydata/test/test_storage_http.py", line 852, in
> test_read_with_no_range
>     def test_read_with_no_range(self, data_length):
>   File
> "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
> /site-packages/hypothesis/core.py", line 1190, in wrapped_test
>     raise the_error_hypothesis_found
>   File
> "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
> /site-packages/hypothesis/core.py", line 886, in __flaky
>     raise Flaky(message)
> hypothesis.errors.Flaky: Hypothesis
> test_read_with_no_range(self=<allmydata.test.test_storage_http.ImmutableHTTPAPITests.test_read_with_no_range
> id=0x7fcaf2949550>, data_length=77788) produces unreliable results:
> Falsified on the first call but did not on a subsequent one
>

> allmydata.test.test_storage_http.ImmutableHTTPAPITests.test_read_with_no_range
> }}}

New description:

 {{{
 [ERROR]
 Traceback (most recent call last):
 Failure: testtools.testresult.real._StringException: Traceback (most
 recent call last):
   File
 "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
 /site-packages/twisted/internet/defer.py", line 191, in maybeDeferred
     result = f(*args, **kwargs)
   File
 "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
 /site-packages/testtools/testcase.py", line 702, in _run_test_method
     return self._get_test_method()()
   File
 "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
 /site-packages/allmydata/test/eliotutil.py", line 171, in run_with_logging
     return test_method(*args, **kwargs)
   File
 "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
 /site-packages/allmydata/test/test_storage_http.py", line 852, in
 test_read_with_no_range
     def test_read_with_no_range(self, data_length):
   File
 "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
 /site-packages/hypothesis/core.py", line 1190, in wrapped_test
     raise the_error_hypothesis_found
   File
 "/nix/store/qqsbr90v1ag6maa1pn0qnfzr2v6lx1p4-python3-3.7.11-env/lib/python3.7
 /site-packages/hypothesis/core.py", line 886, in __flaky
     raise Flaky(message)
 hypothesis.errors.Flaky: Hypothesis
 test_read_with_no_range(self=<allmydata.test.test_storage_http.ImmutableHTTPAPITests.test_read_with_no_range
 id=0x7fcaf2949550>, data_length=77788) produces unreliable results:
 Falsified on the first call but did not on a subsequent one


 allmydata.test.test_storage_http.ImmutableHTTPAPITests.test_read_with_no_range
 }}}

 **Update:** After some digging (see comments) the issue seems to be that
 the CI Hypothesis profile is not being enabled in the Nix builders. This
 may be an issue in other builders as well.

--

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/3882#comment:9>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage