[tahoe-lafs-trac-stream] [Tahoe-LAFS] #3038: Many Python 2.7 macOS builds fail with "Too many open files"

[Tahoe-LAFS]

#3038: Many Python 2.7 macOS builds fail with "Too many open files"
---------------------+---------------------------
 Reporter:  exarkun  |          Owner:
     Type:  defect   |         Status:  new
 Priority:  normal   |      Milestone:  undecided
Component:  unknown  |        Version:  1.12.1
 Keywords:           |  Launchpad Bug:
---------------------+---------------------------
 An example from a run on Travis (but note buildbot macOS fails the same
 way):

 {{{
 ===============================================================================
 [ERROR]
 Traceback (most recent call last):
 Failure: foolscap.tokens.RemoteException: <RemoteException around
 '[CopiedFailure instance: Traceback from remote host -- Traceback (most
 recent call last):
   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/twisted/internet/defer.py", line 501, in errback
     self._startRunCallbacks(fail)
   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/twisted/internet/defer.py", line 568, in _startRunCallbacks
     self._runCallbacks()
   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/twisted/internet/defer.py", line 654, in _runCallbacks
     current.result = callback(current.result, *args, **kw)
   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/twisted/internet/defer.py", lin
 -- TRACEBACK ELIDED --
 /defer.py", line 654, in _runCallbacks
     current.result = callback(current.result, *args, **kw)
   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/foolscap/broker.py", line 579, in <lambda>

   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/foolscap/broker.py", line 614, in _doCall

   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/foolscap/referenceable.py", line 59, in doRemoteCall

   File "/Users/travis/build/tahoe-lafs/tahoe-
 lafs/src/allmydata/storage/server.py", line 300, in
 remote_allocate_buckets

   File "/Users/travis/build/tahoe-lafs/tahoe-
 lafs/src/allmydata/storage/immutable.py", line 209, in __init__
     self._sharefile = ShareFile(incominghome, create=True,
 max_size=max_size)
   File "/Users/travis/build/tahoe-lafs/tahoe-
 lafs/src/allmydata/storage/immutable.py", line 53, in __init__
     f = open(self.home, 'wb')
 exceptions.IOError: [Errno 24] Too many open files: u'/Users/travis/build
 /tahoe-lafs/tahoe-
 lafs/_trial_temp/system/SystemTest/test_upload_and_download_convergent/client2/storage/shares/incoming/v7/v7tjbaysgdl3br6ymaek73z5sa/5'
 ]'>
 ])
 ]'>
 allmydata.test.test_system.SystemTest.test_upload_and_download_convergent
 ===============================================================================
 [ERROR]
 Traceback (most recent call last):
 Failure: foolscap.tokens.RemoteException: <RemoteException around
 '[CopiedFailure instance: Traceback from remote host -- Traceback (most
 recent call last):
   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/foolscap/call.py", line 679, in _done

   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/foolscap/call.py", line 60, in complete

   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/twisted/internet/defer.py", line 460, in callback
     self._startRunCallbacks(result)
   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/twisted/internet/defer.py", line 568, in _startRunCallbacks
     self._runCallbacks()
 --- <exception caught here> ---
   File "/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7
 /site-packages/twisted/internet/defer.py", line 654, in _runCallbacks
     current.result = callback(current.result, *args, **kw)
   File "/Users/travis/build/tahoe-lafs/tahoe-
 lafs/src/allmydata/immutable/offloaded.py", line 345, in _start_reading

 exceptions.IOError: [Errno 24] Too many open files: u'/Users/travis/build
 /tahoe-lafs/tahoe-
 lafs/_trial_temp/system/SystemTest/test_upload_and_download_random_key/client0/helper/CHK_incoming/hozcimqmlsb7gxruhdbi3gaz4a'
 ]'>
 allmydata.test.test_system.SystemTest.test_upload_and_download_random_key
 -------------------------------------------------------------------------------
 }}}

 This seems to have begun around the middle of April.

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/3038>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage