id	summary	reporter	owner	description	type	status	priority	milestone	component	version	resolution	keywords	cc	launchpad_bug
3038	"Many Python 2.7 macOS builds fail with ""Too many open files"""	exarkun	exarkun	"An example from a run on Travis (but note buildbot macOS fails the same way):

{{{
===============================================================================
[ERROR]
Traceback (most recent call last):
Failure: foolscap.tokens.RemoteException: <RemoteException around '[CopiedFailure instance: Traceback from remote host -- Traceback (most recent call last):
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/twisted/internet/defer.py"", line 501, in errback
    self._startRunCallbacks(fail)
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/twisted/internet/defer.py"", line 568, in _startRunCallbacks
    self._runCallbacks()
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/twisted/internet/defer.py"", line 654, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/twisted/internet/defer.py"", lin
-- TRACEBACK ELIDED --
/defer.py"", line 654, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/foolscap/broker.py"", line 579, in <lambda>
    
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/foolscap/broker.py"", line 614, in _doCall
    
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/foolscap/referenceable.py"", line 59, in doRemoteCall
    
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/src/allmydata/storage/server.py"", line 300, in remote_allocate_buckets
    
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/src/allmydata/storage/immutable.py"", line 209, in __init__
    self._sharefile = ShareFile(incominghome, create=True, max_size=max_size)
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/src/allmydata/storage/immutable.py"", line 53, in __init__
    f = open(self.home, 'wb')
exceptions.IOError: [Errno 24] Too many open files: u'/Users/travis/build/tahoe-lafs/tahoe-lafs/_trial_temp/system/SystemTest/test_upload_and_download_convergent/client2/storage/shares/incoming/v7/v7tjbaysgdl3br6ymaek73z5sa/5'
]'>
])
]'>
allmydata.test.test_system.SystemTest.test_upload_and_download_convergent
===============================================================================
[ERROR]
Traceback (most recent call last):
Failure: foolscap.tokens.RemoteException: <RemoteException around '[CopiedFailure instance: Traceback from remote host -- Traceback (most recent call last):
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/foolscap/call.py"", line 679, in _done
    
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/foolscap/call.py"", line 60, in complete
    
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/twisted/internet/defer.py"", line 460, in callback
    self._startRunCallbacks(result)
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/twisted/internet/defer.py"", line 568, in _startRunCallbacks
    self._runCallbacks()
--- <exception caught here> ---
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/.tox/py27/lib/python2.7/site-packages/twisted/internet/defer.py"", line 654, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File ""/Users/travis/build/tahoe-lafs/tahoe-lafs/src/allmydata/immutable/offloaded.py"", line 345, in _start_reading
    
exceptions.IOError: [Errno 24] Too many open files: u'/Users/travis/build/tahoe-lafs/tahoe-lafs/_trial_temp/system/SystemTest/test_upload_and_download_random_key/client0/helper/CHK_incoming/hozcimqmlsb7gxruhdbi3gaz4a'
]'>
allmydata.test.test_system.SystemTest.test_upload_and_download_random_key
-------------------------------------------------------------------------------
}}}

This seems to have begun around the middle of April.
"	defect	closed	normal	undecided	unknown	1.12.1	fixed