[tahoe-lafs-trac-stream] [tahoe-lafs] #1824: Tahoe process gone wild

[tahoe-lafs]

#1824: Tahoe process gone wild
--------------------------+--------------------------------
     Reporter:  kpreid    |      Owner:
         Type:  defect    |     Status:  new
     Priority:  critical  |  Milestone:  1.11.0
    Component:  code      |    Version:  1.9.2
   Resolution:            |   Keywords:  hang repair memory
Launchpad Bug:            |
--------------------------+--------------------------------

Comment (by kpreid):

 Had this happen again today. However, slightly different logs — there was
 nothing immediately before the repeating message by timestamp. Here is the
 first repeating message and a couple of its predecessors:

 {{{

 2012-12-25 08:04:08.619Z [-] Unhandled Error
         Traceback (most recent call last):
         Failure: allmydata.interfaces.DownloadStopped: our Consumer called
 stopProducing()

 2012-12-25 08:04:08.677Z [-] Unhandled error in Deferred:
 2012-12-25 08:04:08.677Z [-] Unhandled Error
         Traceback (most recent call last):
           File "/External/Projects/tahoe/support/lib/python2.7/site-
 packages/Nevow-0.10.0-py2.7.egg/nevow/appserver.py", line 163, in
 gotPageContext
             pageContext.tag.renderHTTP, pageContext
           File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py",
 line 133, in maybeDeferred
             result = f(*args, **kw)
           File "/External/Projects/tahoe/src/allmydata/web/filenode.py",
 line 490, in renderHTTP
             d.addCallbacks(_finished, _error)
           File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py",
 line 286, in addCallbacks
             self._runCallbacks()
         --- <exception caught here> ---
           File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py",
 line 542, in _runCallbacks
             current.result = callback(current.result, *args, **kw)
           File "/External/Projects/tahoe/src/allmydata/web/filenode.py",
 line 489, in _error
             eh.renderHTTP_exception(ctx, f)
           File "/External/Projects/tahoe/src/allmydata/web/common.py",
 line 326, in renderHTTP_exception
             return super.renderHTTP_exception(self, ctx, f)
           File "/External/Projects/tahoe/support/lib/python2.7/site-
 packages/Nevow-0.10.0-py2.7.egg/nevow/appserver.py", line 61, in
 renderHTTP_exception
             request.finishRequest( False )
           File "/External/Projects/tahoe/support/lib/python2.7/site-
 packages/Nevow-0.10.0-py2.7.egg/nevow/appserver.py", line 176, in
 finishRequest
             server.Request.finish(self)
           File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/web/http.py",
 line 866, in finish
             "Request.finish called on a request after its connection was
 lost; "
         exceptions.RuntimeError: Request.finish called on a request after
 its connection was lost; use Request.notifyFinish to keep track of this.

 2012-12-25 09:16:06.623Z [-] Unhandled error in Deferred:
 2012-12-25 09:16:06.909Z [-] Unhandled Error
         Traceback (most recent call last):
           File
 "/External/Projects/tahoe/src/allmydata/mutable/retrieve.py", line 610, in
 _download_current_segment
             d = self._process_segment(self._current_segment)
           File
 "/External/Projects/tahoe/src/allmydata/mutable/retrieve.py", line 638, in
 _process_segment
             dl.addErrback(self._validation_or_decoding_failed, [reader])
           File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py",
 line 308, in addErrback
             errbackKeywords=kw)
           File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py",
 line 286, in addCallbacks
             self._runCallbacks()
         --- <exception caught here> ---
           File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py",
 line 542, in _runCallbacks
             current.result = callback(current.result, *args, **kw)
           File
 "/External/Projects/tahoe/src/allmydata/mutable/retrieve.py", line 736, in
 _validation_or_decoding_failed
             self._mark_bad_share(reader.server, reader.shnum, reader, f)
           File
 "/External/Projects/tahoe/src/allmydata/mutable/retrieve.py", line 595, in
 _mark_bad_share
             self.notify_server_corruption(server, shnum, str(f.value))
           File
 "/External/Projects/tahoe/src/allmydata/mutable/retrieve.py", line 938, in
 notify_server_corruption
             rref.callRemoteOnly("advise_corrupt_share",
         exceptions.AttributeError: 'NoneType' object has no attribute
 'callRemoteOnly'
 }}}

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1824#comment:11>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage