[tahoe-lafs-trac-stream] [tahoe-lafs] #1875: Hanging on dead reference?

[tahoe-lafs]

#1875: Hanging on dead reference?
--------------------------+------------------------
     Reporter:  nejucomo  |      Owner:  davidsarah
         Type:  defect    |     Status:  new
     Priority:  normal    |  Milestone:  undecided
    Component:  unknown   |    Version:  1.9.2
   Resolution:            |   Keywords:
Launchpad Bug:            |
--------------------------+------------------------

Comment (by nejucomo):

 **Commands and Output**:

 Here are some sanitized cut'n'pastes of the commands described above.

 **{{{tahoe backup}}}**

 The end of the {{{stderr}}} stream of {{{tahoe backup}}} is:

 {{{
 Traceback (most recent call last):
   File "/home/n/virtualenvs/default/bin/tahoe", line 8, in <module>
     load_entry_point('allmydata-tahoe==1.9.2', 'console_scripts',
 'tahoe')()
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/runner.py", line 113, in run
     rc = runner(sys.argv[1:], install_node_control=install_node_control)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/runner.py", line 99, in runner
     rc = cli.dispatch[command](so)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/cli.py", line 569, in backup
     rc = tahoe_backup.backup(options)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/tahoe_backup.py", line 325, in backup
     return bu.run()
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/tahoe_backup.py", line 118, in run
     new_backup_dircap = self.process(options.from_dir)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/tahoe_backup.py", line 188, in process
     childcap = self.process(childpath)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/tahoe_backup.py", line 188, in process
     childcap = self.process(childpath)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/tahoe_backup.py", line 188, in process
     childcap = self.process(childpath)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/tahoe_backup.py", line 194, in process
     childcap, metadata = self.upload(childpath)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/scripts/tahoe_backup.py", line 305, in upload
     raise HTTPError("Error during file PUT", resp)
 allmydata.scripts.common_http.HTTPError: Error during file PUT: 500
 Internal Server Error
 "Traceback (most recent call last):\x0a  File
 \"/home/n/virtualenvs/default/lib/python2.7/site-
 packages/twisted/internet/defer.py\", line 542, in _runCallbacks\x0a
 current.result = callback(current.result, *args, **kw)\x0a  File
 \"/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/util/pipeline.py\", line 121, in _call_finished\x0a
 d.errback(self.failure)\x0a  File
 \"/home/n/virtualenvs/default/lib/python2.7/site-
 packages/twisted/internet/defer.py\", line 388, in errback\x0a
 self._startRunCallbacks(fail)\x0a  File
 \"/home/n/virtualenvs/default/lib/python2.7/site-
 packages/twisted/internet/defer.py\", line 455, in _startRunCallbacks\x0a
 self._runCallbacks()\x0a--- <exception caught here> ---\x0a  File
 \"/home/n/virtualenvs/default/lib/python2.7/site-
 packages/twisted/internet/defer.py\", line 542, in _runCallbacks\x0a
 current.result = callback(current.result, *args, **kw)\x0a  File
 \"/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/immutable/encode.py\", line 501, in
 _remove_shareholder\x0a    raise
 UploadUnhappinessError(msg)\x0aallmydata.interfaces.UploadUnhappinessError:
 shares could be placed or found on only 0 server(s). We were asked to
 place shares on at least 1 server(s) such that any 1 of them have enough
 shares to recover the file.: [Failure instance: Traceback (failure with no
 frames): <class 'allmydata.util.pipeline.PipelineError'>: <PipelineError
 error=([Failure instance: Traceback (failure with no frames): <class
 'foolscap.ipb.DeadReferenceError'>: Connection was lost (to
 tubid=(*REDACTED*)) (during method=RIBucketWriter:write)\x0a])>\x0a]\x0a"
 }}}

 Using python to print the packed string literal shows:

 {{{
 Traceback (most recent call last):
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/twisted/internet/defer.py", line 542, in _runCallbacks
     current.result = callback(current.result, *args, **kw)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/util/pipeline.py", line 121, in _call_finished
     d.errback(self.failure)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/twisted/internet/defer.py", line 388, in errback
     self._startRunCallbacks(fail)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/twisted/internet/defer.py", line 455, in _startRunCallbacks
     self._runCallbacks()
 --- <exception caught here> ---
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/twisted/internet/defer.py", line 542, in _runCallbacks
     current.result = callback(current.result, *args, **kw)
   File "/home/n/virtualenvs/default/lib/python2.7/site-
 packages/allmydata/immutable/encode.py", line 501, in _remove_shareholder
     raise UploadUnhappinessError(msg)
 allmydata.interfaces.UploadUnhappinessError: shares could be placed or
 found on only 0 server(s). We were asked to place shares on at least 1
 server(s) such that any 1 of them have enough shares to recover the file.:
 [Failure instance: Traceback (failure with no frames): <class
 'allmydata.util.pipeline.PipelineError'>: <PipelineError error=([Failure
 instance: Traceback (failure with no frames): <class
 'foolscap.ipb.DeadReferenceError'>: Connection was lost (to
 tubid=(*REDACTED*)) (during method=RIBucketWriter:write)
 ])>
 ]
 }}}

 **tahoe ls**

 The first two invocations just show a {{{KeyboardInterrupt}}} where I
 {{{^C}}}'d them.  The third invocation looks like this:

 {{{
 $ tahoe ls tahoe:
 Error during GET: 410 Gone
 UnrecoverableFileError: the directory (or mutable file) could not be
 retrieved, because there were insufficient good shares. This might
 indicate that no servers were connected, insufficient servers were
 connected, the URI was corrupt, or that shares have been lost due to
 server departure, hard drive failure, or disk corruption. You should
 perform a filecheck on this object to learn more.
 }}}

 The fourth invocation looks like:

 {{{
 $ tahoe ls tahoe:
 (*REDACTED: The names listed are what I expect. *)
 }}}

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1875#comment:1>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage