[volunteergrid2-l] speeds again, and missing files
erpo41 at gmail.com
erpo41 at gmail.com
Wed Apr 18 23:28:06 UTC 2012
Here's a stack trace from the most recent error. Although most uploads
proceed without errors (just very slowly).
eric at io:/srv/per-user/eric$ tahoe backup backup-T61p/ tahoe:
Traceback (most recent call last):
File "/home/eric/allmydata-tahoe-1.9.1/support/bin/tahoe", line 9, in
<module>
load_entry_point('allmydata-tahoe==1.9.1', 'console_scripts', 'tahoe')()
File
"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/scripts/runner.py",
line 113, in run
rc = runner(sys.argv[1:], install_node_control=install_node_control)
File
"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/scripts/runner.py",
line 99, in runner
rc = cli.dispatch[command](so)
File
"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/scripts/cli.py",
line 569, in backup
rc = tahoe_backup.backup(options)
File
"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/scripts/tahoe_backup.py",
line 325, in backup
return bu.run()
File
"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/scripts/tahoe_backup.py",
line 118, in run
new_backup_dircap = self.process(options.from_dir)
File
"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/scripts/tahoe_backup.py",
line 194, in process
childcap, metadata = self.upload(childpath)
File
"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/scripts/tahoe_backup.py",
line 305, in upload
raise HTTPError("Error during file PUT", resp)
allmydata.scripts.common_http.HTTPError: Error during file PUT: 500
Internal Server Error
"Traceback (most recent call last):\x0a File
\"/home/volunteergrid2/allmydata-tahoe-1.9.1/support/lib/python2.6/site-packages/Twisted-12.0.0-py2.6-linux-i686.egg/twisted/internet/defer.py\",
line 551, in _runCallbacks\x0a current.result = callback(current.result,
*args, **kw)\x0a File
\"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/util/pipeline.py\",
line 121, in _call_finished\x0a d.errback(self.failure)\x0a File
\"/home/volunteergrid2/allmydata-tahoe-1.9.1/support/lib/python2.6/site-packages/Twisted-12.0.0-py2.6-linux-i686.egg/twisted/internet/defer.py\",
line 397, in errback\x0a self._startRunCallbacks(fail)\x0a File
\"/home/volunteergrid2/allmydata-tahoe-1.9.1/support/lib/python2.6/site-packages/Twisted-12.0.0-py2.6-linux-i686.egg/twisted/internet/defer.py\",
line 464, in _startRunCallbacks\x0a self._runCallbacks()\x0a---
<exception caught here> ---\x0a File
\"/home/volunteergrid2/allmydata-tahoe-1.9.1/support/lib/python2.6/site-packages/Twisted-12.0.0-py2.6-linux-i686.egg/twisted/internet/defer.py\",
line 551, in _runCallbacks\x0a current.result = callback(current.result,
*args, **kw)\x0a File
\"/home/volunteergrid2/allmydata-tahoe-1.9.1/src/allmydata/immutable/encode.py\",
line 501, in _remove_shareholder\x0a raise
UploadUnhappinessError(msg)\x0aallmydata.interfaces.UploadUnhappinessError:
shares could be placed on only 12 server(s) such that any 5 of them have
enough shares to recover the file, but we were asked to place shares on at
least 13 such servers.: [Failure instance: Traceback (failure with no
frames): <class 'allmydata.util.pipeline.PipelineError'>: <PipelineError
error=([Failure instance: Traceback (failure with no frames): <class
'foolscap.ipb.DeadReferenceError'>: Connection was lost (to tubid=oted)
(during method=RIBucketWriter:write)\x0a])>\x0a]\x0a"
On Wed, Apr 18, 2012 at 12:26 PM, Shawn Willden <shawn at willden.org> wrote:
> A good start would be to get stack traces from when the errors occur.
>
>
> On Wed, Apr 18, 2012 at 12:20 PM, erpo41 at gmail.com <erpo41 at gmail.com>wrote:
>
>> How do we do this?
>>
>>
>> On Tue, Apr 17, 2012 at 9:08 PM, Shawn Willden <shawn at willden.org> wrote:
>>
>>> I haven't seen these problems. We should look into them more deeply and
>>> figure out what's going on.
>>>
>>>
>>> On Tue, Apr 17, 2012 at 7:13 PM, Billy Earney <billy.earney at gmail.com>wrote:
>>>
>>>> I've had issues too with the grid, many uncorridnatioed writes, and
>>>> errors while deep checking, which terminates the leasing process. I've
>>>> lost some files on the grid (luckily, I've had copies elsewhere). Do
>>>> others have the same experience, and if not, what are some good practices I
>>>> should start using?
>>>>
>>>> Thanks!
>>>>
>>>> On Tue, Apr 17, 2012 at 7:58 PM, erpo41 at gmail.com <erpo41 at gmail.com>wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I just checked my recent upload and download activity, and I found the
>>>>> following:
>>>>>
>>>>> - Timings:
>>>>> - File Size: 26257857 bytes
>>>>> - Total: 4 hours (1.6kBps)
>>>>> - Storage Index: 293ms (89.56MBps)
>>>>> - [Contacting Helper]:
>>>>> - [Helper Already-In-Grid Check]:
>>>>> - [Upload Ciphertext To Helper]: ()
>>>>> - Peer Selection: 12 seconds
>>>>> - Encode And Push: 4 hours (1.6kBps)
>>>>> - Cumulative Encoding: 2.53s (10.37MBps)
>>>>> - Cumulative Pushing: 4 hours (1.6kBps)
>>>>> - Send Hashes And Close: 33 seconds
>>>>> - [Helper Total]:
>>>>>
>>>>> Does 1.6kBps sound about right?
>>>>>
>>>>> Also, I've been using the command "tahoe backup backup-T61p tahoe:".
>>>>> When I use the WUI to navigate to the writecap associated with tahoe:, it
>>>>> shows the only entry in the directory is another directory called Archive.
>>>>> The Archive directory is empty, even though I've been uploading files
>>>>> (according to upload activity log). What gives?
>>>>>
>>>>> Thanks,
>>>>> Eric
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> volunteergrid2-l mailing list
>>>>> volunteergrid2-l at tahoe-lafs.org
>>>>> https://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>>>>> http://bigpig.org/twiki/bin/view/Main/WebHome
>>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> volunteergrid2-l mailing list
>>>> volunteergrid2-l at tahoe-lafs.org
>>>> https://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>>>> http://bigpig.org/twiki/bin/view/Main/WebHome
>>>>
>>>
>>>
>>>
>>> --
>>> Shawn
>>>
>>> _______________________________________________
>>> volunteergrid2-l mailing list
>>> volunteergrid2-l at tahoe-lafs.org
>>> https://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>>> http://bigpig.org/twiki/bin/view/Main/WebHome
>>>
>>
>>
>> _______________________________________________
>> volunteergrid2-l mailing list
>> volunteergrid2-l at tahoe-lafs.org
>> https://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>> http://bigpig.org/twiki/bin/view/Main/WebHome
>>
>
>
>
> --
> Shawn
>
> _______________________________________________
> volunteergrid2-l mailing list
> volunteergrid2-l at tahoe-lafs.org
> https://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
> http://bigpig.org/twiki/bin/view/Main/WebHome
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://tahoe-lafs.org/cgi-bin/mailman/private/volunteergrid2-l/attachments/20120418/22c59215/attachment-0001.html>
More information about the volunteergrid2-l
mailing list