[tahoe-dev] bug

[Iantcho Vassilev]

Hello to all,
Hi Zooko,


As a user of the Bigpig tahoe grid and as i promised Zooko i post here
a big i see..

Currently i traced this to non UTF-8 encoding being used on the filenames


The setup is this:
SCP copies directories from a WIndows 7 machine (which uses Bulgarian)
to a linux box..
Which then runs tahoe backup

At first i saw a lot of errors i made my script use CONVMVFS (which
mounts non utf to utf filesystem using fuse)
convmvfs /home/dir/testmount/ -o srcdir=/home/dir2/backup -o icharset=cp1251



then i use:
tahoe backup -v --exclude="*~*" --exclude=".*" /home/dir/testmount XXXXX:XXXXXX


what i get is:

 re-using old directory for '/home/dir/testmount/DESKTOP'
 re-using old directory for '/home/dir/testmount'
Traceback (most recent call last):
  File "/home/dir/allmydata-tahoe-1.9.0/support/bin/tahoe", line 9, in <module>
    load_entry_point('allmydata-tahoe==1.9.0', 'console_scripts', 'tahoe')()
  File "/home/dir/allmydata-tahoe-1.9.0/src/allmydata/scripts/runner.py",
line 113, in run
    rc = runner(sys.argv[1:], install_node_control=install_node_control)
  File "/home/dir/allmydata-tahoe-1.9.0/src/allmydata/scripts/runner.py",
line 99, in runner
    rc = cli.dispatch[command](so)
  File "/home/dir/allmydata-tahoe-1.9.0/src/allmydata/scripts/cli.py",
line 570, in backup
    rc = tahoe_backup.backup(options)
  File "/home/dir/allmydata-tahoe-1.9.0/src/allmydata/scripts/tahoe_backup.py",
line 325, in backup
    return bu.run()
  File "/home/dir/allmydata-tahoe-1.9.0/src/allmydata/scripts/tahoe_backup.py",
line 123, in run
    put_child(archives_url, now, new_backup_dircap)
  File "/home/dir/allmydata-tahoe-1.9.0/src/allmydata/scripts/tahoe_backup.py",
line 57, in put_child
    raise HTTPError("Error during put_child", resp)
allmydata.scripts.common_http.HTTPError: Error during put_child: 500
Internal Server Error
"Traceback (most recent call last):\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/support/lib/python2.7/site-packages/Twisted-10.1.0-py2.7-linux-x86_64.egg/twisted/internet/base.py\",
line 796, in runUntilCurrent\x0a    call.func(*call.args,
**call.kw)\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/support/lib/python2.7/site-packages/foolscap-0.6.2-py2.7.egg/foolscap/eventual.py\",
line 26, in _turn\x0a    cb(*args, **kwargs)\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/support/lib/python2.7/site-packages/Twisted-10.1.0-py2.7-linux-x86_64.egg/twisted/internet/defer.py\",
line 318, in callback\x0a    self._startRunCallbacks(result)\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/support/lib/python2.7/site-packages/Twisted-10.1.0-py2.7-linux-x86_64.egg/twisted/internet/defer.py\",
line 424, in _startRunCallbacks\x0a    self._runCallbacks()\x0a---
<exception caught here> ---\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/support/lib/python2.7/site-packages/Twisted-10.1.0-py2.7-linux-x86_64.egg/twisted/internet/defer.py\",
line 441, in _runCallbacks\x0a    self.result = callback(self.result,
*args, **kw)\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/src/allmydata/mutable/filenode.py\",
line 855, in <lambda>\x0a    self._modify_once(modifier,
first_time))\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/src/allmydata/mutable/filenode.py\",
line 881, in _modify_once\x0a    d = self._try_to_download_data()\x0a
File \"/home/dir/allmydata-tahoe-1.9.0/src/allmydata/mutable/filenode.py\",
line 959, in _try_to_download_data\x0a    d = self._read(c,
fetch_privkey=True)\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/src/allmydata/mutable/filenode.py\",
line 980, in _read\x0a    d = r.download(consumer, offset, size)\x0a
File \"/home/dir/allmydata-tahoe-1.9.0/src/allmydata/mutable/retrieve.py\",
line 237, in download\x0a    self._setup_download()\x0a  File
\"/home/dir/allmydata-tahoe-1.9.0/src/allmydata/mutable/retrieve.py\",
line 277, in _setup_download\x0a    shares =
versionmap[self.verinfo]\x0aexceptions.KeyError: (26,
'\\x86\\x81^&\\xa6_\\t\\xe9\\xce\\xf2J\\xe3t\\xee\\x8c\\x8f\\x16x\\x95\\x83m\\xe9\\xdc\\xc3k\\xe1\\xc2\\xd8?\\xb4<\\x1f',
'\\xbe\\x10\\xa9\\xe0\\xa3\\xe1\\xb0\\xf1\\x12P9\\x91\\x99M\\x90 ',
6695, 6694, 5, 12,
\"\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x1a\\x86\\x81^&\\xa6_\\t\\xe9\\xce\\xf2J\\xe3t\\xee\\x8c\\x8f\\x16x\\x95\\x83m\\xe9\\xdc\\xc3k\\xe1\\xc2\\xd8?\\xb4<\\x1f\\xbe\\x10\\xa9\\xe0\\xa3\\xe1\\xb0\\xf1\\x12P9\\x91\\x99M\\x90
\\x05\\x0c\\x00\\x00\\x00\\x00\\x00\\x00\\x1a'\\x00\\x00\\x00\\x00\\x00\\x00\\x1a&\",
(('enc_privkey', 2162), ('EOF', 3378), ('share_data', 823),
('signature', 399), ('block_hash_tree', 791), ('share_hash_chain',
655)))\x0a"






Any help i will appreciate.


Regards,
ianchov