[volunteergrid2-l] finally able to upload

[erpo41 at gmail.com]

Hi all,

It looks like I'm finally having some luck uploading files into the grid,
so I thought I would share that with the mailing list in case future users
have similar problems. I've always been able to upload small files through
the web interface, but I've never been able to upload a directory full of
larger (~26MB) files successfully. I've tried running

tahoe backup backup-T61p tahoe:

and

tahoe cp -r backup-T61p tahoe:

Both of these commands failed, eventually giving me an error about being
unable to place all of the shares. Nobody was able to figure out why, since
I had N=15, H=13, K=5 and showed connections to 20 out of 20 servers of
which at least 15 had room (i.e. it should have been possible to place all
of the shares).

Now, I'm using the following shell script instead of the above commands:

#!/bin/sh

while true
do find /srv/per-user/eric/backup-T61p/ -type f -exec tahoe cp {}
tahoe:backup-T61p/ \;
sleep 3600
done

Files are appearing at a pretty decent rate (i.e. near my full upstream
bandwidth) inside my tahoe: alias as viewed from the web frontend. I will
email a followup when/if all of my files get uploaded.

If anyone else is having the same problem I had, I would not recommend
using the above script without modification. As it stands, it tries to
upload my entire backup directory with only a one hour delay between
attempts. This is good for testing, but probably would put too much load on
the grid if run indefinitely. If the script works reliably, I intend to
change the delay from one hour to one day.

Thanks,
Eric
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://tahoe-lafs.org/cgi-bin/mailman/private/volunteergrid2-l/attachments/20120722/b58b5138/attachment.html>