[volunteergrid2-l] verifying completeness of uploads

[erpo41 at gmail.com]

I'm willing to trust the part of tahoe that won't upload a file into the
grid if it's already present. I'm not willing to trust the part of tahoe
that will upload a file into the grid if it isn't already there.

The problem is that my uploads randomly fail (or, fail in a way I can't
predict) a sizable percentage of the time, so just uploading all of my
files again wouldn't guarantee that every single file actually gets to the
grid. I'm looking for a tool to compare a local directory to a dircap and
either output an "OK" if they match, or list problems if they don't match.

Thanks,
Eric


On Sat, Aug 25, 2012 at 8:51 PM, Shawn Willden <shawn at willden.org> wrote:

> Depends on what you mean by "verify".  If you trust Tahoe to work
> correctly, then just attempting to upload again (perhaps blowing away the
> sqlite database to force a re-hash of everything) will do it, because if
> the hash is the same it won't upload again.
>
> Another option that comes to mind is to pick some files at random to
> download then verify yourself that they're identical in whatever way seems
> good to you (I'd just use shasum, but I have great faith in hashes).
>
> Perhaps others will have better suggestions.
>
> On Sat, Aug 25, 2012 at 11:35 AM, erpo41 at gmail.com <erpo41 at gmail.com>wrote:
>
>> Hi all,
>>
>> I've nearly finished uploading my backup files into the grid. Now I am
>> starting to wonder how I can check whether the files in the grid exactly
>> match the files I uploaded. Any ideas?
>>
>> Thanks,
>> Eric
>>
>>
>> _______________________________________________
>> volunteergrid2-l mailing list
>> volunteergrid2-l at tahoe-lafs.org
>> https://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>> http://bigpig.org/twiki/bin/view/Main/WebHome
>>
>
>
>
> --
> Shawn
>
> _______________________________________________
> volunteergrid2-l mailing list
> volunteergrid2-l at tahoe-lafs.org
> https://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
> http://bigpig.org/twiki/bin/view/Main/WebHome
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://tahoe-lafs.org/cgi-bin/mailman/private/volunteergrid2-l/attachments/20120825/ff360f53/attachment.html>