[volunteergrid2-l] adding files to the grid

[Billy Earney]

Steve, I also upgraded to version 1.8.2.  I notice that your response time
is now less than a second, so that is a good thing.  I'm still getting
around 30KBps for upload speeds for each file, which is way to slow.  I
still haven't figured out a way to see the upload speed for each node for a
regular sized file (> 1 MB).

Does anyone know where I can find this information? (zooko, do you know)?


Thinking about this, maybe I can find a unix tool that will tell me the open
sockets and how much bandwidth each is taking at any given time..   Will let
you all know the tool, and how it works, once I find it.

After I figure this out, I think about creating  a page on our wiki that
describes some of the things that can be done to figure out bottlenecks,
such as the one I'm trying to diagnosis..


-----Original Message-----
From: volunteergrid2-l-bounces at tahoe-lafs.org
[mailto:volunteergrid2-l-bounces at tahoe-lafs.org] On Behalf Of Steve Dodson
Sent: Wednesday, March 02, 2011 5:52 PM
To: a small group of people sharing storage resources with Tahoe-LAFS
Subject: Re: [volunteergrid2-l] adding files to the grid

Not sure whether or not this was helpful (probably not), but I upgraded 
rhp997 to 1.8.2.  I checked the shares directory and I show several new 
files (timestamped > 4:20pm today)...someone appears to be adding shares?

On 03/02/2011 03:39 PM, Billy Earney wrote:
> Steve,
>
> 9am this morning is the last time I saw your server..  My process is
> currently loading larger files (a few hundred MB per file) and at
> 50kbps, its taking a few hours per file.   I'm guessing in the next
> hour, another file will be uploaded and I can see if your server
> participates in the upload.
>
> Below is some stats for the last time my machine uploaded shares to your
> machine.
>
>     * Timings:
>           o Total: 2 minutes
>                 + Initial Queries: 7.8ms
>                 + Cumulative Verify: 3.3ms
>           o Per-Server Response Times:
>                 + [gbytbnxw]: 2.41s
>                 + [g4xvpwqa]: 2 minutes
>                 + [jbrse33y]: 2.03s
>                 + [pmitrhwg]: 2.27s
>                 + [qivwuhf6]: 2.33s
>                 + [vifimgiw]: 25ms
>                 + [voej6qtg]: 2.30s
>
>
>
>
> On Wed, Mar 2, 2011 at 8:27 AM, Zooko O'Whielacronx <zooko at zooko.com
> <mailto:zooko at zooko.com>> wrote:
>
>     On Wed, Mar 2, 2011 at 6:57 AM, Billy Earney <billy.earney at gmail.com
>     <mailto:billy.earney at gmail.com>> wrote:
>      >
>      > I want to thank you for the help last night on IRC,  I had to go,
>     so I
>      > couldn't wait for you to return..  Looking at the stats from the
>     recent
>      > upload and download operations, it looks like the encoding is
>     doing about
>      > 10MBps (which is very good), but the uploading portion is only
>     doing around
>      > 30Kbps, so it looks like the upload is the bottleneck.  My upload
>     speed is
>      > near (1Mbps), I checked this on speedtest.net
>     <http://speedtest.net>, and it seems to be accurate.
>      > I don't expect to get 1Mbps upload speed with tahoe-lafs since it
>     has some
>      > extra overhead, but I would expect at least 200KBps or so.
>
>     Cool! I think those stats should show you details about which servers
>     you were uploading to and how each one performed. I suspect that there
>     is one server which is accepting data very slowly.
>
>     The uploader uploads to the servers in parallel, so it proceeds at
>     exactly the speed of the slowest server.
>
>     Regards,
>
>     Zooko
>     _______________________________________________
>     volunteergrid2-l mailing list
>     volunteergrid2-l at tahoe-lafs.org
<mailto:volunteergrid2-l at tahoe-lafs.org>
>     http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>     http://bigpig.org/twiki/bin/view/Main/WebHome
>
>
>
>
> _______________________________________________
> volunteergrid2-l mailing list
> volunteergrid2-l at tahoe-lafs.org
> http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
> http://bigpig.org/twiki/bin/view/Main/WebHome

-- 

soli Deo gloria
_______________________________________________
volunteergrid2-l mailing list
volunteergrid2-l at tahoe-lafs.org
http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
http://bigpig.org/twiki/bin/view/Main/WebHome