[volunteergrid2-l] adding files to the grid

Chris Brown volunteergrid2 at vpxp.com
Wed Mar 2 16:18:38 PST 2011


While not directly answering your question, it might be good practice to 
run ntop on the node.

Perhaps allow others access to.

This would help determine the node's max upload/download speed (peaks on 
charts) as well as how busy it was with other traffic at the time your 
were uploading your file.

http://www.ntop.org/overview.html

Chris Brown
Arrival Telecom, Inc.


On 3/2/2011 5:04 PM, Billy Earney wrote:
> I can see that shares are being added to your server, but for regular 
> files I have not found a way to see which server(s) are causing the 
> bottleneck.  From map update files (not sure what they are) it shows 
> stats per server, but regular file uploads do not go into that detail 
> (it only shows the total time.., not time per server)..
>
> Does anyone know where we can find server timings for regular file 
> uploads? (or is that possible)?
>
> On Wed, Mar 2, 2011 at 5:51 PM, Steve Dodson <steve.dodson at gmail.com 
> <mailto:steve.dodson at gmail.com>> wrote:
>
>     Not sure whether or not this was helpful (probably not), but I
>     upgraded rhp997 to 1.8.2.  I checked the shares directory and I
>     show several new files (timestamped > 4:20pm today)...someone
>     appears to be adding shares?
>
>
>     On 03/02/2011 03:39 PM, Billy Earney wrote:
>
>         Steve,
>
>         9am this morning is the last time I saw your server..  My
>         process is
>         currently loading larger files (a few hundred MB per file) and at
>         50kbps, its taking a few hours per file.   I'm guessing in the
>         next
>         hour, another file will be uploaded and I can see if your server
>         participates in the upload.
>
>         Below is some stats for the last time my machine uploaded
>         shares to your
>         machine.
>
>            * Timings:
>                  o Total: 2 minutes
>
>                        + Initial Queries: 7.8ms
>                        + Cumulative Verify: 3.3ms
>                  o Per-Server Response Times:
>
>                        + [gbytbnxw]: 2.41s
>                        + [g4xvpwqa]: 2 minutes
>                        + [jbrse33y]: 2.03s
>                        + [pmitrhwg]: 2.27s
>                        + [qivwuhf6]: 2.33s
>                        + [vifimgiw]: 25ms
>                        + [voej6qtg]: 2.30s
>
>
>
>
>         On Wed, Mar 2, 2011 at 8:27 AM, Zooko O'Whielacronx
>         <zooko at zooko.com <mailto:zooko at zooko.com>
>         <mailto:zooko at zooko.com <mailto:zooko at zooko.com>>> wrote:
>
>            On Wed, Mar 2, 2011 at 6:57 AM, Billy Earney
>         <billy.earney at gmail.com <mailto:billy.earney at gmail.com>
>         <mailto:billy.earney at gmail.com
>         <mailto:billy.earney at gmail.com>>> wrote:
>         >
>         > I want to thank you for the help last night on IRC,  I had
>         to go,
>            so I
>         > couldn't wait for you to return..  Looking at the stats from the
>            recent
>         > upload and download operations, it looks like the encoding is
>            doing about
>         > 10MBps (which is very good), but the uploading portion is only
>            doing around
>         > 30Kbps, so it looks like the upload is the bottleneck.  My
>         upload
>            speed is
>         > near (1Mbps), I checked this on speedtest.net
>         <http://speedtest.net>
>         <http://speedtest.net>, and it seems to be accurate.
>
>         > I don't expect to get 1Mbps upload speed with tahoe-lafs
>         since it
>            has some
>         > extra overhead, but I would expect at least 200KBps or so.
>
>            Cool! I think those stats should show you details about
>         which servers
>            you were uploading to and how each one performed. I suspect
>         that there
>            is one server which is accepting data very slowly.
>
>            The uploader uploads to the servers in parallel, so it
>         proceeds at
>            exactly the speed of the slowest server.
>
>            Regards,
>
>            Zooko
>            _______________________________________________
>            volunteergrid2-l mailing list
>         volunteergrid2-l at tahoe-lafs.org
>         <mailto:volunteergrid2-l at tahoe-lafs.org>
>         <mailto:volunteergrid2-l at tahoe-lafs.org
>         <mailto:volunteergrid2-l at tahoe-lafs.org>>
>
>         http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>         http://bigpig.org/twiki/bin/view/Main/WebHome
>
>
>
>
>         _______________________________________________
>         volunteergrid2-l mailing list
>         volunteergrid2-l at tahoe-lafs.org
>         <mailto:volunteergrid2-l at tahoe-lafs.org>
>         http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>         http://bigpig.org/twiki/bin/view/Main/WebHome
>
>
>     -- 
>
>     soli Deo gloria
>
>     _______________________________________________
>     volunteergrid2-l mailing list
>     volunteergrid2-l at tahoe-lafs.org
>     <mailto:volunteergrid2-l at tahoe-lafs.org>
>     http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
>     http://bigpig.org/twiki/bin/view/Main/WebHome
>
>
>
> _______________________________________________
> volunteergrid2-l mailing list
> volunteergrid2-l at tahoe-lafs.org
> http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
> http://bigpig.org/twiki/bin/view/Main/WebHome
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://tahoe-lafs.org/cgi-bin/mailman/private/volunteergrid2-l/attachments/20110302/cd915862/attachment-0001.html>


More information about the volunteergrid2-l mailing list