[volunteergrid2-l] adding files to the grid

[Billy Earney]

Chris,

 

Thanks for the info..

 

From: volunteergrid2-l-bounces at tahoe-lafs.org
[mailto:volunteergrid2-l-bounces at tahoe-lafs.org] On Behalf Of Chris Brown
Sent: Wednesday, March 02, 2011 6:19 PM
To: a small group of people sharing storage resources with Tahoe-LAFS
Subject: Re: [volunteergrid2-l] adding files to the grid

 

While not directly answering your question, it might be good practice to run
ntop on the node.

Perhaps allow others access to.

This would help determine the node's max upload/download speed (peaks on
charts) as well as how busy it was with other traffic at the time your were
uploading your file.

http://www.ntop.org/overview.html

Chris Brown
Arrival Telecom, Inc.


On 3/2/2011 5:04 PM, Billy Earney wrote: 

I can see that shares are being added to your server, but for regular files
I have not found a way to see which server(s) are causing the bottleneck.
>From map update files (not sure what they are) it shows stats per server,
but regular file uploads do not go into that detail (it only shows the total
time.., not time per server)..

Does anyone know where we can find server timings for regular file uploads?
(or is that possible)?

On Wed, Mar 2, 2011 at 5:51 PM, Steve Dodson <steve.dodson at gmail.com> wrote:

Not sure whether or not this was helpful (probably not), but I upgraded
rhp997 to 1.8.2.  I checked the shares directory and I show several new
files (timestamped > 4:20pm today)...someone appears to be adding shares? 



On 03/02/2011 03:39 PM, Billy Earney wrote:

Steve,

9am this morning is the last time I saw your server..  My process is
currently loading larger files (a few hundred MB per file) and at
50kbps, its taking a few hours per file.   I'm guessing in the next
hour, another file will be uploaded and I can see if your server
participates in the upload.

Below is some stats for the last time my machine uploaded shares to your
machine.

   * Timings:

         o Total: 2 minutes 


               + Initial Queries: 7.8ms
               + Cumulative Verify: 3.3ms

         o Per-Server Response Times: 


               + [gbytbnxw]: 2.41s
               + [g4xvpwqa]: 2 minutes
               + [jbrse33y]: 2.03s
               + [pmitrhwg]: 2.27s
               + [qivwuhf6]: 2.33s
               + [vifimgiw]: 25ms
               + [voej6qtg]: 2.30s




On Wed, Mar 2, 2011 at 8:27 AM, Zooko O'Whielacronx <zooko at zooko.com

<mailto:zooko at zooko.com>> wrote:

   On Wed, Mar 2, 2011 at 6:57 AM, Billy Earney <billy.earney at gmail.com

   <mailto:billy.earney at gmail.com>> wrote:
    >
    > I want to thank you for the help last night on IRC,  I had to go,
   so I
    > couldn't wait for you to return..  Looking at the stats from the
   recent
    > upload and download operations, it looks like the encoding is
   doing about
    > 10MBps (which is very good), but the uploading portion is only
   doing around
    > 30Kbps, so it looks like the upload is the bottleneck.  My upload
   speed is
    > near (1Mbps), I checked this on speedtest.net

   <http://speedtest.net>, and it seems to be accurate. 


    > I don't expect to get 1Mbps upload speed with tahoe-lafs since it
   has some
    > extra overhead, but I would expect at least 200KBps or so.

   Cool! I think those stats should show you details about which servers
   you were uploading to and how each one performed. I suspect that there
   is one server which is accepting data very slowly.

   The uploader uploads to the servers in parallel, so it proceeds at
   exactly the speed of the slowest server.

   Regards,

   Zooko
   _______________________________________________
   volunteergrid2-l mailing list

   volunteergrid2-l at tahoe-lafs.org <mailto:volunteergrid2-l at tahoe-lafs.org> 


   http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
   http://bigpig.org/twiki/bin/view/Main/WebHome




_______________________________________________
volunteergrid2-l mailing list
volunteergrid2-l at tahoe-lafs.org
http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
http://bigpig.org/twiki/bin/view/Main/WebHome


-- 

soli Deo gloria 


_______________________________________________
volunteergrid2-l mailing list
volunteergrid2-l at tahoe-lafs.org
http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
http://bigpig.org/twiki/bin/view/Main/WebHome





 
 
_______________________________________________
volunteergrid2-l mailing list
volunteergrid2-l at tahoe-lafs.org
http://tahoe-lafs.org/cgi-bin/mailman/listinfo/volunteergrid2-l
http://bigpig.org/twiki/bin/view/Main/WebHome
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://tahoe-lafs.org/cgi-bin/mailman/private/volunteergrid2-l/attachments/20110303/d4018bcf/attachment-0001.html>