[tahoe-dev] [tahoe-lafs] #1170: new-downloader performs badly when downloading a lot of data from a file

[tahoe-lafs]

#1170: new-downloader performs badly when downloading a lot of data from a file
------------------------------+---------------------------------------------
     Reporter:  zooko         |       Owner:                                           
         Type:  defect        |      Status:  new                                      
     Priority:  critical      |   Milestone:  1.8.0                                    
    Component:  code-network  |     Version:  1.8β                                     
   Resolution:                |    Keywords:  immutable download performance regression
Launchpad Bug:                |  
------------------------------+---------------------------------------------

Comment (by zooko):

 Okay, the patch from comment:54 seems to have improved performance
 significantly. I just performed run 114:
 {{{
 MUSI Zooko-Ofsimplegeos-MacBook-Pro:~/Desktop$ echo this is run 114 tahoe-
 lafs v1.8.0c2-r4699+comment:54 ; time curl
 http://localhost:3456/file/URI%3ACHK%3A4klgnafrwsm2nx3bqy24ygac5a%3Acrz7nhthi4bevzrug6xwgif2vhiacp7wk2cfmjutoz2ns3w45qza%3A3%3A10%3A1490710513/@@named
 =/bbb-360p24.i420.lossless.drc.ogg.fixed.ogg%2Bbbb-24fps.flac.via-
 ffmpeg.ogg  > bbb.ogg
 this is run 114 tahoe-lafs v1.8.0c2-r4699+comment:54
   % Total    % Received % Xferd  Average Speed   Time    Time     Time
 Current
                                  Dload  Upload   Total   Spent    Left
 Speed
  10 1421M   10  146M    0     0   149k      0  2:42:42  0:16:42  2:26:00
 159k^R
  30 1421M   30  435M    0     0   147k      0  2:44:53  0:50:30  1:54:23
 144k^C

 real    50m30.207s
 user    0m0.290s
 sys     0m2.112s
 }}}

 Here is the full table:

 ||= run =||= version =||= downloaded =||= download KBps =||= flags =||
 || [comment:18 101] || 1.8.0c2 || 100 MB ||   91 ||
 ||
 || [comment:19 102] || 1.7.1   || 100 MB ||  182 ||
 ||
 || [comment:22 103] || 1.7.1   || 100 MB ||  207 ||
 ||
 || [comment:23 104] || 1.8.0c2 || 100 MB ||   82 ||
 ||
 || [comment:25 105] || 1.7.1   || 100 MB ||  211 ||
 ||
 || [comment:35 109] || 1.7.1   || 100 MB ||  228 || cProfile
 ||
 || [comment:36 110] || 1.8.0c2 || 100 MB ||  113 || cProfile
 ||
 || [comment:47 111] || 1.8.0c2 || 413 MB ||   19 || spanstrace
 ||
 || [comment:49 112] || 1.8.0c2 || 456 MB ||  113 || spanstrace,
 [attachment:spans.py.diff spans.py.diff] ||
 || [comment:52 113] ||   1.7.1 ||        543 MB ||       241 ||  on office
 network ||
 || [comment:57 114] ||   1.8.0c2 ||      456 MB ||       147 ||
 [attachment:spans.py.diff spans.py.diff] + comment:54 ||

 I'm not sure if v1.8.0c2 is now good enough to be considered "not a
 significant regression" vs. v1.7.1 for downloading large files. I'll go
 download a large file with v1.7.1 now on my home network for comparison...

-- 
Ticket URL: <http://tahoe-lafs.org/trac/tahoe-lafs/ticket/1170#comment:57>
tahoe-lafs <http://tahoe-lafs.org>
secure decentralized storage