[tahoe-dev] [tahoe-lafs] #1170: new-downloader performs badly when downloading a lot of data from a file

[tahoe-lafs]

#1170: new-downloader performs badly when downloading a lot of data from a file
------------------------------+---------------------------------------------
     Reporter:  zooko         |       Owner:                                           
         Type:  defect        |      Status:  new                                      
     Priority:  critical      |   Milestone:  1.8.0                                    
    Component:  code-network  |     Version:  1.8β                                     
   Resolution:                |    Keywords:  immutable download performance regression
Launchpad Bug:                |  
------------------------------+---------------------------------------------

Comment (by zooko):

 The patch helped a lot—compare run 112 to 111—but not enough to make trunk
 as fast as 1.7.1 on large downoads—compare run 112 to runs 102, 103, 105,
 and 109.

 I intend to write a tool which reads the traces of what was done to the
 {{{Share._received}}} Spans object and does those operations to a Spans
 object so that we can run benchmark it and profile it in isolation.

 ||= run =||= version =||= downloaded =||= download KBps =||= flags =||
 || [comment:18 101] || 1.8.0c2 || 100 MB ||   91 ||
 ||
 || [comment:19 102] || 1.7.1   || 100 MB ||  182 ||
 ||
 || [comment:22 103] || 1.7.1   || 100 MB ||  207 ||
 ||
 || [comment:23 104] || 1.8.0c2 || 100 MB ||   82 ||
 ||
 || [comment:25 105] || 1.7.1   || 100 MB ||  211 ||
 ||
 || [comment:35 109] || 1.7.1   || 100 MB ||  228 || cProfile
 ||
 || [comment:36 110] || 1.8.0c2 || 100 MB ||  113 || cProfile
 ||
 || [comment:47 111] || 1.8.0c2 || 413 MB ||   19 || spanstrace
 ||
 || [comment:49 112] || 1.8.0c2 || 456 MB ||  113 || spanstrace,
 [attachment:spans.py.diff patched] ||

-- 
Ticket URL: <http://tahoe-lafs.org/trac/tahoe-lafs/ticket/1170#comment:50>
tahoe-lafs <http://tahoe-lafs.org>
secure decentralized storage