[tahoe-dev] [tahoe-lafs] #962: Performance problems testing on a 45 disk Dual core 3.3Ghz 4G memory Box

[tahoe-lafs]

#962: Performance problems testing on a 45 disk Dual core 3.3Ghz 4G memory Box
--------------------------------+-------------------------------------------
 Reporter:  stott               |           Owner:  somebody 
     Type:  defect              |          Status:  new      
 Priority:  major               |       Milestone:  undecided
Component:  website             |         Version:  1.5.0    
 Keywords:  performance memory  |   Launchpad_bug:           
--------------------------------+-------------------------------------------

Comment(by warner):

 Is there just one upload happening at a time? Or are you doing many in
 parallel?

 One of the "recent uploads and downloads" stats that you pasted in IRC
 showed a '''mutable''' upload, rather than the normal immutable upload
 (which the {{{curl}}} command above would use). We've documented once or
 twice how memory usage for mutable files is pretty bad (N/k*filesize, as
 opposed to the well-limited N/k*128KiB for immutable files).
 source:docs/performance.txt mentions about half the story.. I guess we
 should probably improve that section.

 If you had a lot of simultaneous large-memory uploads going on, I can
 easily see how the overall memory usage would spike, and you'd get a lot
 of swapping and stalls. It sounds like there were a couple different kinds
 of tests taking place, though, so I don't want to misdiagnose problem A if
 the symptoms actually occurred during test B.

-- 
Ticket URL: <http://allmydata.org/trac/tahoe/ticket/962#comment:5>
tahoe-lafs <http://allmydata.org>
secure decentralized file storage grid