[tahoe-lafs-trac-stream] [tahoe-lafs] #1523: MDMF upload via web-API uses much more memory in the gateway process than updating the same file via SFTP

[tahoe-lafs]

#1523: MDMF upload via web-API uses much more memory in the gateway process than
updating the same file via SFTP
--------------------------------+------------------------------------------
     Reporter:  davidsarah      |      Owner:  davidsarah
         Type:  defect          |     Status:  assigned
     Priority:  major           |  Milestone:  undecided
    Component:  code-frontend-  |    Version:  1.9.0a1
  web                           |   Keywords:  memory tahoe-put performance
   Resolution:                  |
Launchpad Bug:                  |
--------------------------------+------------------------------------------

Comment (by davidsarah):

 I restarted all the nodes, and repeated the experiment using {{{bin/tahoe
 put --mutable --mutable-type=mdmf zeros <URI from previous run>}}}, i.e.
 an update rather than an initial upload. The results were similar except
 that the peak RSS of the gateway process was 1322.5 MiB, and the final
 usages were:
 {{{
   PID   RSS    VSZ S TTY          TIME COMMAND
 28617 39340 163824 S ?        00:00:00 [...]/tahoe start
 ../grid/introducer
 28627 202768 286752 S ?       00:00:05 [...]/tahoe start ../grid/server1
 28637 204752 288772 S ?       00:00:05 [...]/tahoe start ../grid/server2
 28647 289676 373704 S ?       00:00:07 [...]/tahoe start ../grid/server3
 28657 204468 288544 S ?       00:00:07 [...]/tahoe start ../grid/server4
 28667 700936 829076 S ?       00:01:05 [...]/tahoe start
 }}}
 (i.e. 684.5 MiB RSS for the gateway). Again these hadn't decreased several
 minutes later.

-- 
Ticket URL: <http://tahoe-lafs.org/trac/tahoe-lafs/ticket/1523#comment:5>
tahoe-lafs <http://tahoe-lafs.org>
secure decentralized storage