[tahoe-lafs-trac-stream] [tahoe-lafs] #113: command-line: do things in an incremental fashion and accept stdin as input

[tahoe-lafs]

#113: command-line: do things in an incremental fashion and accept stdin as input
-----------------------------+---------------------------------------------
     Reporter:  zooko        |      Owner:  zooko
         Type:  defect       |     Status:  assigned
     Priority:  major        |  Milestone:  eventually
    Component:  code-        |    Version:  0.7.0
  frontend-cli               |   Keywords:  tahoe-put http streaming memory
   Resolution:               |
Launchpad Bug:               |
-----------------------------+---------------------------------------------
Changes (by davidsarah):

 * keywords:  tahoe-put http streaming => tahoe-put http streaming memory
 * type:  enhancement => defect


Comment:

 Note that {{{tahoe put}}} never uses streaming, even when its input is
 from a file rather than stdin. This results in memory usage proportional
 to the file size (which would be expected for SDMF files, but not for
 immutable or MDMF files).

 Note that the increase in memory usage of the gateway process seems to be
 at least double the file size; for example, when uploading a 191 MiB MDMF
 file in 1.9alpha using {{{tahoe put --mutable --mutable-type=mdmf}}}, the
 peak RSS of the gateway (which was also a storage server) was about 510
 MiB greater than when updating the same file using SFTP. I think that
 counts as a defect.

-- 
Ticket URL: <http://tahoe-lafs.org/trac/tahoe-lafs/ticket/113#comment:13>
tahoe-lafs <http://tahoe-lafs.org>
secure decentralized storage