Changes between Version 7 and Version 8 of Ticket #1523


Ignore:
Timestamp:
2011-09-02T19:07:53Z (13 years ago)
Author:
davidsarah
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #1523 – Description

    v7 v8  
    11Split from #113:
    22
    3 The web-API interface does not support streaming (#113, #320), so it is expected for the gateway to need to hold the whole file in memory in order to upload it. However, when using {{{tahoe put}}} to upload an MDMF file, the increase in memory usage of the gateway process seems to be more than double the file size. For example, when uploading a 191 MiB MDMF file in 1.9alpha using {{{tahoe put --mutable --mutable-type=mdmf}}}, the peak RSS of the gateway (which was also a storage server in this test) was over 1300 MiB. There is also a huge memory leak of more than 700 MiB after the upload has finished.
     3The web-API interface does not support streaming (#113, #320), so it is expected for the gateway to need to hold the whole file in memory in order to upload it. However, when using {{{tahoe put}}} to upload an MDMF file, the increase in memory usage of the gateway process seems to be much larger than the file size. For example, when uploading a 191 MiB MDMF file in 1.9alpha using {{{tahoe put --mutable --mutable-type=mdmf}}}, the peak RSS of the gateway (which was also a storage server in this test) was over 1300 MiB. There is also a huge memory leak of more than 700 MiB after the upload has finished.
    44
    55I originally thought that the memory usage was larger when using the web-API than when updating the same file using SFTP, but apparently that was wrong (I may have been misled by at first doing the SFTP experiment without restarting the nodes).