[tahoe-lafs-trac-stream] [tahoe-lafs] #1288: support streaming uploads in uploader

[tahoe-lafs]

#1288: support streaming uploads in uploader
-------------------------+-------------------------------------------------
     Reporter:           |      Owner:
  davidsarah             |     Status:  new
         Type:           |  Milestone:  undecided
  enhancement            |    Version:  1.8.1
     Priority:  major    |   Keywords:  streaming performance upload sftp
    Component:  code-    |  fuse reliability
  encoding               |
   Resolution:           |
Launchpad Bug:           |
-------------------------+-------------------------------------------------

Comment (by davidsarah):

 I'd been thinking that to support convergence, the server selector has to
 be based on a hash of the whole file. But that's not necessarily true: it
 could be based on a hash of a prefix of the file (say the first segment),
 and the convergence secret. This would make no difference for small files,
 but for large files it would allow the server selector to be calculated
 more quickly, perhaps before the rest of the file is known.

 This would mean that files with the same prefix in a given convergence set
 would always have the same selector. But arguably the server selector only
 has to have sufficient diversity to average out the consumed space among
 servers for a reasonably large collection of files. If it's sufficiently
 unusual to have lots of files with the same prefix in a given convergence
 set, that this goal is achieved even if the server selector only depends
 on the prefix (within that set).

-- 
Ticket URL: <http://tahoe-lafs.org/trac/tahoe-lafs/ticket/1288#comment:4>
tahoe-lafs <http://tahoe-lafs.org>
secure decentralized storage