[tahoe-lafs-trac-stream] [Tahoe-LAFS] #1440: drop-upload: don't perform redundant uploads when a file is quickly modified three or more times

[Tahoe-LAFS]

#1440: drop-upload: don't perform redundant uploads when a file is quickly
modified three or more times
-------------------------------------+-------------------------------------
     Reporter:  davidsarah           |      Owner:  daira
         Type:  enhancement          |     Status:  assigned
     Priority:  major                |  Milestone:  undecided
    Component:  code-frontend-drop-  |    Version:  1.8.2
  upload                             |   Keywords:  drop-upload performance
   Resolution:                       |  otf-magic-folder-objective2
Launchpad Bug:                       |
-------------------------------------+-------------------------------------

Comment (by daira):

 Replying to [comment:7 dawuud]:
 > We use an explicit dequeue implementation and we utilize a helping hash
 map to track currently queued files/dirs. Each time we add a file to the
 queue we first check if that file is already in the hashmap. We only add a
 file to the queue when it is not already in the hashmap. Likewise we must
 remove it from the hashmap once that queue item has been processed.

 Yes, this is basically the same as the pending_delay code in
 [https://github.com/tahoe-lafs/tahoe-
 lafs/blob/9cd24713e1e51dbc0834148332ce03f43628b4b5/src/allmydata/windows/inotify.py
 allmydata/windows/inotify.py].

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1440#comment:8>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage