#606 closed enhancement (fixed)

backupdb: add directory cache

Reported by: warner Owned by:
Priority: major Milestone: 1.6.0
Component: code-frontend-cli Version: 1.2.0
Keywords: backupdb news-done cache performance Cc:
Launchpad Bug:

Description

We can speed up the #598 "tahoe backup" command even more by caching tahoe-side read-only directory contents. At the moment, we have to read every Tahoe directory to find out whether we can share it with a new backup or not. With a table in the backupdb that maps dircap to hash of its contents, we can avoid those reads, and get rid of almost all of the network IO involved in a null backup.

Change History (6)

comment:1 Changed at 2009-09-24T05:54:50Z by zooko

If you like this ticket, you might also like #465 (add a mutable-file cache), #316 (add caching to tahoe proper?), and #300 (macfuse: need some sort of caching).

comment:2 Changed at 2009-11-18T07:48:50Z by warner

  • Milestone changed from undecided to 1.6.0

now that we've got immutable dirnodes, and I'm working on using them in "tahoe backup" (#828), I want the 1.6.0 release to include this feature, so that "tahoe backup" will be super-efficient.

comment:3 Changed at 2009-11-27T22:47:48Z by warner

  • Resolution set to fixed
  • Status changed from new to closed

Done, in 9901a08fd30efa87.

comment:4 Changed at 2010-02-02T06:08:34Z by davidsarah

  • Keywords news-done added

comment:5 Changed at 2010-02-13T00:44:50Z by davidsarah

  • Keywords cache added

comment:6 Changed at 2010-02-13T00:45:05Z by davidsarah

  • Keywords performance added
Note: See TracTickets for help on using tickets.