[tahoe-lafs-trac-stream] [tahoe-lafs] #940: display space-usage configs, space used, space available for your storage server (was: share-crawler should estimate+display space-used)

[tahoe-lafs]

#940: display space-usage configs, space used, space available for your storage
server
-------------------------+-------------------------------------------------
     Reporter:  warner   |      Owner:
         Type:           |     Status:  new
  enhancement            |  Milestone:  undecided
     Priority:  major    |    Version:  1.6.0
    Component:  code-    |   Keywords:  statistics transparency space-
  storage                |  efficiency
   Resolution:           |
Launchpad Bug:           |
-------------------------+-------------------------------------------------

Old description:

> It would be nice if the "Storage Server" sub-page of the Welcome Page
> would show an estimate of how much space the storage server is using.
> This estimate could be built by one of the share-crawlers, by adding up
> how much space is used in each prefix directory. A loose estimate could
> be maintained cheaply by summing the last-known-size for each prefixdir,
> and updating one prefixdir per time period (as all crawlers do). Since
> shares are placed pseudo-randomly, an even looser and cheaper estimate
> could be made by measuring a fraction of the prefixdirs and multiplying.
>
> The bucketcrawler doesn't look inside the bucket directories, but the
> lease-crawler does. Let's add "space consumed" functionality to the
> lease-crawler, and display the results on the storage-server WUI page.

New description:

 It would be nice if the "Storage Server" sub-page of the Welcome Page
 would show an estimate of how much space the storage server is using. This
 estimate could be built by one of the share-crawlers, by adding up how
 much space is used in each prefix directory. A loose estimate could be
 maintained cheaply by summing the last-known-size for each prefixdir, and
 updating one prefixdir per time period (as all crawlers do). Since shares
 are placed pseudo-randomly, an even looser and cheaper estimate could be
 made by measuring a fraction of the prefixdirs and multiplying.

 The bucketcrawler doesn't look inside the bucket directories, but the
 lease-crawler does. Let's add "space consumed" functionality to the lease-
 crawler, and display the results on the storage-server WUI page.

--

Comment (by zooko):

 See also #1836, which is to get this information from leasedb instead of
 share crawler. Changing the title of this ticket to make it independent of
 where the information comes from.

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/940#comment:3>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage