[tahoe-dev] [tahoe-lafs] #913: Support running a storage node per drive easily

tahoe-lafs trac at allmydata.org
Mon Jan 18 15:29:43 PST 2010


#913: Support running a storage node per drive easily
-------------------------+--------------------------------------------------
 Reporter:  davidsarah   |           Owner:  nobody   
     Type:  enhancement  |          Status:  new      
 Priority:  major        |       Milestone:  undecided
Component:  unknown      |         Version:  1.5.0    
 Keywords:  usability    |   Launchpad_bug:           
-------------------------+--------------------------------------------------

Comment(by imhavoc):

 I think this may be a possible design flaw. Not in the sense that Tahoe
 was originally designed for, but in the sense of how Tahoe is going to be
 used in the real world.

 Production grids will fill up. New drives/servers will be added. The new
 drives in each generation will be larger than the previous generations.
 This may potentially cause the grid to have a cascading performance
 decrease. The other usage is for heterogeneous grids like those that have
 been discussed lately (including my own).

 I have had some thoughts on this, but they are just thoughts.
  - Give a node the ability to flag itself "full," "read only," "storage
 not available," or some other flag. This will keep the grid from trying to
 store shares on full volumes and eliminate that performance penalty. (Let
 the requesting node know you're full before it asks to store shares on
 you.)
  - Have nodes report available storage. The storage algorithms could sort
 the nodes before polling for share storage by only looking at nodes that
 last reported >X bytes available to grid. (Each node would keep a table of
 available storage on each attached peer.)
  - With "servers of happiness" in place rather than "shares of happiness,"
 a flag could be raised to indicate problems.
  - A daemon could be run to email grid administrators grid status updates
 related to grid balance/imbalance/alarms.

 By hoping for a homogeneous grid, Tahoe is limited to expansive,
 relatively sterile use cases.

-- 
Ticket URL: <http://allmydata.org/trac/tahoe/ticket/913#comment:6>
tahoe-lafs <http://allmydata.org>
secure decentralized file storage grid


More information about the tahoe-dev mailing list