Whoosh + Tahoe = distributed search engine for documents in Tahoe

Okhin okhin at okhin.fr
Tue Jul 8 14:56:29 UTC 2014


On Tue, Jul 08, 2014 at 07:34:00AM -0700, Raoul Duke wrote:
> if i understand... sounds like there's 1 single machine doing the
> actual searching algorithm on the data? so it is still serial? since i
> guess tahoe does storage fan-out, but not compute fan-out.
> 

Well, you can have several machine doing the actual searching. Since all
the needed files are distributed (you still need to share the CAP
somehow). But you can have different indexers and searchers from
different computers working on the same index.

> makes me wonder: what if somebody tried some crazy hacks like making
> HDFS run on Tahoe instead, for example? :-}

-- 
With datalove,
Okhin
:(){ :|:& };:
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 949 bytes
Desc: not available
URL: <http://tahoe-lafs.org/pipermail/tahoe-dev/attachments/20140708/29877c15/attachment.pgp>


More information about the tahoe-dev mailing list