[tahoe-dev] 1,000,000+ files?

[zooko]

On May 6, 2008, at 8:14 PM, Brian Warner wrote:

>> Thanks. Do you know the exact limitation per file? So I can restrict
>> an upload size.
>
> The relevant limit is at:
>
>  http://allmydata.org/trac/tahoe/browser/src/allmydata/mutable/ 
> publish.py?rev=2498#L97
>
> and is 3.5MB (that's 3.5e6 bytes) per mutable file. This limit is  
> fairly
> arbitrary. One reason to keep it below infinity is to keep the memory
> footprint to a reasonable level: the node will use something like  
> 4x the
> segment size to upload a file, and something like 2x to download  
> it. The
> other reason is to discourage people from using very large mutable  
> files
> while they are in the current inefficient state.

See also this ticket:

http://allmydata.org/trac/tahoe/ticket/359 # eliminate hard limit on  
size of SDMFs

I would say that #359 is currently in the state of not getting  
priority -- we want it to be done (at least I do), but we want other  
things to be done more.

Regards,

Zooko