[tahoe-dev] tahoe backup, parallel jobs

[Marco Tedaldi]

Hello

I'm using tahoe lafs in vg2 for backups. After trying for a long time to
backup all the stuff in one go I realized that I should fallow the
suggestions and let the backup run on smaller junks of data.

What I've realized, especially when backing up a lot of smaller files:
The overhead (time-wise, not bandwith wise) is huge.
For example a 3.4MB file takes 18seconds to push. But in total, it takes
26secunds to finish the operation because of all the communication overhead.

This got me thinking:
Could I start several parallel backup jobs to get a better use of my
upload bandwith? I'm quite sure, that there should be no problems. The
only things I see is in the locally stored information.
What about the backupdb.sqlite?
And where is the "revision" ("latest") of the backup stored? Could there
be conflicts?


And since I'm sure that someone has already done this:
Can someone provide me with a script that walks down trough part of the
directory tree and backups all the directories and sub directories one
by one instead of everything at once?


best regards

Marco