[tahoe-lafs-trac-stream] [Tahoe-LAFS] #3955: High-level benchmarking suite, as part of attempt to speed up Tahoe

[Tahoe-LAFS]

#3955: High-level benchmarking suite, as part of attempt to speed up Tahoe
--------------------------+-----------------------
     Reporter:  itamarst  |      Owner:
         Type:  task      |     Status:  new
     Priority:  normal    |  Milestone:  undecided
    Component:  unknown   |    Version:  n/a
   Resolution:            |   Keywords:
Launchpad Bug:            |
--------------------------+-----------------------
Description changed by itamarst:

Old description:

> We should have a broader benchmarking attempt, involving:
>
> - Defining metrics
> - Defining goals
>
> Two aspects:
>
> - User experience
> - Server-side load
>
> UX is probably more important at this point, but eventually if that's
> finished server load will become an issue.
>
> Metrics:
>
> - Latency (single upload/download)
> - Throughput (batch uploads/downloads)
>
> Bottlenecks will be network latency, CPU, network bandwidth. If we've hit
> point where network bandwidth is the bottleneck, we're done optimizing.
>
> Throughput depends on usage patterns of:
>
> - `tahoe cp`
> - `tahoe backup`
> - sftp
> - Magic Folders

New description:

 We should have a broader benchmarking attempt, involving:

 - Defining metrics
 - Defining goals

 Two aspects:

 - User experience
 - Server-side load

 UX is probably more important at this point, but eventually if that's
 finished server load will become an issue.

 Metrics:

 - Latency (single upload/download)
 - Throughput (batch uploads/downloads)

 Bottlenecks will be network latency, CPU, network bandwidth. If we've hit
 point where network bandwidth is the bottleneck, we're done optimizing.

 Throughput depends on usage patterns of:

 - `tahoe cp`
 - `tahoe backup`
 - sftp
 - Magic Folders
 - Third party backup tools that integrate with Tahoe (duplicaty?
 duplicati? borg?)

 Knobs: number of backend storage servers, network latency.

--

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/3955#comment:2>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage