Changes between Version 33 and Version 34 of Performance


Ignore:
Timestamp:
2011-04-11T17:20:59Z (14 years ago)
Author:
zooko
Comment:

notes about modern benchmarking

Legend:

Unmodified
Added
Removed
Modified

  • Performance

    v33 v34  
    11(See also copious notes and data about performance of older versions of Tahoe-LAFS, archived at Performance/Old.)
     2
     3In late 2010 Kyle Markley did some benchmarking of what were then the release candidates for Tahoe-LAFS v1.8.0. This helped us catch two major performance regressions in Brian's New Downloader and helped make Tahoe-LAFS v1.8.0 into an excellent new release (see epic ticket #1170 for mind-numbing details). Kyle also contributed code for his benchmarking scripts (in Perl), but nobody to my knowledge has yet tried to re-use that script.
     4
     5* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-July/004776.html
     6* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-July/004781.html
     7* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-July/004782.html
     8* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-July/004838.html
     9* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-August/004853.html
     10* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-August/004985.html
     11* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-August/005007.html
     12* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-August/005011.html
     13* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-September/005155.html
     14* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-September/005162.html
     15
     16We also experimented with different segment sizes and immutable uploader pipeline depths, and the results tentatively confirmed that the current segment size (128 KiB) and immutable uploader pipeline depth (50,000 B) were better on both of Kyle's networks than any of the alternatives that Kyle tried.
     17
     18Along the way Terrell Russell did some benchmarking and contributed a bash script which I used several times during the process:
     19
     20* http://tahoe-lafs.org/trac/tahoe-lafs/ticket/1170#comment:81
     21
     22At about the same time Nathan Eisenberg of Atlas Networks did a couple of manual benchmarks:
     23
     24* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-August/004929.html
     25* http://tahoe-lafs.org/pipermail/tahoe-dev/2010-August/004929.html
     26
     27Also François Deppierraz has run a few benchmarks. (Can't find a link to his results.)
     28
     29What we ''really'' want, of course, is automated benchmarks that get executed at regularly scheduled intervals, or whenever a new patch is committed to revision control, or both. This would ideally run on some dedicated hardware or at least on some virtualized hardware which had a fairly consistent load of other tenants, so that the resulting measurements would not get too much noise from other people's behavior. You can see on Performance/Old that we used to have such an automated setup, including graphs of the resulting performance.