#1530 new task

automated comparative 'k' performance tests and graphs

Reported by: warner Owned by: warner
Priority: major Milestone: soon (release n/a)
Component: dev-infrastructure Version: 1.9.0a1
Keywords: performance statistics visualization Cc:
Launchpad Bug:

Description

Here's my plan for some automated performance tests I intend to build over the next few months:

  • use the four servers on loan from Atlas Networks, one as a client, three as storage servers
  • use the attached attachment:upload-kN.py to upload a bunch of files with various sizes and encoding parameters (actually just varying 'k' and leaving N/k constant, since I don't think N affects performance much and would increase the runtime drastically).
  • write a script which fetches the directory contents once to get all the filecaps, then randomly downloads files from it, keeping track of how long each one takes (also recording other download-result timing data)
  • push that data to a CouchDB server for long-term storage (probably on iriscouch.com because it's free for small datasets, but it's easy to move a CouchDB to a different server later)
  • write some static HTML, served by that same CouchDB server, that uses d3.js to construct graphs. The script in the HTML will turn around and fetch the relevant data from the DB with XHR.
  • make a scatterplot of time vs k, then a candlestick chart

Later, I hope to use the same approach to store+display performance data across revisions, like the speedtest and memtest data we're getting from the buildbot.

Attachments (1)

upload-kN.py (2.0 KB) - added by warner at 2011-09-07T16:46:59Z.
script to upload files of various sizes and encoding parameters

Download all attachments as: .zip

Change History (5)

Changed at 2011-09-07T16:46:59Z by warner

script to upload files of various sizes and encoding parameters

comment:1 Changed at 2011-09-07T18:06:53Z by zooko

Sweet! I can't wait to see this. :-)

comment:2 Changed at 2011-10-06T19:04:38Z by davidsarah

  • Keywords performance statistics visualization added
  • Milestone changed from undecided to soon (release n/a)

comment:4 Changed at 2011-10-06T19:30:15Z by davidsarah

See also #1406.

Note: See TracTickets for help on using tickets.