trac sqlite db accesses taking a long time

[zooko]

When I click on the "list all users" function of the Admin interface to trac, it takes many minutes, during which time the whole ​https://tahoe-lafs.org is locked.

Also other operations seem to be taking a long time, such as looking at the Timeline.

Here is the current tail of /var/log/nginx/error.log:

2013/08/12 20:01:34 [error] 9225#0: *194257 open() "/var/www/debian/dists/etch/tahoe/binary-i386/allmydata-tahoe_1.4.1-r3916_all.deb" failed (2: No such file or directory), client: 173.199.115.107, server: tahoe-lafs.org, request: "GET /debian/dists/etch/tahoe/binary-i386/allmydata-tahoe_1.4.1-r3916_all.deb HTTP/1.1", host: "tahoe-lafs.org"
2013/08/12 20:17:15 [error] 9225#0: *194653 open() "/var/www/apple-touch-icon-precomposed.png" failed (2: No such file or directory), client: 37.183.112.149, server: tahoe-lafs.org, request: "GET /apple-touch-icon-precomposed.png HTTP/1.1", host: "tahoe-lafs.org"
2013/08/12 20:17:15 [error] 9225#0: *194653 open() "/var/www/apple-touch-icon.png" failed (2: No such file or directory), client: 37.183.112.149, server: tahoe-lafs.org, request: "GET /apple-touch-icon.png HTTP/1.1", host: "tahoe-lafs.org"
2013/08/12 20:25:03 [error] 9225#0: *194880 open() "/var/www/json/builders/Atlas ubuntu natty/builds" failed (2: No such file or directory), client: 66.249.74.232, server: tahoe-lafs.org, request: "GET /json/builders/Atlas%20ubuntu%20natty/builds?select=-1&select=-2&as_text=1 HTTP/1.1", host: "www.tahoe-lafs.org"
2013/08/12 20:35:07 [error] 9225#0: *195163 open() "/var/www/json/builders/Atlas ubuntu natty/slaves" failed (2: No such file or directory), client: 66.249.74.232, server: tahoe-lafs.org, request: "GET /json/builders/Atlas%20ubuntu%20natty/slaves?as_text=1 HTTP/1.1", host: "www.tahoe-lafs.org"
2013/08/12 20:56:30 [error] 9225#0: *195773 open() "/var/www/buildbot-zfecbuilders/MM netbsd5 i386 warp" failed (2: No such file or directory), client: 66.249.74.45, server: tahoe-lafs.org, request: "GET /buildbot-zfecbuilders/MM%20netbsd5%20i386%20warp HTTP/1.1", host: "tahoe-lafs.org"
2013/08/12 21:19:21 [error] 9225#0: *196351 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 66.249.74.45, server: tahoe-lafs.org, request: "GET /buildbot-tahoe-lafs/builders/Francois%20lenny-armv5tel/builds/159/steps/build/logs/stdio/text HTTP/1.1", upstream: "http://127.0.0.1:8015/builders/Francois%20lenny-armv5tel/builds/159/steps/build/logs/stdio/text", host: "tahoe-lafs.org"
2013/08/12 21:26:06 [error] 9225#0: *196463 open() "/var/www/~zooko/network-and-reliance-topology.png" failed (2: No such file or directory), client: 92.143.240.64, server: tahoe-lafs.org, request: "GET /~zooko/network-and-reliance-topology.png HTTP/1.1", host: "tahoe-lafs.org", referrer: "http://doc.ubuntu-fr.org/tahoe-lafs"
2013/08/12 21:26:52 [error] 9225#0: *196521 open() "/var/www/~zooko/network-and-reliance-topology.png" failed (2: No such file or directory), client: 92.143.240.64, server: tahoe-lafs.org, request: "GET /~zooko/network-and-reliance-topology.png HTTP/1.1", host: "tahoe-lafs.org", referrer: "http://doc.ubuntu-fr.org/tahoe-lafs"
2013/08/12 21:27:33 [error] 9225#0: *196266 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 97.118.93.160, server: tahoe-lafs.org, request: "GET /trac/tahoe-lafs/admin/accounts/users HTTP/1.1", upstream: "uwsgi://unix:///home/trac/protected/uwsgi.sock", host: "tahoe-lafs.org", referrer: "https://tahoe-lafs.org/trac/tahoe-lafs/admin"

[warner]

I *think* this was due to the thousands of spam accounts that had been signed up, which I believe I've fixed, and I've deleted most of the dummy accounts.

Please re-open if you see it happening again.