[tahoe-lafs-trac-stream] [tahoe-lafs] #1824: Tahoe process gone wild

[tahoe-lafs]

#1824: Tahoe process gone wild
---------------------+----------------------------
 Reporter:  kpreid   |          Owner:  davidsarah
     Type:  defect   |         Status:  new
 Priority:  normal   |      Milestone:  undecided
Component:  unknown  |        Version:  unknown
 Keywords:           |  Launchpad Bug:
---------------------+----------------------------
 I woke up this morning (~07:20 PDT) to find my machine sluggish to
 respond. It turned out to be my Volunteer Grid 1 tahoe node, having grown
 to 24GB virtual, 12GB (of 16GB) real. It was not responsive to the web
 port. It was using about 0.3% CPU.

 It appears to have hung in the middle of my regularly scheduled
 repair/lease process, which started 14 hours ago; here is the output from
 that. Note that this cronjob mail didn't come to me until I killed the
 process, so I suspect it hung in the middle of the third repair, and the
 tracebacks are merely due to the death of the TCP server.

 Further details will be added later; I have no time to hunt for logs now.

 {{{
 Randomised start: Sun Oct 14 18:42:35 PDT 2012
 *** calendar-publish-dir
         done: 3 objects checked
          pre-repair: 3 healthy, 0 unhealthy
          0 repairs attempted, 0 successful, 0 failed
          post-repair: 3 healthy, 0 unhealthy

 *** family
          repair successful
         done: 2 objects checked
          pre-repair: 1 healthy, 1 unhealthy
          1 repairs attempted, 1 successful, 0 failed
          post-repair: 1 healthy, 1 unhealthy

 *** publish
 Traceback (most recent call last):
  File "/External/Projects/tahoe/support/bin/tahoe", line 9, in <module>
    load_entry_point('allmydata-tahoe==1.9.0.post28', 'console_scripts',
 'tahoe')()
  File "/External/Projects/tahoe/src/allmydata/scripts/runner.py", line
 113, in run
    rc = runner(sys.argv[1:], install_node_control=install_node_control)
  File "/External/Projects/tahoe/src/allmydata/scripts/runner.py", line 99,
 in runner
    rc = cli.dispatch[command](so)
  File "/External/Projects/tahoe/src/allmydata/scripts/cli.py", line 594,
 in deepcheck
    rc = tahoe_check.deepcheck(options)
  File "/External/Projects/tahoe/src/allmydata/scripts/tahoe_check.py",
 line 306, in deepcheck
    return DeepCheckStreamer().run(options)
  File "/External/Projects/tahoe/src/allmydata/scripts/tahoe_check.py",
 line 287, in run
    resp = do_http("POST", url)
  File "/External/Projects/tahoe/src/allmydata/scripts/common_http.py",
 line 68, in do_http
    return c.getresponse()
  File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py",
 line 1013, in getresponse
    response.begin()
  File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py",
 line 402, in begin
    version, status, reason = self._read_status()
  File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py",
 line 366, in _read_status
    raise BadStatusLine(line)
 httplib.BadStatusLine: ''

 *** tahoe-illustration
 Traceback (most recent call last):
  File "/External/Projects/tahoe/support/bin/tahoe", line 9, in <module>
    load_entry_point('allmydata-tahoe==1.9.0.post28', 'console_scripts',
 'tahoe')()
  File "/External/Projects/tahoe/src/allmydata/scripts/runner.py", line
 113, in run
    rc = runner(sys.argv[1:], install_node_control=install_node_control)
  File "/External/Projects/tahoe/src/allmydata/scripts/runner.py", line 99,
 in runner
    rc = cli.dispatch[command](so)
  File "/External/Projects/tahoe/src/allmydata/scripts/cli.py", line 594,
 in deepcheck
    rc = tahoe_check.deepcheck(options)
  File "/External/Projects/tahoe/src/allmydata/scripts/tahoe_check.py",
 line 306, in deepcheck
    return DeepCheckStreamer().run(options)
  File "/External/Projects/tahoe/src/allmydata/scripts/tahoe_check.py",
 line 287, in run
    resp = do_http("POST", url)
  File "/External/Projects/tahoe/src/allmydata/scripts/common_http.py",
 line 60, in do_http
    c.endheaders()
  File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py",
 line 937, in endheaders
    self._send_output(message_body)
  File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py",
 line 797, in _send_output
    self.send(msg)
  File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py",
 line 759, in send
    self.connect()
  File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py",
 line 740, in connect
    self.timeout, self.source_address)
  File
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py",
 line 571, in create_connection
    raise err
 socket.error: [Errno 61] Connection refused

 }}}

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1824>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage