[tahoe-lafs-trac-stream] [tahoe-lafs] #1768: intermittent test_system failure

tahoe-lafs trac at tahoe-lafs.org
Fri Jul 26 14:02:46 UTC 2013


#1768: intermittent test_system failure
------------------------+------------------------------------
     Reporter:  warner  |      Owner:
         Type:  defect  |     Status:  new
     Priority:  normal  |  Milestone:  undecided
    Component:  code    |    Version:  1.9.1
   Resolution:          |   Keywords:  test windows heisenbug
Launchpad Bug:          |
------------------------+------------------------------------

Comment (by zooko):

 Our windows buildslave demonstrated this again:

 https://tahoe-lafs.org/buildbot-tahoe-
 lafs/builders/Marcus%20Cygwin%20WinXP/builds/140/

 The relevant excerpt from stdout is:

 {{{
 allmydata.test.test_system.SystemTest.test_filesystem ...
 [<twisted.python.failure.Failure <class
 'foolscap.ipb.DeadReferenceError'>>]
 Traceback (most recent call last):
   File "/usr/lib/python2.6/site-
 packages/Twisted-11.1.0-py2.6-cygwin-1.7.9-i686.egg/twisted/internet/defer.py",
 line 134, in maybeDeferred
     result = f(*args, **kw)
   File
 "/home/marcus/bbtahoe/Marcus_Cygwin_WinXP/build/src/allmydata/util/pollmixin.py",
 line 49, in _poll
     self.fail("Errors snooped, terminating early")
 twisted.trial.unittest.FailTest: Errors snooped, terminating early
 [FAILURE]Traceback (most recent call last):
 Failure: foolscap.ipb.DeadReferenceError: replaced by a new connection
 [ERROR]Traceback (most recent call last):
 Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=njea) (during
 method=RIIntroducerPublisherAndSubscriberService_v2.tahoe.allmydata.com:subscribe_v2)
 [ERROR]Traceback (most recent call last):
 Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=ncie) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)
 [ERROR]
 (17.628 secs)
 }}}

 And the relevant excerpt from trial log is:

 {{{
 2013-07-18 21:51:21.391Z [-] -->
 allmydata.test.test_system.SystemTest.test_filesystem <--
 2013-07-18 21:51:21.470Z [-] Listener starting on 2549
 2013-07-18 21:51:21.480Z [-] NevowSite starting on 2550
 2013-07-18 21:51:21.480Z [-] Starting factory <nevow.appserver.NevowSite
 instance at 0x7cc48b8c>
 2013-07-18 21:51:21.484Z [-] My pid: 136
 2013-07-18 21:51:21.495Z [-] DatagramProtocol starting on 2551
 2013-07-18 21:51:21.495Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cc4994c>
 2013-07-18 21:51:21.503Z [-] DatagramProtocol starting on 2552
 2013-07-18 21:51:21.504Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cc49d8c>
 2013-07-18 21:51:21.509Z [-] DatagramProtocol starting on 2553
 2013-07-18 21:51:21.510Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cc49ccc>
 2013-07-18 21:51:21.519Z [-] (UDP Port 2551 Closed)
 2013-07-18 21:51:21.519Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cc4994c>
 2013-07-18 21:51:21.520Z [-] (UDP Port 2552 Closed)
 2013-07-18 21:51:21.520Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cc49d8c>
 2013-07-18 21:51:21.521Z [-] (UDP Port 2553 Closed)
 2013-07-18 21:51:21.521Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cc49ccc>
 2013-07-18 21:51:21.644Z [-] Listener starting on 2554
 2013-07-18 21:51:21.658Z [-] DatagramProtocol starting on 2555
 2013-07-18 21:51:21.658Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7d580a2c>
 2013-07-18 21:51:21.918Z [-] Listener starting on 2556
 2013-07-18 21:51:21.927Z [-] NevowSite starting on 2557
 2013-07-18 21:51:21.927Z [-] Starting factory <nevow.appserver.NevowSite
 instance at 0x7e6e24ec>
 2013-07-18 21:51:21.931Z [-] My pid: 136
 2013-07-18 21:51:21.932Z [-] (UDP Port 2555 Closed)
 2013-07-18 21:51:21.932Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7d580a2c>
 2013-07-18 21:51:21.941Z [-] DatagramProtocol starting on 2558
 2013-07-18 21:51:21.942Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cc4942c>
 2013-07-18 21:51:21.948Z [-] DatagramProtocol starting on 2559
 2013-07-18 21:51:21.949Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7e6e202c>
 2013-07-18 21:51:21.953Z [-] DatagramProtocol starting on 2560
 2013-07-18 21:51:21.954Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7e6e2cac>
 2013-07-18 21:51:21.961Z [-] (UDP Port 2558 Closed)
 2013-07-18 21:51:21.961Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cc4942c>
 2013-07-18 21:51:21.962Z [-] (UDP Port 2559 Closed)
 2013-07-18 21:51:21.962Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7e6e202c>
 2013-07-18 21:51:21.963Z [-] (UDP Port 2560 Closed)
 2013-07-18 21:51:21.963Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7e6e2cac>
 2013-07-18 21:51:22.135Z [-] Listener starting on 2561
 2013-07-18 21:51:22.144Z [-] My pid: 136
 2013-07-18 21:51:22.309Z [-] Listener starting on 2562
 2013-07-18 21:51:22.316Z [-] My pid: 136
 2013-07-18 21:51:23.019Z [-] Listener starting on 2563
 2013-07-18 21:51:23.029Z [-] NevowSite starting on 2564
 2013-07-18 21:51:23.029Z [-] Starting factory <nevow.appserver.NevowSite
 instance at 0x7e6bb3cc>
 2013-07-18 21:51:23.034Z [-] My pid: 136
 2013-07-18 21:51:23.181Z [-] Listener starting on 2565
 2013-07-18 21:51:23.190Z [-] My pid: 136
 2013-07-18 21:51:23.201Z [-] DatagramProtocol starting on 2568
 2013-07-18 21:51:23.201Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7e6e2c2c>
 2013-07-18 21:51:23.210Z [-] DatagramProtocol starting on 2569
 2013-07-18 21:51:23.210Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b4cc>
 2013-07-18 21:51:23.215Z [-] DatagramProtocol starting on 2570
 2013-07-18 21:51:23.216Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b50c>
 2013-07-18 21:51:23.232Z [-] DatagramProtocol starting on 2571
 2013-07-18 21:51:23.232Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b14c>
 2013-07-18 21:51:23.241Z [-] DatagramProtocol starting on 2572
 2013-07-18 21:51:23.242Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b66c>
 2013-07-18 21:51:23.248Z [-] DatagramProtocol starting on 2573
 2013-07-18 21:51:23.248Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b3ec>
 2013-07-18 21:51:23.269Z [-] DatagramProtocol starting on 2574
 2013-07-18 21:51:23.270Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd4608c>
 2013-07-18 21:51:23.277Z [-] DatagramProtocol starting on 2575
 2013-07-18 21:51:23.277Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd4634c>
 2013-07-18 21:51:23.283Z [-] DatagramProtocol starting on 2576
 2013-07-18 21:51:23.284Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd46eec>
 2013-07-18 21:51:23.297Z [-] DatagramProtocol starting on 2577
 2013-07-18 21:51:23.297Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd4688c>
 2013-07-18 21:51:23.304Z [-] DatagramProtocol starting on 2578
 2013-07-18 21:51:23.305Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd46a0c>
 2013-07-18 21:51:23.310Z [-] DatagramProtocol starting on 2579
 2013-07-18 21:51:23.311Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7ce2ebac>
 2013-07-18 21:51:23.329Z [-] (UDP Port 2568 Closed)
 2013-07-18 21:51:23.329Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7e6e2c2c>
 2013-07-18 21:51:23.330Z [-] (UDP Port 2569 Closed)
 2013-07-18 21:51:23.331Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b4cc>
 2013-07-18 21:51:23.331Z [-] (UDP Port 2570 Closed)
 2013-07-18 21:51:23.332Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b50c>
 2013-07-18 21:51:23.492Z [-] (UDP Port 2571 Closed)
 2013-07-18 21:51:23.492Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b14c>
 2013-07-18 21:51:23.493Z [-] (UDP Port 2572 Closed)
 2013-07-18 21:51:23.493Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b66c>
 2013-07-18 21:51:23.494Z [-] (UDP Port 2573 Closed)
 2013-07-18 21:51:23.494Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7cb5b3ec>
 2013-07-18 21:51:23.497Z [-] (UDP Port 2574 Closed)
 2013-07-18 21:51:23.497Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd4608c>
 2013-07-18 21:51:23.497Z [-] (UDP Port 2575 Closed)
 2013-07-18 21:51:23.497Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd4634c>
 2013-07-18 21:51:23.498Z [-] (UDP Port 2576 Closed)
 2013-07-18 21:51:23.498Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd46eec>
 2013-07-18 21:51:23.499Z [-] (UDP Port 2577 Closed)
 2013-07-18 21:51:23.499Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd4688c>
 2013-07-18 21:51:23.500Z [-] (UDP Port 2578 Closed)
 2013-07-18 21:51:23.500Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dd46a0c>
 2013-07-18 21:51:23.500Z [-] (UDP Port 2579 Closed)
 2013-07-18 21:51:23.500Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7ce2ebac>
 2013-07-18 21:51:27.782Z [-] Starting factory <HTTPClientFactory:
 http://127.0.0.1:2550/>
 2013-07-18 21:51:28.068Z [HTTPPageGetter,client] Starting factory
 <HTTPClientFactory: http://127.0.0.1:2550/tahoe.css>
 2013-07-18 21:51:28.071Z [HTTPPageGetter,client] Stopping factory
 <HTTPClientFactory: http://127.0.0.1:2550/>
 2013-07-18 21:51:28.092Z [HTTPPageGetter,client] Starting factory
 <HTTPClientFactory: http://127.0.0.1:2550/?t=json>
 2013-07-18 21:51:28.093Z [HTTPPageGetter,client] Stopping factory
 <HTTPClientFactory: http://127.0.0.1:2550/tahoe.css>
 2013-07-18 21:51:28.299Z [HTTPPageGetter,client] Stopping factory
 <HTTPClientFactory: http://127.0.0.1:2550/?t=json>
 2013-07-18 21:51:36.534Z [-] (TCP Port 2557 Closed)
 2013-07-18 21:51:36.536Z [-] Stopping factory <nevow.appserver.NevowSite
 instance at 0x7e6e24ec>
 2013-07-18 21:51:36.537Z [-] (TCP Port 2556 Closed)
 2013-07-18 21:51:37.802Z [-] Listener starting on 2556
 2013-07-18 21:51:37.830Z [-] NevowSite starting on 2645
 2013-07-18 21:51:37.830Z [-] Starting factory <nevow.appserver.NevowSite
 instance at 0x7e33286c>
 2013-07-18 21:51:37.834Z [-] My pid: 136
 2013-07-18 21:51:37.852Z [-] DatagramProtocol starting on 2648
 2013-07-18 21:51:37.852Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dac88ec>
 2013-07-18 21:51:37.860Z [-] DatagramProtocol starting on 2649
 2013-07-18 21:51:37.860Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dac828c>
 2013-07-18 21:51:37.866Z [-] DatagramProtocol starting on 2650
 2013-07-18 21:51:37.866Z [-] Starting protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dac874c>
 2013-07-18 21:51:37.875Z [-] (UDP Port 2648 Closed)
 2013-07-18 21:51:37.875Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dac88ec>
 2013-07-18 21:51:37.876Z [-] (UDP Port 2649 Closed)
 2013-07-18 21:51:37.876Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dac828c>
 2013-07-18 21:51:37.877Z [-] (UDP Port 2650 Closed)
 2013-07-18 21:51:37.877Z [-] Stopping protocol
 <twisted.internet.protocol.DatagramProtocol instance at 0x7dac874c>
 2013-07-18 21:51:38.831Z [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: replaced by a new
 connection

 2013-07-18 21:51:38.948Z [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=njea) (during
 method=RIIntroducerPublisherAndSubscriberService_v2.tahoe.allmydata.com:subscribe_v2)

 2013-07-18 21:51:38.951Z [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=ncie) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 2013-07-18 21:51:38.953Z [-] (TCP Port 2645 Closed)
 2013-07-18 21:51:38.954Z [-] Stopping factory <nevow.appserver.NevowSite
 instance at 0x7e33286c>
 2013-07-18 21:51:38.955Z [-] (TCP Port 2556 Closed)
 2013-07-18 21:51:38.956Z [-] (TCP Port 2565 Closed)
 2013-07-18 21:51:38.957Z [-] (TCP Port 2564 Closed)
 2013-07-18 21:51:38.958Z [-] Stopping factory <nevow.appserver.NevowSite
 instance at 0x7e6bb3cc>
 2013-07-18 21:51:38.958Z [-] (TCP Port 2563 Closed)
 2013-07-18 21:51:38.959Z [-] (TCP Port 2562 Closed)
 2013-07-18 21:51:38.960Z [-] (TCP Port 2561 Closed)
 2013-07-18 21:51:38.962Z [-] (TCP Port 2554 Closed)
 2013-07-18 21:51:38.964Z [-] (TCP Port 2549 Closed)
 2013-07-18 21:51:38.965Z [-] (TCP Port 2550 Closed)
 2013-07-18 21:51:38.966Z [-] Stopping factory <nevow.appserver.NevowSite
 instance at 0x7cc48b8c>
 2013-07-18 21:51:39.019Z [-] Main loop terminated.
 }}}

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1768#comment:6>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage


More information about the tahoe-lafs-trac-stream mailing list