[tahoe-lafs-trac-stream] [Tahoe-LAFS] #2364: Clients in onion grid busy-wait if a storage node is unreachable

[Tahoe-LAFS]

#2364: Clients in onion grid busy-wait if a storage node is unreachable
-------------------------------------------------+-------------------------
 Reporter:  mhazinsk                             |          Owner:
     Type:  defect                               |         Status:  new
 Priority:  major                                |      Milestone:
Component:  unknown                              |  undecided
 Keywords:  availability reliability anti-       |        Version:  1.10.0
  censorship                                     |  Launchpad Bug:
-------------------------------------------------+-------------------------
 When running "torify tahoe start", the process uses 100% CPU while
 attempting to connect to a down storage node. Meanwhile, connections to
 all other storage nodes and the introducer show as intermittent on the
 grid status page so the grid is unusable.

 I'm using the latest trunk version of Tahoe on Arch Linux with Torsocks
 2.0.0


 Here's the errors that get printed:

 [Jan 18 14:42:14] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:42:14-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=awo7) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 2015-01-18 14:42:14-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=poce) (during
 method=RIIntroducerPublisherAndSubscriberService_v2.tahoe.allmydata.com:subscribe_v2)

 [Jan 18 14:42:24] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:42:33] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:42:56] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:42:56-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=rnfm) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 [Jan 18 14:43:20] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:43:33] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:43:43] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:43:43-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=xivp) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 2015-01-18 14:43:43-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=rnfm) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 2015-01-18 14:43:43-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=poce) (during
 method=RIIntroducerPublisherAndSubscriberService_v2.tahoe.allmydata.com:subscribe_v2)

 [Jan 18 14:43:53] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:44:20] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:44:35] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:44:47] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:44:47-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=rnfm) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 [Jan 18 14:44:58] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:45:23] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:45:34] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:45:53] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:46:21] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:46:21-0500 [-] Reconnector._failed (furl=[redacted]):
 [Failure instance: Traceback (failure with no frames): <class
 'foolscap.tokens.NegotiationError'>: no connection established within
 client timeout

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2364>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage