[tahoe-lafs-trac-stream] [Tahoe-LAFS] #2364: Clients in onion grid busy-wait if a storage node is unreachable

Tahoe-LAFS trac at tahoe-lafs.org
Sun Jan 18 22:26:53 UTC 2015


#2364: Clients in onion grid busy-wait if a storage node is unreachable
-------------------------+-------------------------------------------------
     Reporter:           |      Owner:
  mhazinsk               |     Status:  new
         Type:  defect   |  Milestone:  undecided
     Priority:  major    |    Version:  1.10.0
    Component:  code-    |   Keywords:  availability reliability anti-
  network                |  censorship tor
   Resolution:           |
Launchpad Bug:           |
-------------------------+-------------------------------------------------
Description changed by daira:

Old description:

> When running "torify tahoe start", the process uses 100% CPU while
> attempting to connect to a down storage node. Meanwhile, connections to
> all other storage nodes and the introducer show as intermittent on the
> grid status page so the grid is unusable.
>
> I'm using the latest trunk version of Tahoe on Arch Linux with Torsocks
> 2.0.0
>

> Here's the errors that get printed:
>
> [Jan 18 14:42:14] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> 2015-01-18 14:42:14-0500 [-] Unhandled Error
>         Traceback (most recent call last):
>         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
> tubid=awo7) (during
> method=RIStorageServer.tahoe.allmydata.com:get_version)
>
> 2015-01-18 14:42:14-0500 [-] Unhandled Error
>         Traceback (most recent call last):
>         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
> tubid=poce) (during
> method=RIIntroducerPublisherAndSubscriberService_v2.tahoe.allmydata.com:subscribe_v2)
>
> [Jan 18 14:42:24] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:42:33] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:42:56] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> 2015-01-18 14:42:56-0500 [-] Unhandled Error
>         Traceback (most recent call last):
>         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
> tubid=rnfm) (during
> method=RIStorageServer.tahoe.allmydata.com:get_version)
>
> [Jan 18 14:43:20] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:43:33] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:43:43] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> 2015-01-18 14:43:43-0500 [-] Unhandled Error
>         Traceback (most recent call last):
>         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
> tubid=xivp) (during
> method=RIStorageServer.tahoe.allmydata.com:get_version)
>
> 2015-01-18 14:43:43-0500 [-] Unhandled Error
>         Traceback (most recent call last):
>         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
> tubid=rnfm) (during
> method=RIStorageServer.tahoe.allmydata.com:get_version)
>
> 2015-01-18 14:43:43-0500 [-] Unhandled Error
>         Traceback (most recent call last):
>         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
> tubid=poce) (during
> method=RIIntroducerPublisherAndSubscriberService_v2.tahoe.allmydata.com:subscribe_v2)
>
> [Jan 18 14:43:53] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:44:20] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:44:35] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:44:47] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> 2015-01-18 14:44:47-0500 [-] Unhandled Error
>         Traceback (most recent call last):
>         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
> tubid=rnfm) (during
> method=RIStorageServer.tahoe.allmydata.com:get_version)
>
> [Jan 18 14:44:58] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:45:23] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:45:34] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:45:53] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> [Jan 18 14:46:21] ERROR torsocks[15086]: Host unreachable (in
> socks5_recv_connect_reply() at socks5.c:528)
> 2015-01-18 14:46:21-0500 [-] Reconnector._failed (furl=[redacted]):
> [Failure instance: Traceback (failure with no frames): <class
> 'foolscap.tokens.NegotiationError'>: no connection established within
> client timeout

New description:

 When running "torify tahoe start", the process uses 100% CPU while
 attempting to connect to a down storage node. Meanwhile, connections to
 all other storage nodes and the introducer show as intermittent on the
 grid status page so the grid is unusable.

 I'm using the latest trunk version of Tahoe on Arch Linux with Torsocks
 2.0.0


 Here's the errors that get printed:
 {{{
 [Jan 18 14:42:14] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:42:14-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=awo7) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 2015-01-18 14:42:14-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=poce) (during
 method=RIIntroducerPublisherAndSubscriberService_v2.tahoe.allmydata.com:subscribe_v2)

 [Jan 18 14:42:24] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:42:33] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:42:56] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:42:56-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=rnfm) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 [Jan 18 14:43:20] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:43:33] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:43:43] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:43:43-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=xivp) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 2015-01-18 14:43:43-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=rnfm) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 2015-01-18 14:43:43-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=poce) (during
 method=RIIntroducerPublisherAndSubscriberService_v2.tahoe.allmydata.com:subscribe_v2)

 [Jan 18 14:43:53] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:44:20] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:44:35] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:44:47] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:44:47-0500 [-] Unhandled Error
         Traceback (most recent call last):
         Failure: foolscap.ipb.DeadReferenceError: Connection was lost (to
 tubid=rnfm) (during
 method=RIStorageServer.tahoe.allmydata.com:get_version)

 [Jan 18 14:44:58] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:45:23] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:45:34] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:45:53] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 [Jan 18 14:46:21] ERROR torsocks[15086]: Host unreachable (in
 socks5_recv_connect_reply() at socks5.c:528)
 2015-01-18 14:46:21-0500 [-] Reconnector._failed (furl=[redacted]):
 [Failure instance: Traceback (failure with no frames): <class
 'foolscap.tokens.NegotiationError'>: no connection established within
 client timeout
 }}}

--

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2364#comment:2>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage


More information about the tahoe-lafs-trac-stream mailing list