[tahoe-lafs-trac-stream] [tahoe-lafs] #1791: UploadUnhappinessError with available storage nodes > shares.happy

[tahoe-lafs]

#1791: UploadUnhappinessError with available storage nodes > shares.happy
---------------------------+-----------------------------------------------
     Reporter:  gyver      |      Owner:  gyver
         Type:  defect     |     Status:  new
     Priority:  major      |  Milestone:  1.10.0
    Component:  code-      |    Version:  1.9.2
  peerselection            |   Keywords:  servers-of-happiness upload error
   Resolution:             |
Launchpad Bug:             |
---------------------------+-----------------------------------------------

Comment (by davidsarah):

 Replying to [comment:12 gyver]:
 > 03:09:17.469 L20 []#2496 servers before upload:
 > frozenset([<NativeStorageServer for zp6jpfeu>, <NativeStorageServer for
 omkzwfx5>, <NativeStorageServer for lehmccp7>, <NativeStorageServer for
 wo6akhxt>, <NativeStorageServer for ughwvrtu>, <NativeStorageServer for
 pa2myijh>, <NativeStorageServer for d3fycapp>])
 > permuted to [<NativeStorageServer for zp6jpfeu>, <NativeStorageServer
 for pa2myijh>, <NativeStorageServer for omkzwfx5>, <NativeStorageServer
 for wo6akhxt>, <NativeStorageServer for ughwvrtu>, <NativeStorageServer
 for lehmccp7>, <NativeStorageServer for d3fycapp>],
 > of which [<NativeStorageServer for zp6jpfeu>, <NativeStorageServer for
 pa2myijh>, <NativeStorageServer for omkzwfx5>, <NativeStorageServer for
 wo6akhxt>, <NativeStorageServer for ughwvrtu>, <NativeStorageServer for
 lehmccp7>, <NativeStorageServer for d3fycapp>]
 > are writeable and set([]) are read-only

 OK, that proves that the problem occurs after deciding which servers are
 writeable. We seem to be logging only ''responses'' to remote
 {{{allocate_buckets}}} requests at the gateway, so the next steps are:

 a) Log when the gateway sends an {{{allocate_buckets}}} request.

 b) Look at the logs of the storage servers to see how many of them receive
 an {{{allocate_buckets}}} request (which is logged
 [source:1.9.2/src/allmydata/storage/server.py#L248 here] as "{{{storage:
 allocate_buckets <SI>}}}") and what they do about it.

 To do a), add this at line 105 of {{{src/allmydata/immutable/upload.py}}}
 (in the {{{query}}} method of {{{ServerTracker}}} after {{{rref =
 self._server.get_rref()}}}):
 {{{
         log.msg("query(%(sharenums)s) for %(rref)s",
 sharenums=repr(sharenums), rref=repr(rref), level=log.OPERATIONAL)
 }}}

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1791#comment:13>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage