[tahoe-lafs-trac-stream] [Tahoe-LAFS] #3672: UnicodeDecodeError in Eliot messages

[Tahoe-LAFS]

#3672: UnicodeDecodeError in Eliot messages
----------------------+----------------------------------
 Reporter:  itamarst  |          Owner:
     Type:  defect    |         Status:  new
 Priority:  normal    |      Milestone:  Support Python 3
Component:  unknown   |        Version:  n/a
 Keywords:            |  Launchpad Bug:
----------------------+----------------------------------
 Eliot in Tahoe-LAFS currently assumes bytes are always UTF-8 encoded. This
 is not always the case.

 Running `trial allmydata`:

 {{{
 {"exception": "exceptions.UnicodeDecodeError", "timestamp":
 1617718191.704726, "task_uuid": "a8ecfc19-947b-46e2-a1dd-bffcb4be5fc5",
 "reason": "'utf8' codec can't decode byte 0x9d in position 6: invalid
 start byte", "message": "{u\"u'message_type'\": u\"u'immutable:upload:get-
 share-placements'\", u\"u'timestamp'\": u'1617718191.704558',
 u\"'happiness_mappings'\": u\"{0: 'b3llgpwwqwozijzje7ydgossrdyqig5e'}\",
 u\"'happiness'\": u'1', u\"'existing_shares'\":
 u'{\"\\\\x0e\\\\xd6\\\\xb3>\\\\xd6\\\\x85\\\\x9d\\\\x94\\')\\'\\\\xf03:R\\\\x88\\\\xf1\\\\x04\\\\x1b\\\\xa4\":
 [0]}', u\"u'task_level'\": u'[2, 3, 2]', u\"u'task_uuid'\": u\"u'a8ecfc19
 -947b-46e2-a1dd-bffcb4be5fc5'\", u\"'total_shares'\": u'1', u\"'peers'\":
 u\"['6jdspiha6nw2az6fqglwfzbu2c2uvnfg',
 'b3llgpwwqwozijzje7ydgossrdyqig5e']\", u\"'readonly_peers'\": u'[]'}",
 "message_type": "eliot:destination_failure", "task_level": [2, 3, 3]}
 {"timestamp": 1617718191.715011, "task_uuid": "a8ecfc19-947b-46e2-a1dd-
 bffcb4be5fc5", "message_type": "immutable:upload:get-shareholders
 :converged-happiness", "effective_happiness": 1, "task_level": [2, 3, 4]}
 {"exception": "exceptions.UnicodeDecodeError", "timestamp":
 1617718191.715412, "task_uuid": "a8ecfc19-947b-46e2-a1dd-bffcb4be5fc5",
 "reason": "'utf8' codec can't decode byte 0x9d in position 6: invalid
 start byte", "message": "{u\"u'timestamp'\": u'1617718191.715314',
 u\"u'action_status'\": u\"u'succeeded'\", u\"'upload_trackers'\": u'[]',
 u\"u'task_level'\": u'[2, 3, 5]', u\"u'task_uuid'\": u\"u'a8ecfc19-947b-
 46e2-a1dd-bffcb4be5fc5'\", u\"'already_serverids'\": u'{0:
 set([\"\\\\x0e\\\\xd6\\\\xb3>\\\\xd6\\\\x85\\\\x9d\\\\x94\\')\\'\\\\xf03:R\\\\x88\\\\xf1\\\\x04\\\\x1b\\\\xa4\"])}',
 u\"u'action_type'\": u\"u'immutable:upload:locate-all-shareholders'\"}",
 "message_type": "eliot:destination_failure", "task_level": [2, 4]}
 }}}

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/3672>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage