[tahoe-lafs-trac-stream] [tahoe-lafs] #1678: S3 backend: either handle or avoid truncated get_bucket responses

[tahoe-lafs]

#1678: S3 backend: either handle or avoid truncated get_bucket responses
----------------------------+--------------------------------
 Reporter:  davidsarah      |          Owner:
     Type:  defect          |         Status:  new
 Priority:  major           |      Milestone:  soon
Component:  code-storage    |        Version:  1.9.0-s3branch
 Keywords:  s3-backend 410  |  Launchpad Bug:
----------------------------+--------------------------------
 The GET Bucket AWS call may return a truncated response, by default after
 1000 objects
 [http://docs.amazonwebservices.com/AmazonS3/latest/API/RESTBucketGET.html
 (doc)]. Currently we don't take that into account (actually I forgot that
 we didn't :-( ), which might be causing some of the 410 Gone errors.

 In the meantime, here is a patch to log this case as WEIRD, so that it
 will trigger an incident.

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1678>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage