[tahoe-lafs-trac-stream] [tahoe-lafs] #1991: cloud backend fails with DataUnavailable when uploading+downloading a 10 GB file

[tahoe-lafs]

#1991: cloud backend fails with DataUnavailable when uploading+downloading a 10 GB
file
-------------------------------------------------+-------------------------
 Reporter:  daira                                |          Owner:  daira
     Type:  defect                               |         Status:  new
 Priority:  normal                               |      Milestone:
Component:  code-storage                         |  undecided
 Keywords:  DataUnavailable error large cloud-   |        Version:  1.10.0
  backend immutable upload download              |  Launchpad Bug:
-------------------------------------------------+-------------------------
 {{{
 $ bin/tahoe put ~/tahoe/grid/random azure:random
 201 Created
 URI:CHK:[censored]:1:1:10000000000
 $ bin/tahoe webopen azure:
 }}}

 The upload appeared to succeed, taking about 4 hours. (There were errors
 on some HTTP PUT requests but they were all successfully retried.) The
 file is listed in the directory. However:

 {{{
 $ time bin/tahoe get URI:CHK:[censored]:1:1:10000000000
 Error during GET: 410 Gone
 "NoSharesError: no shares could be found. Zero shares usually indicates a
 corrupt URI, or that no servers were connected, but it might also indicate
 severe corruption. You should perform a filecheck on this object to learn
 more.

 The full error message is:
 no shares (need 1). Last failure: [Failure instance: Traceback (failure
 with no frames): <class
 'allmydata.immutable.downloader.share.DataUnavailable'>: need len=1160:
 [10008388708-10008388739],[10008388772-10008388803],
 [10008388900-10008388931],[10008389156-10008389187],[10008389668-10008389699],
 [10008390692-10008390723],[10008392740-10008392771],[10008396836-10008396867],
 [10008405028-10008405059],[10008421412-10008421443],[10008454180-10008454211],
 [10008519716-10008519747],[10008650788-10008650819],[10008912932-10008912963],
 [10009437220-10009437251],[10010485796-10010485827],[10012582916-10012582979],
 [10016777284-10016777315],[10016777348-10016777379],[10016777476-10016777507],
 [10016777732-10016777763],[10016778244-10016778275],[10016779268-10016779299],
 [10016781316-10016781347],[10016785412-10016785443],[10016793604-10016793635],
 [10016809988-10016810019],[10016842756-10016842787],[10016908292-10016908323],
 [10017039364-10017039395],[10017301508-10017301539],[10017825796-10017825827],
 [10018874372-10018874403],[10020971492-10020971555],[10025165830-10025165837]
  but will never get it
 ]"

 real    0m4.025s
 user    0m0.268s
 sys     0m0.044s
 }}}

 The entry in the leasedb {{{shares}}} table is:
 {{{
 storage_index               shnum  prefix  backend_key  used_space
 sharetype  state
 ohcac6xn5ot7hxwfcstdeqcf4e  0      oh                   10016777607  0
 1
 }}}
 (sharetype 0 is immutable; state 1 is STABLE).

 The disk backend is capable of storing files this size.

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1991>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage