Opened at 2010-07-20T02:33:07Z
Last modified at 2021-03-30T18:40:19Z
#1130 new defect
Failure to achieve happiness in upload — at Version 5
Reported by: | kmarkley86 | Owned by: | nobody |
---|---|---|---|
Priority: | major | Milestone: | soon |
Component: | code-peerselection | Version: | 1.7.1 |
Keywords: | upload repair rebalancing availability unfinished-business servers-of-happiness | Cc: | |
Launchpad Bug: |
Description (last modified by davidsarah)
Prior to Tahoe-LAFS v1.7.1, the immutable uploader would sometimes raise an assertion error (#1118). We fixed that problem, and we also fixed the problem of uploader uploading an insufficiently well-distributed set of shares while thinking that it achieved servers-of-happiness. But now uploader gives up and doesn't upload at all, saying that it hasn't achieved happiness, when if it were smarter it could achieve happiness. This ticket is to make it successfully upload in this case.
Log excerpt:
19:12:35.519 L20 []#1337 CHKUploader starting 19:12:35.519 L20 []#1338 starting upload of <allmydata.immutable.upload.EncryptAnUploadable instance at 0x20886b5a8> 19:12:35.520 L20 []#1339 creating Encoder <Encoder for unknown storage index> 19:12:35.520 L20 []#1340 file size: 106 19:12:35.520 L10 []#1341 my encoding parameters: (2, 4, 4, 106) 19:12:35.520 L20 []#1342 got encoding parameters: 2/4/4 106 19:12:35.520 L20 []#1343 now setting up codec 19:12:35.520 L20 []#1344 using storage index 5xpii 19:12:35.520 L20 []#1345 <Tahoe2PeerSelector for upload 5xpii> starting 19:12:35.633 L10 []#1346 response from peer 47cslusc: alreadygot=(), allocated=(0,) 19:12:36.590 L10 []#1347 response from peer vjqcroal: alreadygot=(0, 3), allocated=(1,) 19:12:37.119 L10 []#1348 response from peer sn4ana4b: alreadygot=(1,), allocated=(2,) 19:12:37.124 L20 []#1349 storage: allocate_buckets 5xpiivbjrybcmy4ws7xp7dxez4 19:12:37.130 L10 []#1350 response from peer yuzbctlc: alreadygot=(2,), allocated=(0,) 19:12:37.130 L25 []#1351 server selection unsuccessful for <Tahoe2PeerSelector for upload 5xpii>: shares could be placed on only 3 server(s) such that any 2 of them have enough shares to recover the file, but we were asked to place shares on at least 4 such servers. (placed all 4 shares, want to place shares on at least 4 servers such that any 2 of them have enough shares to recover the file, sent 4 queries to 4 peers, 4 queries placed some shares, 0 placed none (of which 0 placed none due to the server being full and 0 placed none due to an error)), merged={0: set(['\xc52\x11Mb\xa1\xff\x8d\xafn\x0b#s\x17\xbe\x82\x85\x93G0']), 1: set(['\xaa`(\xb8\x0b\x89\x98Y\xfb\xcc2,T\xd0\xde\xf7\xca\xbfA#', '\x93x\x06\x83\x81\xdb\x12*\xe5\xb095T\xf0\x1e\xa5\x00V+\x0f']), 2: set(['\xc52\x11Mb\xa1\xff\x8d\xafn\x0b#s\x17\xbe\x82\x85\x93G0', '\x93x\x06\x83\x81\xdb\x12*\xe5\xb095T\xf0\x1e\xa5\x00V+\x0f']), 3: set(['\xaa`(\xb8\x0b\x89\x98Y\xfb\xcc2,T\xd0\xde\xf7\xca\xbfA#'])} 19:12:37.133 L20 []#1352 web: 127.0.0.1 PUT /uri/[CENSORED].. 500 1826 19:12:37.148 L23 []#1353 storage: aborting sharefile /home/tahoe/.tahoe/storage/shares/incoming/5x/5xpiivbjrybcmy4ws7xp7dxez4/0
Change History (6)
Changed at 2010-07-20T02:33:43Z by kmarkley86
comment:1 Changed at 2010-07-20T02:34:46Z by kmarkley86
- Description modified (diff)
comment:2 Changed at 2010-07-20T02:44:44Z by kmarkley86
I think I had originally uploaded this file when I was configured to use encoding parameters 2/3/4. That may explain the original distribution of the shares. I assume it's legal for a client to change their parameters (as I did, to 2/4/4) and continue using the grid. In this case the share needs to be migrated, but the migration doesn't happen.
comment:3 Changed at 2010-07-20T03:04:36Z by davidsarah
- Component changed from unknown to code-peerselection
- Description modified (diff)
- Keywords upload rebalancing added
- Version changed from 1.7.0 to 1.7.1
comment:4 Changed at 2010-07-20T03:05:15Z by davidsarah
- Keywords availability added
comment:5 Changed at 2010-07-20T03:12:25Z by davidsarah
- Description modified (diff)
Log from flogtool