[tahoe-lafs-trac-stream] [Tahoe-LAFS] #2251: Database full or disk full error, stops backups

Tahoe-LAFS trac at tahoe-lafs.org
Thu Jul 24 00:25:47 UTC 2014


#2251: Database full or disk full error, stops backups
-----------------------------------+---------------------------------
     Reporter:  CyberAxe           |      Owner:  daira
         Type:  defect             |     Status:  new
     Priority:  normal             |  Milestone:  undecided
    Component:  code-frontend-cli  |    Version:  1.10.0
   Resolution:                     |   Keywords:  database full space
Launchpad Bug:                     |
-----------------------------------+---------------------------------
Changes (by daira):

 * cc: daira (removed)
 * keywords:  database, full, file space => database full space
 * component:  unknown => code-frontend-cli


Old description:

> http://sebsauvage.net/paste/?86d37574a47fd008#Xcj23YbPlxSMZ63yIVfune6X+kxkHQSCQ9Hm7kJmqkI=
>
> {{{
> ZeroBin is a minimalist, opensource online pastebin where the server has
> zero knowledge of pasted data. Data is encrypted/decrypted in the browser
> using 256 bits AES. More information on the project page.
> ▶ Note: This is a test service: Data may be deleted anytime. Kittens will
> die if you abuse this service.
> ZeroBinZeroBin
> Because ignorance is bliss
> Alpha 0.19.2
>

>

>

>
> New  Clone Raw text
>
> This document will expire in 29 days.
>

>

>

>

> C:\allmydata-tahoe-1.10.0\bin>Backup-Now
>
> C:\allmydata-tahoe-1.10.0\bin>ECHO OFF
> Traceback (most recent call last):
>   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\runner.py", line
> 156, in run
>     rc = runner(sys.argv[1:], install_node_control=install_node_control)
>   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\runner.py", line
> 141, in runner
>     rc = cli.dispatch[command](so)
>   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\cli.py", line
> 574, in backup
>     rc = tahoe_backup.backup(options)
>   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py",
> line 325, in backup
>     return bu.run()
>   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py",
> line 118, in run
>     new_backup_dircap = self.process(options.from_dir)
>   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py",
> line 211, in process
>     newdircap = mkdir(create_contents, self.options)
>   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py",
> line 47, in mkdir
>     raise HTTPError("Error during mkdir", resp)
> HTTPError: Error during mkdir: 500 Internal Server Error
> "Traceback (most recent call last):
>   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
> packages\\foolscap-0.6.4-py2.7.egg\\foolscap\\call.py\", line 753, in
> receiveClose
>     self.request.fail(f)
>   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
> packages\\foolscap-0.6.4-py2.7.egg\\foolscap\\call.py\", line 95, in fail
>     self.deferred.errback(why)
>   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
> packages\\twisted-12.3.0-py2.7-win-
> amd64.egg\\twisted\\internet\\defer.py\", line 42
> 2, in errback
>     self._startRunCallbacks(fail)
>   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
> packages\\twisted-12.3.0-py2.7-win-
> amd64.egg\\twisted\\internet\\defer.py\", line 48
> 9, in _startRunCallbacks
>     self._runCallbacks()
> --- <exception caught here> ---
>   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
> packages\\twisted-12.3.0-py2.7-win-
> amd64.egg\\twisted\\internet\\defer.py\", line 57
> 6, in _runCallbacks
>     current.result = callback(current.result, *args, **kw)
>   File \"c:\\allmydata-
> tahoe-1.10.0\\src\\allmydata\\immutable\\upload.py\", line 604, in
> _got_response
>     return self._loop()
>   File \"c:\\allmydata-
> tahoe-1.10.0\\src\\allmydata\\immutable\\upload.py\", line 516, in _loop
>     return self._failed(msg)
>   File \"c:\\allmydata-
> tahoe-1.10.0\\src\\allmydata\\immutable\\upload.py\", line 617, in
> _failed
>     raise UploadUnhappinessError(msg)
> allmydata.interfaces.UploadUnhappinessError: server selection failed for
> <Tahoe2ServerSelector for upload 66ww6>: shares could be placed or
> found on only 0 server(s). We were asked to place shares on at least 1
> server(s) such that any 1 of them have enough shares to recover the f
> ile. (placed 0 shares out of 1 total (1 homeless), want to place shares
> on at least 1 servers such that any 1 of them have enough shares to
> recover the file, sent 1 queries to 1 servers, 0 queries placed some
> shares, 1 placed none (of which 0 placed none due to the server being f
> ull and 1 placed none due to an error)) (last failure (from
> <ServerTracker for server xfia4afr and SI 66ww6>) was: [Failure instance:
> Traceb
> ack (failure with no frames): <class 'foolscap.tokens.RemoteException'>:
> <RemoteException around '[CopiedFailure instance: Traceback from re
> mote host -- Traceback (most recent call last):
>   File \"/home/customer/LAFS_source/src/allmydata/storage/server.py\",
> line 258, in <lambda>
>     canary))
>   File
> \"/home/customer/LAFS_source/src/allmydata/storage/backends/cloud/cloud_backend.py\",
> line 175, in make_bucket_writer
>     d.addCallback(lambda ign: BucketWriter(account, immsh, canary))
>   File \"/usr/local/lib/python2.7/dist-
> packages/Twisted-13.2.0-py2.7-linux-i686.egg/twisted/internet/defer.py\",
> line 306, in addCallback
>     callbackKeywords=kw)
>   File \"/usr/local/lib/python2.7/dist-
> packages/Twisted-13.2.0-py2.7-linux-i686.egg/twisted/internet/defer.py\",
> line 295, in addCallbacks
>     self._runCallbacks()
> --- <exception caught here> ---
>   File \"/usr/local/lib/python2.7/dist-
> packages/Twisted-13.2.0-py2.7-linux-i686.egg/twisted/internet/defer.py\",
> line 577, in _runCallbacks
>     current.result = callback(current.result, *args, **kw)
>   File
> \"/home/customer/LAFS_source/src/allmydata/storage/backends/cloud/cloud_backend.py\",
> line 175, in <lambda>
>     d.addCallback(lambda ign: BucketWriter(account, immsh, canary))
>   File \"/home/customer/LAFS_source/src/allmydata/storage/bucket.py\",
> line 28, in __init__
>     share.get_allocated_data_length(), SHARETYPE_IMMUTABLE)
>   File \"/home/customer/LAFS_source/src/allmydata/storage/account.py\",
> line 54, in add_share
>     self._leasedb.add_new_share(storage_index, shnum, used_space,
> sharetype)
>   File \"/home/customer/LAFS_source/src/allmydata/storage/leasedb.py\",
> line 176, in add_new_share
>     (si_s, shnum, prefix, backend_key, used_space, sharetype,
> STATE_COMING))
> sqlite3.OperationalError: database or disk is full
> ]'>
> ])
> "
> }}}
>
> This was trying to backup 1 very small test file.
> I have 38GB of space locally.
> On windows

New description:

 http://sebsauvage.net/paste/?86d37574a47fd008#Xcj23YbPlxSMZ63yIVfune6X+kxkHQSCQ9Hm7kJmqkI=

 {{{
 [...]
 C:\allmydata-tahoe-1.10.0\bin>Backup-Now

 C:\allmydata-tahoe-1.10.0\bin>ECHO OFF
 Traceback (most recent call last):
   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\runner.py", line
 156, in run
     rc = runner(sys.argv[1:], install_node_control=install_node_control)
   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\runner.py", line
 141, in runner
     rc = cli.dispatch[command](so)
   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\cli.py", line 574,
 in backup
     rc = tahoe_backup.backup(options)
   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py",
 line 325, in backup
     return bu.run()
   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py",
 line 118, in run
     new_backup_dircap = self.process(options.from_dir)
   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py",
 line 211, in process
     newdircap = mkdir(create_contents, self.options)
   File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py",
 line 47, in mkdir
     raise HTTPError("Error during mkdir", resp)
 HTTPError: Error during mkdir: 500 Internal Server Error
 "Traceback (most recent call last):
   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
 packages\\foolscap-0.6.4-py2.7.egg\\foolscap\\call.py\", line 753, in
 receiveClose
     self.request.fail(f)
   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
 packages\\foolscap-0.6.4-py2.7.egg\\foolscap\\call.py\", line 95, in fail
     self.deferred.errback(why)
   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
 packages\\twisted-12.3.0-py2.7-win-
 amd64.egg\\twisted\\internet\\defer.py\", line 42
 2, in errback
     self._startRunCallbacks(fail)
   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
 packages\\twisted-12.3.0-py2.7-win-
 amd64.egg\\twisted\\internet\\defer.py\", line 48
 9, in _startRunCallbacks
     self._runCallbacks()
 --- <exception caught here> ---
   File \"C:\\allmydata-tahoe-1.10.0\\support\\Lib\\site-
 packages\\twisted-12.3.0-py2.7-win-
 amd64.egg\\twisted\\internet\\defer.py\", line 57
 6, in _runCallbacks
     current.result = callback(current.result, *args, **kw)
   File \"c:\\allmydata-
 tahoe-1.10.0\\src\\allmydata\\immutable\\upload.py\", line 604, in
 _got_response
     return self._loop()
   File \"c:\\allmydata-
 tahoe-1.10.0\\src\\allmydata\\immutable\\upload.py\", line 516, in _loop
     return self._failed(msg)
   File \"c:\\allmydata-
 tahoe-1.10.0\\src\\allmydata\\immutable\\upload.py\", line 617, in _failed
     raise UploadUnhappinessError(msg)
 allmydata.interfaces.UploadUnhappinessError: server selection failed for
 <Tahoe2ServerSelector for upload 66ww6>: shares could be placed or
 found on only 0 server(s). We were asked to place shares on at least 1
 server(s) such that any 1 of them have enough shares to recover the f
 ile. (placed 0 shares out of 1 total (1 homeless), want to place shares on
 at least 1 servers such that any 1 of them have enough shares to
 recover the file, sent 1 queries to 1 servers, 0 queries placed some
 shares, 1 placed none (of which 0 placed none due to the server being f
 ull and 1 placed none due to an error)) (last failure (from <ServerTracker
 for server xfia4afr and SI 66ww6>) was: [Failure instance: Traceb
 ack (failure with no frames): <class 'foolscap.tokens.RemoteException'>:
 <RemoteException around '[CopiedFailure instance: Traceback from re
 mote host -- Traceback (most recent call last):
   File \"/home/customer/LAFS_source/src/allmydata/storage/server.py\",
 line 258, in <lambda>
     canary))
   File
 \"/home/customer/LAFS_source/src/allmydata/storage/backends/cloud/cloud_backend.py\",
 line 175, in make_bucket_writer
     d.addCallback(lambda ign: BucketWriter(account, immsh, canary))
   File \"/usr/local/lib/python2.7/dist-
 packages/Twisted-13.2.0-py2.7-linux-i686.egg/twisted/internet/defer.py\",
 line 306, in addCallback
     callbackKeywords=kw)
   File \"/usr/local/lib/python2.7/dist-
 packages/Twisted-13.2.0-py2.7-linux-i686.egg/twisted/internet/defer.py\",
 line 295, in addCallbacks
     self._runCallbacks()
 --- <exception caught here> ---
   File \"/usr/local/lib/python2.7/dist-
 packages/Twisted-13.2.0-py2.7-linux-i686.egg/twisted/internet/defer.py\",
 line 577, in _runCallbacks
     current.result = callback(current.result, *args, **kw)
   File
 \"/home/customer/LAFS_source/src/allmydata/storage/backends/cloud/cloud_backend.py\",
 line 175, in <lambda>
     d.addCallback(lambda ign: BucketWriter(account, immsh, canary))
   File \"/home/customer/LAFS_source/src/allmydata/storage/bucket.py\",
 line 28, in __init__
     share.get_allocated_data_length(), SHARETYPE_IMMUTABLE)
   File \"/home/customer/LAFS_source/src/allmydata/storage/account.py\",
 line 54, in add_share
     self._leasedb.add_new_share(storage_index, shnum, used_space,
 sharetype)
   File \"/home/customer/LAFS_source/src/allmydata/storage/leasedb.py\",
 line 176, in add_new_share
     (si_s, shnum, prefix, backend_key, used_space, sharetype,
 STATE_COMING))
 sqlite3.OperationalError: database or disk is full
 ]'>
 ])
 "
 }}}

 This was trying to backup 1 very small test file.
 I have 38GB of space locally.
 On windows

--

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2251#comment:4>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage


More information about the tahoe-lafs-trac-stream mailing list