Déjà Dup

Bug #676767
Comment #5

Comment 5 for bug 676767

Revision history for this message

Kenneth Loafman (kenneth-loafman) wrote on 2010-11-29: Re: [Bug 676767] Re: IOError: CRC check failed

The gzip portion of the file is corrupted somehow and I'm not sure how to
recover the contents. It may be possible to manually go into the gzip file
after decryption and run some sort of gzip-fix on it, but I don't see
anything in the repositories to suggest that such a critter exists.

Before you do anything, copy the backup itself to a work area and don't
touch the original.

You'll need to run with verbosity high to find out which file is the
culprit.

On Mon, Nov 29, 2010 at 7:23 AM, Michael Terry
<email address hidden>wrote:

> I'm not sure how. Ken, do you know?
>
> --
> IOError: CRC check failed
> https://bugs.launchpad.net/bugs/676767
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in Déjà Dup: Incomplete
>
> Bug description:
> Hi,
> I can't restore my backup, deja dup shows an error:
>
> -----------------
>
> /tmp/deja-dup.log
>
> DUPLICITY: INFO 1
> DUPLICITY: . Making directory /home/lukas/.jdownloader/libs
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/BrowserLauncher2.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/BrowserLauncher2.jar of
> type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/Filters.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/Filters.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JAntiCaptcha.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JAntiCaptcha.jar of type
> reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JDGUI.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JDGUI.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JDHttp.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JDHttp.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JDUtils.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JDUtils.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JUnique.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JUnique.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/balloontip.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/balloontip.jar of type
> reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/clink170.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/clink170.jar of type reg
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Removing still remembered temporary file
> /tmp/duplicity-_y22bi-tempdir/mkstemp-_ZjUB0-1
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Removing still remembered temporary file
> /tmp/duplicity-_y22bi-tempdir/mktemp-wmFejx-6
>
> DUPLICITY: ERROR 30 IOError
> DUPLICITY: . Traceback (most recent call last):
> DUPLICITY: . File "/usr/bin/duplicity", line 1257, in <module>
> DUPLICITY: . with_tempdir(main)
> DUPLICITY: . File "/usr/bin/duplicity", line 1250, in with_tempdir
> DUPLICITY: . fn()
> DUPLICITY: . File "/usr/bin/duplicity", line 1204, in main
> DUPLICITY: . restore(col_stats)
> DUPLICITY: . File "/usr/bin/duplicity", line 539, in restore
> DUPLICITY: . restore_get_patched_rop_iter(col_stats)):
> DUPLICITY: . File
> "/usr/lib/python2.6/dist-packages/duplicity/patchdir.py", line 522, in
> Write_ROPaths
> DUPLICITY: . ITR( ropath.index, ropath )
> DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/lazy.py",
> line 335, in __call__
> DUPLICITY: . last_branch.fast_process, args)
> DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/robust.py",
> line 37, in check_common_error
> DUPLICITY: . return function(*args)
> DUPLICITY: . File
> "/usr/lib/python2.6/dist-packages/duplicity/patchdir.py", line 575, in
> fast_process
> DUPLICITY: . ropath.copy( self.base_path.new_index( index ) )
> DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/path.py",
> line 416, in copy
> DUPLICITY: . other.writefileobj(self.open("rb"))
> DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/path.py",
> line 591, in writefileobj
> DUPLICITY: . buf = fin.read(_copy_blocksize)
> DUPLICITY: . File
> "/usr/lib/python2.6/dist-packages/duplicity/patchdir.py", line 200, in read
> DUPLICITY: . if not self.addtobuffer():
> DUPLICITY: . File
> "/usr/lib/python2.6/dist-packages/duplicity/patchdir.py", line 221, in
> addtobuffer
> DUPLICITY: . self.buffer += fp.read()
> DUPLICITY: . File
> "/usr/lib/python2.6/dist-packages/duplicity/tarfile.py", line 1338, in
> _readnormal
> DUPLICITY: . return self.fileobj.read(bytestoread)
> DUPLICITY: . File
> "/usr/lib/python2.6/dist-packages/duplicity/dup_temp.py", line 204, in read
> DUPLICITY: . return self.fileobj.read(length)
> DUPLICITY: . File "/usr/lib/python2.6/gzip.py", line 219, in read
> DUPLICITY: . self._read(readsize)
> DUPLICITY: . File "/usr/lib/python2.6/gzip.py", line 284, in _read
> DUPLICITY: . self._read_eof()
> DUPLICITY: . File "/usr/lib/python2.6/gzip.py", line 304, in _read_eof
> DUPLICITY: . hex(self.crc)))
> DUPLICITY: . IOError: CRC check failed 0xbfacd5c8L != 0xca281a1cL
> DUPLICITY: .
>
> ** (deja-dup:4599): DEBUG: DuplicityInstance.vala:553: duplicity (4613)
> exited with value 30
>
> ----------------
>
> /tmp/deja-dup.gconf
>
> <gconfentryfile>
> <entrylist base="/apps/deja-dup">
> <entry>
> <key>backend</key>
> <schema_key>/schemas/apps/deja-dup/backend</schema_key>
> <value>
> <string>file</string>
> </value>
> </entry>
> <entry>
> <key>delete-after</key>
> <schema_key>/schemas/apps/deja-dup/delete-after</schema_key>
> <value>
> <int>0</int>
> </value>
> </entry>
> <entry>
> <key>encrypt</key>
> <schema_key>/schemas/apps/deja-dup/encrypt</schema_key>
> <value>
> <bool>false</bool>
> </value>
> </entry>
> <entry>
> <key>exclude-list</key>
> <schema_key>/schemas/apps/deja-dup/exclude-list</schema_key>
> <value>
> <list type="string">
> <value>
> <string>$TRASH</string>
> </value>
> </list>
> </value>
> </entry>
> <entry>
> <key>include-list</key>
> <schema_key>/schemas/apps/deja-dup/include-list</schema_key>
> <value>
> <list type="string">
> <value>
> <string>$HOME</string>
> </value>
> </list>
> </value>
> </entry>
> <entry>
> <key>last-run</key>
> <schema_key>/schemas/apps/deja-dup/last-run</schema_key>
> </entry>
> <entry>
> <key>periodic</key>
> <schema_key>/schemas/apps/deja-dup/periodic</schema_key>
> <value>
> <bool>false</bool>
> </value>
> </entry>
> <entry>
> <key>periodic-period</key>
> <schema_key>/schemas/apps/deja-dup/periodic-period</schema_key>
> <value>
> <int>7</int>
> </value>
> </entry>
> <entry>
> <key>root-prompt</key>
> <schema_key>/schemas/apps/deja-dup/root-prompt</schema_key>
> <value>
> <bool>true</bool>
> </value>
> </entry>
> <entry>
> <key>file/icon</key>
> <schema_key>/schemas/apps/deja-dup/file/icon</schema_key>
> <value>
> <string>. GThemedIcon drive-harddisk-usb drive-harddisk
> drive</string>
> </value>
> </entry>
> <entry>
> <key>file/name</key>
> <schema_key>/schemas/apps/deja-dup/file/name</schema_key>
> <value>
> <string>500 GB Festplatte: ExterneHD</string>
> </value>
> </entry>
> <entry>
> <key>file/path</key>
> <schema_key>/schemas/apps/deja-dup/file/path</schema_key>
> <value>
> <string>/media/ExterneHD/Backup14112010_Ubuntu_10_04</string>
> </value>
> </entry>
> <entry>
> <key>file/relpath</key>
> <schema_key>/schemas/apps/deja-dup/file/relpath</schema_key>
> <value>
> <string>Backup14112010_Ubuntu_10_04</string>
> </value>
> </entry>
> <entry>
> <key>file/short_name</key>
> <schema_key>/schemas/apps/deja-dup/file/short_name</schema_key>
> <value>
> <string>ExterneHD</string>
> </value>
> </entry>
> <entry>
> <key>file/type</key>
> <schema_key>/schemas/apps/deja-dup/file/type</schema_key>
> <value>
> <string>volume</string>
> </value>
> </entry>
> <entry>
> <key>file/uuid</key>
> <schema_key>/schemas/apps/deja-dup/file/uuid</schema_key>
> <value>
> <string>2BF561DA421F5C79</string>
> </value>
> </entry>
> <entry>
> <key>s3/bucket</key>
> <schema_key>/schemas/apps/deja-dup/s3/bucket</schema_key>
> </entry>
> <entry>
> <key>s3/folder</key>
> <schema_key>/schemas/apps/deja-dup/s3/folder</schema_key>
> <value>
> <string>/</string>
> </value>
> </entry>
> <entry>
> <key>s3/id</key>
> <schema_key>/schemas/apps/deja-dup/s3/id</schema_key>
> </entry>
> </entrylist>
> </gconfentryfile>
>
> ---------------------
>
> Version of deja-dup and duplicity
>
> deja-dup 16.0-0ubuntu1
> duplicity 0.6.10-0ubuntu1
>
> ---------------
>
> System: Ubuntu 10.04.1 LTS
>
> I backed up the Data using Ubuntu 10.04 as well. Created the backup on an
> external harddrive. Formated my harddisk today and reinstalled Ubuntu 10.04.
> Then I tried to restore the data.
>
> Hope you can help me.
>
> To unsubscribe from this bug, go to:
> https://bugs.launchpad.net/deja-dup/+bug/676767/+subscribe
>

The gzip portion of the file is corrupted somehow and I'm not sure how to
recover the contents.  It may be possible to manually go into the gzip file
after decryption and run some sort of gzip-fix on it, but I don't see
anything in the repositories to suggest that such a critter exists.

Before you do anything, copy the backup itself to a work area and don't
touch the original.

You'll need to run with verbosity high to find out which file is the
culprit.

On Mon, Nov 29, 2010 at 7:23 AM, Michael Terry
<michael.terry@canonical.com>wrote:

> I'm not sure how.  Ken, do you know?
>
> --
> IOError: CRC check failed
> https://bugs.launchpad.net/bugs/676767
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in Déjà Dup: Incomplete
>
> Bug description:
> Hi,
> I can't restore my backup, deja dup shows an error:
>
> -----------------
>
> /tmp/deja-dup.log
>
> DUPLICITY: INFO 1
> DUPLICITY: . Making directory /home/lukas/.jdownloader/libs
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/BrowserLauncher2.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/BrowserLauncher2.jar of
> type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/Filters.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/Filters.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JAntiCaptcha.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JAntiCaptcha.jar of type
> reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JDGUI.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JDGUI.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JDHttp.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JDHttp.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JDUtils.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JDUtils.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/JUnique.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/JUnique.jar of type reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/balloontip.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/balloontip.jar of type
> reg
>
> DUPLICITY: INFO 7 'home/lukas/.jdownloader/libs/clink170.jar' reg
> DUPLICITY: . Writing home/lukas/.jdownloader/libs/clink170.jar of type reg
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Removing still remembered temporary file
> /tmp/duplicity-_y22bi-tempdir/mkstemp-_ZjUB0-1
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Removing still remembered temporary file
> /tmp/duplicity-_y22bi-tempdir/mktemp-wmFejx-6
>
> DUPLICITY: ERROR 30 IOError
> DUPLICITY: . Traceback (most recent call last):
> DUPLICITY: .   File "/usr/bin/duplicity", line 1257, in <module>
> DUPLICITY: .     with_tempdir(main)
> DUPLICITY: .   File "/usr/bin/duplicity", line 1250, in with_tempdir
> DUPLICITY: .     fn()
> DUPLICITY: .   File "/usr/bin/duplicity", line 1204, in main
> DUPLICITY: .     restore(col_stats)
> DUPLICITY: .   File "/usr/bin/duplicity", line 539, in restore
> DUPLICITY: .     restore_get_patched_rop_iter(col_stats)):
> DUPLICITY: .   File
> "/usr/lib/python2.6/dist-packages/duplicity/patchdir.py", line 522, in
> Write_ROPaths
> DUPLICITY: .     ITR( ropath.index, ropath )
> DUPLICITY: .   File "/usr/lib/python2.6/dist-packages/duplicity/lazy.py",
> line 335, in __call__
> DUPLICITY: .     last_branch.fast_process, args)
> DUPLICITY: .   File "/usr/lib/python2.6/dist-packages/duplicity/robust.py",
> line 37, in check_common_error
> DUPLICITY: .     return function(*args)
> DUPLICITY: .   File
> "/usr/lib/python2.6/dist-packages/duplicity/patchdir.py", line 575, in
> fast_process
> DUPLICITY: .     ropath.copy( self.base_path.new_index( index ) )
> DUPLICITY: .   File "/usr/lib/python2.6/dist-packages/duplicity/path.py",
> line 416, in copy
> DUPLICITY: .     other.writefileobj(self.open("rb"))
> DUPLICITY: .   File "/usr/lib/python2.6/dist-packages/duplicity/path.py",
> line 591, in writefileobj
> DUPLICITY: .     buf = fin.read(_copy_blocksize)
> DUPLICITY: .   File
> "/usr/lib/python2.6/dist-packages/duplicity/patchdir.py", line 200, in read
> DUPLICITY: .     if not self.addtobuffer():
> DUPLICITY: .   File
> "/usr/lib/python2.6/dist-packages/duplicity/patchdir.py", line 221, in
> addtobuffer
> DUPLICITY: .     self.buffer += fp.read()
> DUPLICITY: .   File
> "/usr/lib/python2.6/dist-packages/duplicity/tarfile.py", line 1338, in
> _readnormal
> DUPLICITY: .     return self.fileobj.read(bytestoread)
> DUPLICITY: .   File
> "/usr/lib/python2.6/dist-packages/duplicity/dup_temp.py", line 204, in read
> DUPLICITY: .     return self.fileobj.read(length)
> DUPLICITY: .   File "/usr/lib/python2.6/gzip.py", line 219, in read
> DUPLICITY: .     self._read(readsize)
> DUPLICITY: .   File "/usr/lib/python2.6/gzip.py", line 284, in _read
> DUPLICITY: .     self._read_eof()
> DUPLICITY: .   File "/usr/lib/python2.6/gzip.py", line 304, in _read_eof
> DUPLICITY: .     hex(self.crc)))
> DUPLICITY: . IOError: CRC check failed 0xbfacd5c8L != 0xca281a1cL
> DUPLICITY: .
>
> ** (deja-dup:4599): DEBUG: DuplicityInstance.vala:553: duplicity (4613)
> exited with value 30
>
> ----------------
>
> /tmp/deja-dup.gconf
>
> <gconfentryfile>
>  <entrylist base="/apps/deja-dup">
>    <entry>
>      <key>backend</key>
>      <schema_key>/schemas/apps/deja-dup/backend</schema_key>
>      <value>
>        <string>file</string>
>      </value>
>    </entry>
>    <entry>
>      <key>delete-after</key>
>      <schema_key>/schemas/apps/deja-dup/delete-after</schema_key>
>      <value>
>        <int>0</int>
>      </value>
>    </entry>
>    <entry>
>      <key>encrypt</key>
>      <schema_key>/schemas/apps/deja-dup/encrypt</schema_key>
>      <value>
>        <bool>false</bool>
>      </value>
>    </entry>
>    <entry>
>      <key>exclude-list</key>
>      <schema_key>/schemas/apps/deja-dup/exclude-list</schema_key>
>      <value>
>        <list type="string">
>            <value>
>              <string>$TRASH</string>
>            </value>
>        </list>
>      </value>
>    </entry>
>    <entry>
>      <key>include-list</key>
>      <schema_key>/schemas/apps/deja-dup/include-list</schema_key>
>      <value>
>        <list type="string">
>            <value>
>              <string>$HOME</string>
>            </value>
>        </list>
>      </value>
>    </entry>
>    <entry>
>      <key>last-run</key>
>      <schema_key>/schemas/apps/deja-dup/last-run</schema_key>
>    </entry>
>    <entry>
>      <key>periodic</key>
>      <schema_key>/schemas/apps/deja-dup/periodic</schema_key>
>      <value>
>        <bool>false</bool>
>      </value>
>    </entry>
>    <entry>
>      <key>periodic-period</key>
>      <schema_key>/schemas/apps/deja-dup/periodic-period</schema_key>
>      <value>
>        <int>7</int>
>      </value>
>    </entry>
>    <entry>
>      <key>root-prompt</key>
>      <schema_key>/schemas/apps/deja-dup/root-prompt</schema_key>
>      <value>
>        <bool>true</bool>
>      </value>
>    </entry>
>    <entry>
>      <key>file/icon</key>
>      <schema_key>/schemas/apps/deja-dup/file/icon</schema_key>
>      <value>
>        <string>. GThemedIcon drive-harddisk-usb drive-harddisk
> drive</string>
>      </value>
>    </entry>
>    <entry>
>      <key>file/name</key>
>      <schema_key>/schemas/apps/deja-dup/file/name</schema_key>
>      <value>
>        <string>500 GB Festplatte: ExterneHD</string>
>      </value>
>    </entry>
>    <entry>
>      <key>file/path</key>
>      <schema_key>/schemas/apps/deja-dup/file/path</schema_key>
>      <value>
>        <string>/media/ExterneHD/Backup14112010_Ubuntu_10_04</string>
>      </value>
>    </entry>
>    <entry>
>      <key>file/relpath</key>
>      <schema_key>/schemas/apps/deja-dup/file/relpath</schema_key>
>      <value>
>        <string>Backup14112010_Ubuntu_10_04</string>
>      </value>
>    </entry>
>    <entry>
>      <key>file/short_name</key>
>      <schema_key>/schemas/apps/deja-dup/file/short_name</schema_key>
>      <value>
>        <string>ExterneHD</string>
>      </value>
>    </entry>
>    <entry>
>      <key>file/type</key>
>      <schema_key>/schemas/apps/deja-dup/file/type</schema_key>
>      <value>
>        <string>volume</string>
>      </value>
>    </entry>
>    <entry>
>      <key>file/uuid</key>
>      <schema_key>/schemas/apps/deja-dup/file/uuid</schema_key>
>      <value>
>        <string>2BF561DA421F5C79</string>
>      </value>
>    </entry>
>    <entry>
>      <key>s3/bucket</key>
>      <schema_key>/schemas/apps/deja-dup/s3/bucket</schema_key>
>    </entry>
>    <entry>
>      <key>s3/folder</key>
>      <schema_key>/schemas/apps/deja-dup/s3/folder</schema_key>
>      <value>
>        <string>/</string>
>      </value>
>    </entry>
>    <entry>
>      <key>s3/id</key>
>      <schema_key>/schemas/apps/deja-dup/s3/id</schema_key>
>    </entry>
>  </entrylist>
> </gconfentryfile>
>
> ---------------------
>
> Version of deja-dup and duplicity
>
> deja-dup        16.0-0ubuntu1
> duplicity       0.6.10-0ubuntu1
>
> ---------------
>
> System: Ubuntu 10.04.1 LTS
>
> I backed up the Data using Ubuntu 10.04 as well. Created the backup on an
> external harddrive. Formated my harddisk today and reinstalled Ubuntu 10.04.
> Then I tried to restore the data.
>
> Hope you can help me.
>
> To unsubscribe from this bug, go to:
> https://bugs.launchpad.net/deja-dup/+bug/676767/+subscribe
>