Déjà Dup

Déja-Dup resore failed due to unknown error

Asked by Tomas Poetsch

Hello

I made an backup of the three user directories of about 150GB on an external hard drive. The backup is coomposed by about 720 files full and another 2000 incremental
Today I am not able to restore the backup.
The error messages are as follows.

Could you please give a hit how to restore these data?

Thank you

Errors hereafter:

Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1494, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1488, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1337, in main
    do_backup(action)
  File "/usr/bin/duplicity", line 1370, in do_backup
    globals.archive_dir).set_values()
  File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 697, in set_values
    self.get_backup_chains(partials + backend_filename_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 819, in get_backup_chains
    map(add_to_sets, filename_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 809, in add_to_sets
    if set.add_filename(filename):
  File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 100, in add_filename
    (self.volume_name_dict, filename)
AssertionError: ({2560: 'duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol2560.difftar.gz', 1: 'duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol1.difftar.gz', 1026: 'duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol1026.difftar.gz', 2561: 'duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol2561.difftar.gz', 10: 'duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol10.difftar.gz'.........

Question information

Language:
English Edit question
Status:
Expired
For:
Déjà Dup Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Michael Terry (mterry) said : 		#1

Looks like you might have duplicate volume files somehow?

If you don't see anything obviously duplicated (which would be hard in the thousands of files you have lying there...), https://wiki.gnome.org/Apps/DejaDup/Help/Restore/WorstCase might help. Though it's a very manual process.

Revision history for this message
Tomas Poetsch (tpo1344) said : 		#2

Thank you Michael

This is indeed a very fastidious process as I have more than 2000 images in
the multivol_snapshot directory...
Is there any way of correcting the dublicated files. Indeed there is a
archive that is archived.
As well is there a possibility of extracting the concerned file names in
the incremental backup files?

Thank you

2016-09-09 15:08 GMT+02:00 Michael Terry <
<email address hidden>>:

> Your question #389238 on Déjà Dup changed:
> https://answers.launchpad.net/deja-dup/+question/389238
>
> Michael Terry posted a new comment:
> Looks like you might have duplicate volume files somehow?
>
> If you don't see anything obviously duplicated (which would be hard in
> the thousands of files you have lying there...),
> https://wiki.gnome.org/Apps/DejaDup/Help/Restore/WorstCase might help.
> Though it's a very manual process.
>
> --
> You received this question notification because you asked the question.
>

Revision history for this message
Michael Terry (mterry) said : 		#3

Are there any volume files that don't end in .gz? If you move them out of the way, does the normal restore work?

Revision history for this message
Tomas Poetsch (tpo1344) said : 		#4

Thank you Michael

Indeed, I had two files unzipped as well as .gz

Now it is working

I will come back to you later as I have the impresion that I am missing
some data..
The restored volume is 50 GB but the backup is 180GB and should restore
some 230GB

Therefore my question in anticipation: is there a manifest as well for the
incremental files?
If so, I am missing this file. Is there a possibility of building the
manifest?

Thank you

2016-09-09 16:22 GMT+02:00 Michael Terry <
<email address hidden>>:

> Your question #389238 on Déjà Dup changed:
> https://answers.launchpad.net/deja-dup/+question/389238
>
> Status: Open => Needs information
>
> Michael Terry requested more information:
> Are there any volume files that don't end in .gz? If you move them out
> of the way, does the normal restore work?
>
> --
> To answer this request for more information, you can either reply to
> this email or enter your reply at the following page:
> https://answers.launchpad.net/deja-dup/+question/389238
>
> You received this question notification because you asked the question.
>

Revision history for this message
Tomas Poetsch (tpo1344) said : 		#5

Hi Michael

I just finished to restore the backup.

I confirm that only the files from the main are restored and the data
from the incremental is missing.

Is there a manifest as well for the incremental files?
If so, I am missing this file. Is there a possibility of building the
manifest?

Thank you

Le 09/09/2016 à 16:43, Tomas Poetsch a écrit :
> Your question #389238 on Déjà Dup changed:
> https://answers.launchpad.net/deja-dup/+question/389238
>
> Status: Needs information => Open
>
> You gave more information on the question:
> Thank you Michael
>
> Indeed, I had two files unzipped as well as .gz
>
> Now it is working
>
> I will come back to you later as I have the impresion that I am missing
> some data..
> The restored volume is 50 GB but the backup is 180GB and should restore
> some 230GB
>
> Therefore my question in anticipation: is there a manifest as well for the
> incremental files?
> If so, I am missing this file. Is there a possibility of building the
> manifest?
>
> Thank you
>
> 2016-09-09 16:22 GMT+02:00 Michael Terry <
> <email address hidden>>:
>
>> Your question #389238 on Déjà Dup changed:
>> https://answers.launchpad.net/deja-dup/+question/389238
>>
>> Status: Open => Needs information
>>
>> Michael Terry requested more information:
>> Are there any volume files that don't end in .gz? If you move them out
>> of the way, does the normal restore work?
>>
>> --
>> To answer this request for more information, you can either reply to
>> this email or enter your reply at the following page:
>> https://answers.launchpad.net/deja-dup/+question/389238
>>
>> You received this question notification because you asked the question.
>>

Revision history for this message
Michael Terry (mterry) said : 		#6

There should be separate sets of volume files for the incrementals. Deja Dup offers you a choice of date when you restore. It will use the incrementals up to the date you pick.

Revision history for this message
Tomas Poetsch (tpo1344) said : 		#7

They are all made the same day and déja-dup just shows one date..

Le 09/09/2016 à 17:32, Michael Terry a écrit :
> Your question #389238 on Déjà Dup changed:
> https://answers.launchpad.net/deja-dup/+question/389238
>
> Michael Terry posted a new comment:
> There should be separate sets of volume files for the incrementals.
> Deja Dup offers you a choice of date when you restore. It will use the
> incrementals up to the date you pick.
>

Revision history for this message
Tomas Poetsch (tpo1344) said : 		#8

All I have on the drive are files

duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol1.difftar.gz to
duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol2797.difftar.gz

Unfortuntely there are no other files

Thank you

Le 09/09/2016 à 17:32, Michael Terry a écrit :
> Your question #389238 on Déjà Dup changed:
> https://answers.launchpad.net/deja-dup/+question/389238
>
> Michael Terry posted a new comment:
> There should be separate sets of volume files for the incrementals.
> Deja Dup offers you a choice of date when you restore. It will use the
> incrementals up to the date you pick.
>

Revision history for this message
Michael Terry (mterry) said : 		#9

The duplicity-inc prefix indicates it is an incremental update on top of a full initial backup. There are no other files there?

Revision history for this message
Tomas Poetsch (tpo1344) said : 		#10

Le 09/09/2016 à 18:52, Michael Terry a écrit :
> Your question #389238 on Déjà Dup changed:
> https://answers.launchpad.net/deja-dup/+question/389238
>
> Michael Terry posted a new comment:
> The duplicity-inc prefix indicates it is an incremental update on top of
> a full initial backup. There are no other files there?
>
 Hi Michael

The complete filielist in the directory is:

duplicity-full.20160906T063548Z.manifest
duplicity-full.20160906T063548Z.vol1.difftar.gz
to
duplicity-full.20160906T063548Z.vol740.difftar.gz
duplicity-full-signatures.20160906T063548Z.sigtar.gz

duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol1.difftar.gz
duplicity-inc.20160906T063548Z.to.20160906T085911Z.vol2797.difftar.gz

It says well that this is incremental to the full backup, but the data
is not restored

Thank you

Revision history for this message
Tomas Poetsch (tpo1344) said : 		#11

Hi Michael

I think the manifest file and the signature file are missing for the incremental backup?
Do you confirm?

Thank you

Revision history for this message
Launchpad Janitor (janitor) said : 		#12

This question was expired because it remained in the 'Open' state without activity for the last 15 days.