failure due to unknown error

Asked by Lemien

duplicity list-current-files --verbosity 8 --no-encryption file:///'/media/jean-guillaume/WD_BLACK/jeanguillaume-HP-Pro-3400-Series-MT'
Hello here
I made a backup and went from version 20.04 to 21.04
The backup is on an external drive and I can't recover it, "failure due to unknown error" is all it tells me
I put a password and I only find --no-encryption files
I can't find a solution to my problem ....
Where do I start looking?

Question information

Language:
English Edit question
Status:
Expired
For:
Déjà Dup Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Lemien (pfiouu) said :
#1

       duplicity [restore] [options] [--file-to-restore <relpath>] [--time time] source_url
       target_directory
Help!!!! :)

Revision history for this message
Michael Terry (mterry) said :
#2

Do the duplicity-* files in the backup folder have a .gz file ending or a .gpg file ending?

Revision history for this message
Lemien (pfiouu) said :
#3

Hi i have

duplicity-full.20210621T114434Z.vol2.difftar.gpg
duplicity-full.20210621T114434Z.vol2.difftar
I manage to decompress them one by one
duplicity-full.20210621T114434Z.vol3.difftar for example
But I have 156 records of this type

Revision history for this message
Lemien (pfiouu) said :
#4

gpg decryption failed: no secret key
gpg --multifile --decrypt duplicity-full.20210621T114434Z.*.difftar.gpg

gpg: data encrypted with AES256
gpg: encrypted with 1 passphrase
(many lines of this)

Revision history for this message
Lemien (pfiouu) said :
#5

ls -la
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52490569 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol58.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52496279 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol59.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52475240 juin 23 17:55 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol5.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52497640 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol60.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52488091 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol61.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52484817 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol62.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52481472 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol63.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52469983 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol64.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52499400 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol65.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52477437 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol66.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52479970 juin 23 17:58 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol67.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52497390 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol68.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52465427 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol69.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52476003 juin 23 17:55 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol6.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52496762 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol70.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52469697 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol71.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52484613 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol72.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52499429 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol73.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52486920 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol74.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52478886 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol75.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52477487 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol76.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52488187 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol77.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52495307 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol78.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52478098 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol79.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52486929 juin 23 17:55 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol7.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52479690 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol80.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52464046 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol81.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52471925 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol82.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52480671 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol83.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52495879 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol84.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52474052 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol85.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52488830 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol86.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52469957 juin 23 17:59 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol87.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52491987 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol88.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52474546 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol89.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52489273 juin 23 17:55 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol8.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52466497 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol90.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52467293 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol91.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52477931 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol92.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52471319 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol93.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52475212 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol94.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52482290 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol95.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52494383 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol96.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52478647 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol97.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52476463 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol98.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52486843 juin 23 18:00 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol99.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 52463580 juin 23 17:56 duplicity-inc.20210621T114434Z.to.20210623T155450Z.vol9.difftar.gpg
-rwxr-xr-x 1 jean-guillaume jean-guillaume 50219797 juin 23 18:03 duplicity-new-signatures.20210621T114434Z.to.20210623T155450Z.sigtar.gpg
drwxr-xr-x 3 jean-guillaume jean-guillaume 1048576 juin 28 14:33 multivol_snapshot
-rwxr-xr-x 1 jean-guillaume jean-guillaume 160509936 juin 28 10:41 Sauvegarde1
drwxr-xr-x 3 jean-guillaume jean-guillaume 1048576 juin 28 14:33 snapshot
jean-guillaume@jeanguillaume-HP-Pro-3400-Series-MT:~$
 (and many others)

Revision history for this message
Lemien (pfiouu) said :
#6

*******="PHRASE DE PASSE POUR LE CHIFFRAGE"
export *******
duplicity --volsize 50 --exclude "/home/$USER/Téléchargements" --exclude "/home/jean-guillaume/Téléchargements/.local/share/Trash" /home/jean-guillaume "file:////media/jean-guillaume/WD_BLACK/jeanguillaume-HP-Pro-3400-Series-MT"
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: none
GnuPG passphrase for decryption:
Retype passphrase for decryption to confirm:
No signatures found, switching to full backup.
Cleanup of temporary directory /tmp/duplicity-zf3fi3c2-tempdir failed - this is probably a bug.
Traceback (innermost last):
  File "/usr/bin/duplicity", line 122, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 108, in with_tempdir
    fn()
  File "/usr/lib/python3/dist-packages/duplicity/dup_main.py", line 1535, in main
    do_backup(action)
  File "/usr/lib/python3/dist-packages/duplicity/dup_main.py", line 1662, in do_backup
    full_backup(col_stats)
  File "/usr/lib/python3/dist-packages/duplicity/dup_main.py", line 559, in full_backup
    bytes_written = write_multivol(u"full", tarblock_iter,
  File "/usr/lib/python3/dist-packages/duplicity/dup_main.py", line 417, in write_multivol
    at_end = gpg.GPGWriteFile(tarblock_iter, tdp.name, config.gpg_profile,
  File "/usr/lib/python3/dist-packages/duplicity/gpg.py", line 386, in GPGWriteFile
    bytes_to_go = data_size - get_current_size()
  File "/usr/lib/python3/dist-packages/duplicity/gpg.py", line 378, in get_current_size
    return os.stat(filename).st_size
 FileNotFoundError: [Errno 2] No such file or directory: b'/tmp/duplicity-zf3fi3c2-tempdir/mktemp-3zt4o161-227'

Revision history for this message
Lemien (pfiouu) said :
#7

duplicity --volsize 50 --exclude "/home/$USER/Téléchargements" --exclude "/home/jean-guillaume/Téléchargements/.local/share/Trash" /home/jean-guillaume "file:////media/jean-guillaume/WD_BLACK/jeanguillaume-HP-Pro-3400-Series-MT"

Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Sat Jul 3 09:31:16 2021
GnuPG passphrase for decryption:
Retype passphrase for decryption to confirm:
RESTART: Volumes 225 to 225 failed to upload before termination.
         Restarting backup at volume 225.
Restarting after volume 224, file Images/Cristalyzedogio/800_9759.NEF, block 614

Revision history for this message
Lemien (pfiouu) said :
#8

duplicity --ignore-errors --volsize 50 --exclude "/home/$USER/Téléchargements" --exclude "/home/jean-guillaume/Téléchargements/.local/share/Trash" /home/jean-guillaume "file:////media/jean-guillaume/WD_BLACK/jeanguillaume-HP-Pro-3400-Series-MT"
Running in 'ignore errors' mode due to --ignore-errors; please re-consider if this was not intended
Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Sat Jul 3 09:31:16 2021
GnuPG passphrase for decryption:
Retype passphrase for decryption to confirm:
RESTART: Volumes 3019 to 3019 failed to upload before termination.
         Restarting backup at volume 3019.
Restarting after volume 3018, file media/jean-guillaume/WD_BLACK/jeanguillaume-HP-Pro-3400-Series-MT/duplicity-full.20210703T073116Z.vol625.difftar.gpg, block 225

I'm wrong?

Revision history for this message
Lemien (pfiouu) said :
#9

Running in 'ignore errors' mode due to --ignore-errors; please re-consider if this was not intended
Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Sat Jul 3 09:31:16 2021
GnuPG passphrase for decryption:
Retype passphrase for decryption to confirm:
RESTART: Volumes 3019 to 3019 failed to upload before termination.
         Restarting backup at volume 3019.
Restarting after volume 3018, file media/jean-guillaume/WD_BLACK/jeanguillaume-HP-Pro-3400-Series-MT/duplicity-full.20210703T073116Z.vol625.difftar.gpg, block 225
--------------[ Backup Statistics ]--------------
StartTime 1625485938.25 (Mon Jul 5 13:52:18 2021)
EndTime 1625488507.49 (Mon Jul 5 14:35:07 2021)
ElapsedTime 2569.24 (42 minutes 49.24 seconds)
SourceFiles 35418
SourceFileSize 266022232982 (248 GB)
NewFiles 35418
NewFileSize 266022232982 (248 GB)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 35418
RawDeltaSize 266014047167 (248 GB)
TotalDestinationSizeChange 26218332745 (24.4 GB)
Errors 0
-------------------------------------------------

Revision history for this message
Michael Terry (mterry) said :
#10

Sorry I'm confused about what you are trying to do here. The past few messages you posted are about you trying to make a new backup? I thought you were having difficulties restoring files in your first messages.

I'm going to focus on the "can't restore files" issue. It looks like you have an encrypted backup. But you were passing --no-encryption when trying to interact with the backup. That might be part of your problem?

But you also look like you've manually managed to manually decrypt some of the volume files. Did that work for you? Were you able to get your files back?

Note that if you interact more with that backup set, if you leave the decrypted version of the volume files in the same directory as the encrypted versions, duplicity will get confused. You might want to move them to a different folder.

You say you are moving from Ubuntu 20.04 to 21.04 - which means you probably aren't affected by this old bug, but I mention it because some of your symptoms sound the same. Do the symptoms/issues in this wiki page sound like what you are experiencing? https://wiki.gnome.org/Apps/DejaDup/PassphraseProblems2019

Revision history for this message
Lemien (pfiouu) said :
#11

Thanks for your feedback Michael
Yes I made a mistake the first time trying to decrypt without password
I found out how to insert the password but indeed I have a problem in my decryption or in the backup restore path.
I don't know how to write it
Do you have an idea of the path to type to point to my / home?
My command line level is ... quite low so I don't think I understood my concern or how to respond to it
Sorry for not being clear enough and thank you
Try the wiki if I understand how to modify the code for my problem

Revision history for this message
Lemien (pfiouu) said :
#12

for i in /$/media/jean-guillaume/WD_BLACK/jeanguillaume-HP-Pro-3400-Series-MT/*; do echo $i; if gpg --*******=$PASSPHRASE --batch --pinentry-mode=loopback --decrypt $i >/dev/null 2>/dev/null; then echo -e "^ \033[0;32mcorrect *******\033[0m"; else echo -e "^ \033[0;31mwrong *******\033[0m"; fi; done
/$/media/jean-guillaume/WD_BLACK/jeanguillaume-HP-Pro-3400-Series-MT/*
^ wrong *******(<<-------written in red )
jean-guillaume@jeanguillaume-HP-Pro-3400-Series-MT:~$

when I say that I don't know how to do

Revision history for this message
Lemien (pfiouu) said :
#13

keygrip: u/S0CD2FC0DD95F7ADE
stored-by: GnuPG Pinentry

I have my correct passphrase in password manager (

Revision history for this message
Launchpad Janitor (janitor) said :
#14

This question was expired because it remained in the 'Needs information' state without activity for the last 15 days.