Déjà Dup

Deja-Dup waiting for Files in Amazon Glacier

Asked by Martin

I make backups to Amazon S3.
After a while, the files are migrated into Amazon Glacier.

In some cases, deja-dup wants to load files which have been migrated to Amazon Glacier.
So deja-dup stops waiting for the restore of one file from amazon glacier. This needs hours and meanwhile the user does not know why it is waiting. After this file is restored, deja-dup wants the next file to be restored from Glacier. Again this lasts hours.
It would be better if deja-dup restore all files it wants at once.

Question information

Language:
English Edit question
Status:
Answered
For:
Déjà Dup Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Michael Terry (mterry) said : 		#1

Yeah, I agree that is not a great experience. But we don't really support Amazon Glacier right now.

There's a bug about this: bug 1039471.

Revision history for this message
Martin (martin3000) said : 		#2

Ok I see, this is a problem of duplicity. In the function "sync_archive" it calls globals.backend.pre_process_download(local_missing) and here the check for glacier storage class is done (for amazon s3 I assume this is in _boto_single.py).

What I don't understand: in duplicity calling globals.backend.pre_process_download(local_missing), "local_missing" is a list of files. So it would be easy to for the backend to restore all the files. But in _boto_single.py, the remote filename is not a list.

Revision history for this message
Martin (martin3000) said : 		#3

I see that the test "if hasattr(globals.backend, 'pre_process_download')" is not true. I think this is because the duplicity.backend.BackendWrapper does not contain this function.

I ask this in the duplicity area.

Can you help with this problem?

Provide an answer of your own, or ask Martin for more information if necessary.

To post a message you must log in.