Too big space usage by archive dir

Asked by feighee

Duplicity was awesome tool before version 0.6. Now it wastes too much space for some cache or archive files. Even it is not enough 1Gb of free space to backup 20G of file!! So I need to pay attention to backup process instead of leaving it in auto mode.

Could you tell me the reason of this feature without any disable option? Are you going to make some option for that? Why I need to waste space to store same metadata on the notebook and backup server?

Question information

Language:
English Edit question
Status:
Solved
For:
Duplicity Edit question
Assignee:
No assignee Edit question
Solved by:
Kenneth Loafman
Solved:
Last query:
Last reply:
Revision history for this message
Best Kenneth Loafman (kenneth-loafman) said :
#1

You can remove the entire archive dir after the backup if you wish. It will be downloaded the next time you use duplicity, so no harm done. The archive dir (cache dir) is merely keeping local the things that it would normally have to download in the normal process of doing incremental backups. You probably need to specify an archive dir in a different directory, like this: "duplicity --archive-dir=/tmp". That way, the space goes away on the next boot, but better yet, its available if you need to do another backup, or if you need to restart an interrupted backup.

Checkpoint/restart (in 0.6 and up) uses the data in the archive dir to enable restart if duplicity is interrupted in the middle of a run. Since the data needs to be in permanent visible files for that to occur, I just left the files in a more formal location than some random temp directory.

Bottom line is that duplicity is not using any more room during the run than it had previously, its just leaving more behind on the source system, and maybe putting it in a different place, which makes it more visible. The tradeoff is going to be worth it in terms of restart capabilities and less network overhead.

Revision history for this message
feighee (feighee13) said :
#2

Thank you for the explanation. Moving archive dir to /tmp and adding rm -rf after backing up solve my problem.
It would be nice to have some switch for that.

Revision history for this message
feighee (feighee13) said :
#3

Thanks Kenneth Loafman, that solved my question.