Back In Time

Backup taking > 4h for 40GB total size

Asked by Martin Hohenadler

Dear all,

I was wondering how to track down the reason for the very long time it takes BIT to
do an incremental backup of my /home, (23GB) plus two other folders (15GB combined, but
unchanged since last backup). It is now about 4.5 hours since I started the snapshot.

The snapshot folder is on a SAMSUNG Story USB disk, and I am using version 1.0.6 with Ubuntu 10.04.

Thanks,

Martin

Question information

Language:
English Edit question
Status:
Expired
For:
Back In Time Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Calcipher (calcipher) said : 		#1

I am having a similar problem though not as severe. After the update to 11.04, my incremental backups (even with virtually no changes) went from approximately 15-20 minutes to around 4 hours. I say not as severe simply because I have ~200gigs that it is backing up with about the same delay.

Maybe this would be better as a bug report? What say you developers?

Revision history for this message
Calcipher (calcipher) said : 		#2

I have created a bug report (https://bugs.launchpad.net/backintime/+bug/784840) on this issue. I suggest you go there and click the 'Also affect me' button and provide any additional details that you can.

Revision history for this message
Nils Herde (hernil) said : 		#3

Are you guys using a NTFS formated drive for backups?

I experienced significant performance increase when moving to EXT4 file system :-)

Revision history for this message
Calcipher (calcipher) said : 		#4

I am using a EXT4 drive for backups.

Revision history for this message
Martin Hohenadler (martin-hohenadler) said : 		#5

It is NTFS in my case, but after buying a new laptop recently, backups
are back to about 20 min with the same external disk.

Revision history for this message
Jack Hietpas (jhietpas) said : 		#6

Hello- I am using BIT 1.0.6, and it takes 7-8hours to perform a backup (totalling ~2-3Gb, initial backup was ~80Gb). It has taken this long on both Ubuntu 10.10 and 11.04. I have tried 1Tb WD and 500 Gb Seagate and Simpltech external hard drives. No difference. Can anyone help me get this to a more reasonable timeframe? I have copied and pasted the last log info.... I still have my training wheels on when it comes to Ubuntu/Linux, please be gentle.

Thanks very much,

-jh

========== Take snapshot (profile 1): Wed 25 May 2011 12:00:02 AM ==========

[I] ...
[I] Compare with snapshot 2011-05-24 00:00:11
[I] rsync -rtDH --checksum --links --no-p --no-g --no-o --delete --delete-excluded -i --dry-run --out-format="BACKINTIME: %i %n%L" --chmod=Du+wx --exclude="/media/HAL" --exclude="/home/jack/.local/share/backintime" --include="/home/jack/" --include="/home/" --exclude=".*" --exclude="*.backup*" --exclude="*~" --exclude="/home/jack/Downloads" --include="/home/jack/**" --exclude="*" / "/media/HAL/backintime/jack-laptop/jack/1/20110524-000011-908/backup/"
[I] Create hard-links
[I] cp -aRl "/media/HAL/backintime/jack-laptop/jack/1/20110524-000011-908/backup/"* "/media/HAL/backintime/jack-laptop/jack/1/new_snapshot/backup/"
[I] returns: 0
[I] Take snapshot
[I] rsync -rtDH --checksum --links --no-p --no-g --no-o --delete --delete-excluded -v --chmod=Du+wx --exclude="/media/HAL" --exclude="/home/jack/.local/share/backintime" --include="/home/jack/" --include="/home/" --exclude=".*" --exclude="*.backup*" --exclude="*~" --exclude="/home/jack/Downloads" --include="/home/jack/**" --exclude="*" / "/media/HAL/backintime/jack-laptop/jack/1/new_snapshot/backup/"
[I] Take snapshot (rsync: sending incremental file list)
[I] Take snapshot (rsync: ./)
[I] Take snapshot (rsync: home/jack/)
[I] Take snapshot (rsync: home/jack/Desktop/)
[I] Take snapshot (rsync: deleting home/jack/Desktop/probe_refs.pdf)
[I] Take snapshot (rsync: deleting home/jack/Desktop/REGULAR-OPERATING-SCHEDULE.pdf)
[I] Take snapshot (rsync: home/jack/Geology/Laboratory_Notes/)
[I] Take snapshot (rsync: home/jack/Geology/Laboratory_Notes/WayPoint_data_base.ods)
[I] Take snapshot (rsync: )
[I] Take snapshot (rsync: sent 5692453 bytes received 9649 bytes 751.41 bytes/sec)
[I] Take snapshot (rsync: total size is 64596354738 speedup is 11328.52)
[I] Save config file ...
[I] Save permission ...
[I] Smart remove
[I] Finalizing

Revision history for this message
avlas (avlas) said : 		#7

I like BiT but have the impression that it's slow too and very resource consuming. trying luckybackup now, first snapshot (125 GB) in a bit more than 2 hours. following snapshots in the order of minutes, so seriously considering to move my daily backups to luckybackup...

Revision history for this message
Launchpad Janitor (janitor) said : 		#8

This question was expired because it remained in the 'Open' state without activity for the last 15 days.

Revision history for this message
Calcipher (calcipher) said : 		#9

To anyone having this problem, do you have the 'Use checksum to detect changes' option enabled? And if you do, do you have large files? I was reading rsync's man pages, and it seem that it computes the MD4 (not 5) checksum of files when that is enabled. I, personally, have a lot of ISOs and VM images I use for work. A single 6.8GB file took nearly 3 minutes to compute and that was not with nice or ionice enabled.

Turning the 'Use checksum to detect changes' option off helped BiT work faster.