Déjà Dup

Deja dup creates 19,000 files in one directory for my backup...how to split it up?

Asked by mattismyname

After running my first backup with Deja Dup, I noticed that it created 19741 files in the backup directory. In theory it is not a problem, but in reality it is a problem. It takes forever to run an 'ls' on the directory and a directory with that many files is likely to break other tools which try to process it.

Is there any way to make Deja Dup break up these files into a couple levels of subdirectory hierarchy? Or possibly a way to make each chunk larger? (Right now each chunk is only 10MB.

thanks,
Matt

Question information

Language:
English Edit question
Status:
Answered
For:
Déjà Dup Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Michael Terry (mterry) said : 		#1

Unfortunately, no. There's no way to either make Deja Dup use directories or use larger chunks right now. I'm reconsidering the default chunk size to be larger, but I wasn't planning to make it configurable.

Revision history for this message
mattismyname (mattismyname) said : 		#2

Thanks for the answer. Unfortunately this prevents me from using Deja Dup as my backup tool. After only a few weeks of using it, my backups directory now has over 50,000 files. After a year or more it would really get unmanageable (especially since it resides on a remote CIFS server).

Revision history for this message
Thorsten (thorstenfuehrer) said : 		#3

What are the drawbacks of making the chunk size configurable?
In fact, I'd love to use Deja Dup but for the same reason as Matt I can't.
Thorsten

Revision history for this message
Michael Terry (mterry) said : 		#4

The drawbacks of having it in the UI are large: more translations, confusion to the vast majority of users that don't understand the terms or the tradeoff, users easily shooting themselves in the foot with weird values.

Having it as a hidden gsettings option is maintainabililty on my end, a smaller number of users being able to shoot themselves in the foot.

Revision history for this message
Thorsten (thorstenfuehrer) said : 		#5

So it's better that you shoot the users in the foot ;-)

Revision history for this message
tekrei (tekrei) said : 		#6

I think user configurable chunk size for local backup must be implemented. With current situation many users will walk away from using deja-dup.

Revision history for this message
Francewhoa (francewhoa) said : 		#7

+1 for configurable chunk size for local backup. I would be happy to contribute testing.

Can you help with this problem?

Provide an answer of your own, or ask mattismyname for more information if necessary.

To post a message you must log in.