Duplicity

duplicity fails with file too large error

Asked by Camille on 2017-11-13

Hello,

using:
* duplicity 0.7.14
* gpg (GnuPG) 1.4.16
* Linux 3.13.0-29-generic (Ubuntu)

I had successfuly configured duplicity to remote backup content with commands such as:

duplicity --encrypt-key D68E26B0 /etc sftp://<email address hidden>/duplicity/mendoza.xxxxxx.com/etc

But it suddenly failed a few days ago with the following errors:

 GPGError: GPG Failed, see log below:
===== Begin GnuPG log =====
gpg: [stdout]: write error: File too large
gpg: DBG: deflate: iobuf_write failed
gpg: build_packet failed: file write error
gpg: [stdout]: write error: File too large
gpg: iobuf_flush failed on close: file write error
gpg: [stdout]: write error: File too large
gpg: iobuf_flush failed on close: file write error
gpg: [stdin]: encryption failed: file write error
===== End GnuPG log =====

I have tried to reset the remote folder, removed local cache, reset gpg keyring, even tried differente schemes, to no avail:

# LANG=en_US.UTH-8 duplicity --no-encryption /etc pexpect+scp://<email address hidden>/duplicity/mendoza.xxxxxx.com/etc
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: none
No signatures found, switching to full backup.
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1548, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1534, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1383, in main
    do_backup(action)
  File "/usr/bin/duplicity", line 1509, in do_backup
    full_backup(col_stats)
  File "/usr/bin/duplicity", line 573, in full_backup
    globals.backend)
  File "/usr/bin/duplicity", line 432, in write_multivol
    at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 443, in GzipWriteFile
    outfile.write(new_block.data)
  File "/usr/lib/python2.7/gzip.py", line 236, in write
    self.fileobj.write( self.compress.compress(data) )
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 419, in write
    result = self.fileobj.write(buf)
IOError: [Errno 27] File too large

This backup is small (77MB) anf there are plenty of available space on both sides, even on /tmp/. Manual ssh to the remote user/host works.

Any idea?

Question information

Language:
English Edit question
Status:
Answered
For:
Duplicity Edit question
Assignee:
No assignee Edit question
Last query:
2017-11-13
Last reply:
2017-11-13
edso (ed.so) said : #1

On 13.11.2017 16:57, Camille wrote:
> File "/usr/lib/python2.7/gzip.py", line 236, in write
> self.fileobj.write( self.compress.compress(data) )
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 419, in write
> result = self.fileobj.write(buf)
> IOError: [Errno 27] File too large
>
> This backup is small (77MB) anf there are plenty of available space on both sides, even on /tmp/. Manual ssh to the remote user/host works.
>
> Any idea?

what file systems are involved locally. can you post the output of 'mount' ?

..ede/duply.net

Camille (camille-neodoc) said : #2

root@mendoza:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 3.9G 12K 3.9G 1% /dev
tmpfs 796M 1.9M 794M 1% /run
/dev/sda2 916G 607G 263G 70% /
none 4.0K 0 4.0K 0% /sys/fs/cgroup
none 5.0M 8.0K 5.0M 1% /run/lock
none 3.9G 0 3.9G 0% /run/shm
none 100M 4.0K 100M 1% /run/user
/dev/sda1 180M 66M 101M 40% /boot
root@mendoza:~# mount
/dev/sda2 on / type ext4 (rw,errors=remount-ro)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
none on /sys/fs/cgroup type tmpfs (rw)
none on /sys/fs/fuse/connections type fusectl (rw)
none on /sys/kernel/debug type debugfs (rw)
none on /sys/kernel/security type securityfs (rw)
udev on /dev type devtmpfs (rw,mode=0755)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=0620)
tmpfs on /run type tmpfs (rw,noexec,nosuid,size=10%,mode=0755)
none on /run/lock type tmpfs (rw,noexec,nosuid,nodev,size=5242880)
none on /run/shm type tmpfs (rw,nosuid,nodev)
none on /run/user type tmpfs (rw,noexec,nosuid,nodev,size=104857600,mode=0755)
none on /sys/fs/pstore type pstore (rw)
/dev/sda1 on /boot type ext4 (rw)
systemd on /sys/fs/cgroup/systemd type cgroup (rw,noexec,nosuid,nodev,none,name=systemd)

Can you help with this problem?

Provide an answer of your own, or ask Camille for more information if necessary.

To post a message you must log in.