swift $file was corrupted during upload even with retries
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Duplicity |
Fix Released
|
Medium
|
Unassigned |
Bug Description
Command:
duplicity --verbosity 4 --log-file /var/log/
The backup halts with this error:
ERROR 44 'app1.server8.
. File app1.server8.
I would suspect it to restart (due to --num-retries 100), but that does not happen.
Duplicity version: 0.7.15 (from source)
Ubuntu 16.04 with that default python (2.7..)
Changed in duplicity: | |
assignee: | nobody → Kenneth Loafman (kenneth-loafman) |
importance: | Undecided → Medium |
milestone: | none → 0.7.18 |
status: | New → In Progress |
Changed in duplicity: | |
status: | Fix Released → Fix Committed |
Changed in duplicity: | |
status: | Fix Committed → Fix Released |
There was a discussion in 2011 about this error being fatal and whether or not to retry: https:/ /lists. nongnu. org/archive/ html/duplicity- talk/2011- 11/msg00037. html
TL;DR; duplicity tells backend to transfer file, backend says it did so, duplicity compares filesize to make sure and bails if it doesn't match.
Retry is done only when backend says it failed to transfer.
In your case the file size after a supposedly successful transfer is -1 bytes when 26197773 bytes was expected. For me the difference is usually 3-5 bytes.
As a side note I am using CloudVPS storage too and have noticed an increase of these corrupted transfers in the past two months or so.