xtrabackup_56 " Segmentation fault" error on log prepare & export

Asked by Andrewk

Complete backup with:

[root@server]# xtrabackup_56 --defaults-file=/etc/my.cnf --backup --tables=saint.* --target-dir=/backup/2013-12-04/
xtrabackup_56 version 2.1.6 for MySQL server 5.6.11 Linux (x86_64) (revision id: 702)
xtrabackup: uses posix_fadvise().
xtrabackup: cd to /var/lib/mysql
xtrabackup: using the following InnoDB configuration:
xtrabackup: innodb_data_home_dir = ./
xtrabackup: innodb_data_file_path = ibdata1:10M:autoextend
xtrabackup: innodb_log_group_home_dir = ./
xtrabackup: innodb_log_files_in_group = 2
xtrabackup: innodb_log_file_size = 50331648
>> log scanned up to (672616459434)
InnoDB: Allocated tablespace 89, old maximum was 0
....
<backup junk>
....
>> log scanned up to (672981349946)
xtrabackup: The latest check point (for incremental): '672979861909'
xtrabackup: Stopping log copying thread.
.>> log scanned up to (672981352784)

xtrabackup: Transaction log of lsn (672607273961) to (672981352784) was copied.

Then i try prepare:

[root@server]# gdb xtrabackup_56
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Reading symbols from /usr/bin/xtrabackup_56...Reading symbols from /usr/lib/debug/usr/bin/xtrabackup_56.debug...done.
done.
(gdb) run --defaults-file=/etc/my.cnf --prepare --export --use-memory=12G --target-dir=/backup/2013-12-04/
Starting program: /usr/bin/xtrabackup_56 --defaults-file=/etc/my.cnf --prepare --export --use-memory=12G --target-dir=/backup/2013-12-04/
[Thread debugging using libthread_db enabled]
[New Thread 0x7ffff6162700 (LWP 14112)]
[Thread 0x7ffff6162700 (LWP 14112) exited]
/usr/bin/xtrabackup_56 version 2.1.6 for MySQL server 5.6.11 Linux (x86_64) (revision id: 702)
xtrabackup: cd to /backup/2013-12-04/
xtrabackup: This target seems to be not prepared yet.
2013-12-05 21:02:19 7ffff7feb720 InnoDB: Operating system error number 2 in a file operation.
InnoDB: The error means the system cannot find the path specified.
xtrabackup: Warning: cannot open ./xtrabackup_logfile. will try to find.
  xtrabackup: 'ib_logfile0' seems to be 'xtrabackup_logfile'. will retry.
xtrabackup: xtrabackup_logfile detected: size=599195648, start_lsn=(672607273961)
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup: innodb_data_home_dir = ./
xtrabackup: innodb_data_file_path = ibdata1:10M:autoextend
xtrabackup: innodb_log_group_home_dir = ./
xtrabackup: innodb_log_files_in_group = 1
xtrabackup: innodb_log_file_size = 599195648
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup: innodb_data_home_dir = ./
xtrabackup: innodb_data_file_path = ibdata1:10M:autoextend
xtrabackup: innodb_log_group_home_dir = ./
xtrabackup: innodb_log_files_in_group = 1
xtrabackup: innodb_log_file_size = 599195648
xtrabackup: Starting InnoDB instance for recovery.
xtrabackup: Using 12884901888 bytes for buffer pool (set by --use-memory parameter)
InnoDB: The InnoDB memory heap is disabled
InnoDB: Mutexes and rw_locks use GCC atomic builtins
InnoDB: Compressed tables use zlib 1.2.3
InnoDB: Not using CPU crc32 instructions
InnoDB: Initializing buffer pool, size = 12.0G
InnoDB: Completed initialization of buffer pool
[New Thread 0x7ffff6162700 (LWP 14113)]
[New Thread 0x7ffccece2700 (LWP 14114)]
[New Thread 0x7ffcce2e1700 (LWP 14115)]
[New Thread 0x7ffccd8e0700 (LWP 14116)]
[New Thread 0x7ffcccedf700 (LWP 14117)]
[New Thread 0x7ffccc4de700 (LWP 14118)]
[New Thread 0x7ffccbadd700 (LWP 14119)]
[New Thread 0x7ffccb0dc700 (LWP 14120)]
[New Thread 0x7ffcca6db700 (LWP 14121)]
[New Thread 0x7ffcc9cda700 (LWP 14122)]
InnoDB: Highest supported file format is Barracuda.
InnoDB: Log scan progressed past the checkpoint lsn 672607273961
InnoDB: Database was not shutdown normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages
InnoDB: from the doublewrite buffer...
InnoDB: Doing recovery: scanned up to log sequence number 672612516352 (0%)
...
...
InnoDB: Doing recovery: scanned up to log sequence number 672981352784 (70%)
[New Thread 0x7ffcbcc46700 (LWP 14123)]

Program received signal SIGSEGV, Segmentation fault.
page_rec_find_owner_rec (current_rec=0x7ffd1f9b114a "", index=0x159b5818, rec=0x7fffffff7370 "", offsets=<value optimized out>, mtr=0x7fffffff7c00) at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/include/page0page.ic:931
931 while (rec_get_n_owned_old(rec) == 0) {
Missing separate debuginfos, use: debuginfo-install libaio-0.3.107-10.el6.x86_64

(gdb) bt full
#0 page_rec_find_owner_rec (current_rec=0x7ffd1f9b114a "", index=0x159b5818, rec=0x7fffffff7370 "", offsets=<value optimized out>, mtr=0x7fffffff7c00) at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/include/page0page.ic:931
No locals.
#1 page_cur_insert_rec_low (current_rec=0x7ffd1f9b114a "", index=0x159b5818, rec=0x7fffffff7370 "", offsets=<value optimized out>, mtr=0x7fffffff7c00) at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/page/page0cur.cc:1131
        owner_rec = 0x0
        n_owned = <value optimized out>
        rec_size = 91
        insert_rec = 0x7ffd1f9b015c ""
        insert_buf = <value optimized out>
        page = 0x7ffd1f9b0000 "\353;c>"
        last_insert = <value optimized out>
        free_rec = <value optimized out>
        heap_no = 5
#2 0x00000000004f52c3 in page_cur_rec_insert (is_short=0, ptr=0x7ffcf30e45e7 "KIEB851\t\005\004", end_ptr=<value optimized out>, block=0x7ffcdec39560, index=0x159b5818, mtr=0x7fffffff7c00)
    at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/include/page0cur.ic:315
No locals.
#3 page_cur_parse_insert_rec (is_short=0, ptr=0x7ffcf30e45e7 "KIEB851\t\005\004", end_ptr=<value optimized out>, block=0x7ffcdec39560, index=0x159b5818, mtr=0x7fffffff7c00) at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/page/page0cur.cc:926
        origin_offset = 16
        mismatch_index = 0
        buf = 0x7fffffff7360 "KIEB851\t\005\004"
        cursor = {rec = 0x7ffd1f9b114a "", block = 0x7ffcdec39560}
        page = 0x7ffd1f9b0000 "\353;c>"
        ptr2 = 0x7ffcf30e45e0 "\021J\200\267"
        info_and_status_bits = <value optimized out>
        end_seg_len = 91
        cursor_rec = 0x7ffd1f9b114a ""
        buf1 = "KIEB851\t\005\004\000\001\360\025\021\n\000\000\000i\000\000\n\005\220\000\000\000\001\206\003\000\004\000\000\f\017\000\t\000\300\f\017\000\060\000\300\206\n\000\003\000\000\206\003\000\004\200\000\f\017\000\f\200\300\200\000\000\071AUDPROCESSFEE\217\273\203\203J-mA4", '\000' <repeats 13 times>"\220, \221\303\336\374\177\000\000\236\r\000\000\000\000\000\000\070p\235\000\000\000\000\000H\221\303\336\374\177\000\000\001\000\000\000\000\000\000\000\220t\377\377\377\177\000\000+\242L\000\000\000\000\000\064\v\000\000\000\000\000\000\b\001\000\000\000\000\000\000>\r\000\000\000\000\000\000Xt\377\377\377\177\000\000\064\v\000\000\000\000\000\000\b\001\000\000\000\000\000\000>\r\000\000\000\000\000\000\370\021\000\000\000\000\000\000\370\060\236\000\000\000\000\000Pt\377\377\377\177\000\000\070\252\030\001"...
        heap = 0x0
        offsets_ = {100, 10, 16, 4, 5, 9, 49, 53, 56, 66, 69, 73, 75, 0, 0, 0, 140737328306272, 140737324997786, 2, 140737347612783, 0, 6042917, 0, 16384, 140737488320592, 6043284, 10, 16384, 0, 10, 140737488320752, 6056292, 140737488320840, 1, 140724045844680, 1, 0,
          0, 140725133656064, 30069811480, 362458584, 140737488321008, 17446272, 140724045844680, 140737488320800, 140737328311936, 9, 140737328311936, 362499736, 1256, 1264, 140737325073413, 140725133656064, 1256, 140737328312040, 140724045844680, 140733193388068, 9,
          1, 608, 0, 0, 0, 244813135908, 532575944796, 472446402679, 0, 362501808, 568, 140737328311936, 362501816, 5204960, 362501808, 0, 362501816, 362502048, 140737488321040, 5208760, 10475576, 568, 140737488321072, 362501808, 362501808, 5142194, 362502440, 0,
          10453997, 32, 140737488321072, 362502440, 140737488321152, 5751530, 362501808, 0, 9, 362500088, 140724386285024, 140724386285024, 140725133705216, 9}
        offsets = <value optimized out>
#4 0x000000000048ac19 in recv_parse_or_apply_log_rec_body (type=9 '\t', ptr=0x7ffcf30e45e0 "\021J\200\267", end_ptr=<value optimized out>, block=0x7ffcdec39560, mtr=<value optimized out>, space_id=<value optimized out>)
    at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/log/log0recv.cc:1220
        index = 0x159b5818
        page = 0x7ffd1f9b0000 "\353;c>"
        page_zip = 0x0
#5 0x000000000048db34 in recv_recover_page_func (just_read_in=<value optimized out>, block=0x7ffcdec39560) at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/log/log0recv.cc:1785
        end_lsn = <value optimized out>
        page_zip = 0x0
        recv_addr = 0x62
        buf = 0x7ffcf30e45e0 "\021J\200\267"
        start_lsn = 672616580261
        page_lsn = 672616099924
        page_newest_lsn = <value optimized out>
        modification_to_page = 1
        page = 0x7ffd1f9b0000 "\353;c>"
        recv = <value optimized out>
        end_lsn = 672627420345
        mtr = {memo = {heap = 0x0, used = 16,
            data = "\002\000\000\000\000\000\000\000`\225\303\336\374\177\000\000P|\377\377\377\177\000\000\000\000\000\000\000\000\000\000\070\252\030\001\000\000\000\000XT\231\025\000\000\000\000\340\225\303\336\374\177\000\000\000\000\000\000\000\000\000\000\300\201\377\377\377\177\000\000;WJ", '\000' <repeats 21 times>, "\001", '\000' <repeats 15 times>, "\004", '\000' <repeats 15 times>"\204, \000\000\000\000\000\000\000`\225\303\336\374\177\000\000`\225\303\336\374\177\000\000Kj\224b\000\000\000\000\001", '\000' <repeats 23 times>"\340, |\377\377\377\177", '\000' <repeats 26 times>, "\020\000\000\000\000\000\000\000\002", '\000' <repeats 135 times>"\311, g\234\367\377\177\000\000\000\000\000\000\000\000\000\000\330\061\\\000\000\000\000\000\035\000\000\000\000\000\000\000~\025\060\004\000\000\000\000\001", '\000' <repeats 27 times>, "\002\000\000\000\000\000\267"..., base = {count = 0, start = 0x0, end = 0x0}, list = {prev = 0x7fffffff8ec0, next = 0xa}}, log = {heap = 0x0, used = 0,
            data = "\000\236K", '\000' <repeats 117 times>, "\004\000\000\000\000\000\000\000\001", '\000' <repeats 15 times>, "`", '\000' <repeats 31 times>, "\004\000\000\000\061\000\000\000[\000\000\000|\000\000\000w\000\000\000n", '\000' <repeats 27 times>"\200, \356u\366\377\177\000\000\350\177\377\377\377\177\000\000X\254\030\001\000\000\000\000\070\252\030\001\000\000\000\000op\234\367\377\177\000\000\000\000\000\000\000\000\000\000%5\\\000\000\000\000\000\001\000\000\000\000\000\000\000\000@\000\000\000\000\000\000\240\177\377\377\377\177\000\000\224\066\\\000\000\000\000\000\n\000\000\000\000\000\000\000\000\200", '\000' <repeats 14 times>, "\n\000\000\000\000\000\000\000@\200\377\377\377\177\000\000di\\\000\000\000\000\000\070\252\030\001\000\000\000\000@\217\303\336\374\177\000\000ؓ\303\336\374\177\000\000\002", '\000' <repeats 15 times>..., base = {count = 140724045845464, start = 0x7ffcdec39560, end = 0x4}, list = {prev = 0x0, next = 0x0}}, inside_ibuf = 0, modifications = 1, made_dirty = 1, n_log_recs = 0, n_freed_pages = 0, log_mode = 22,
          start_lsn = 0, end_lsn = 140724045845856}
        success = <value optimized out>
#6 0x00000000004a3447 in buf_page_io_complete (bpage=0x7ffcdec39560) at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/buf/buf0buf.cc:4095
        read_page_no = 16384
        read_space_id = 18446744073709535232
        frame = 0x7ffd1f9b0000 "\353;c>"
        io_type = BUF_IO_READ
        buf_pool = <value optimized out>
        uncompressed = <value optimized out>
#7 0x00000000005e2e73 in buf_read_page_low (err=0x7fffffff829c, sync=1, mode=<value optimized out>, space=0, zip_size=0, unzip=<value optimized out>, tablespace_version=1, offset=4)
---Type <return> to continue, or q <return> to quit---
    at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/buf/buf0rea.cc:214
        bpage = 0x7ffcdec39560
        wake_later = <value optimized out>
        ignore_nonexistent_pages = <value optimized out>
#8 0x00000000005e32ab in buf_read_page (space=0, zip_size=0, offset=4) at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/buf/buf0rea.cc:412
        tablespace_version = <value optimized out>
        count = <value optimized out>
        err = DB_SUCCESS
#9 0x00000000004a65a9 in buf_page_get_gen (space=0, zip_size=0, offset=4, rw_latch=2, guess=<value optimized out>, mode=10,
    file=0x9e30f8 "/mnt/workspace/percona-xtrabackup-2.1-rpms/label_exp/centos6-64/target/BUILD/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/ibuf/ibuf0ibuf.cc", line=558, mtr=0x7fffffff83e0)
    at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/buf/buf0buf.cc:2546
        fold = 4
        fix_type = <value optimized out>
        block_mutex = <value optimized out>
        retries = 0
        block = <value optimized out>
        access_time = 362370136
        hash_lock = 0x15995458
        buf_pool = 0x118aa38
        must_read = <value optimized out>
        hash_bpage = <value optimized out>
#10 0x00000000004fb954 in ibuf_init_at_db_start () at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/ibuf/ibuf0ibuf.cc:558
        block = <value optimized out>
        root = <value optimized out>
        mtr = {memo = {heap = 0x0, used = 64,
            data = "8\000\000\000\000\000\000\000\000\252\232\025\000\000\000\000\002\000\000\000\000\000\000\000P\222\303\336\374\177\000\000\070\000\000\000\000\000\000\000\000\252\232\025\000\000\000\000\002\000\000\000\000\000\000\000ؓ\303\336\374\177\000\000\273\205\377\377\377\177\000\000`\357\026\001\000\000\000\000\024\000\000\000\000\000\000\000\005\000\000\000\000\000\000\000\060\205\377\377\377\177\000\000V\311G\000\000\000\000\000Є\377\377\377\177\000\000\200\354\026\001\000\000\000\000@\001\000\000\000\000\000\000\230\204\377\377\001\000\000\000\300\002\000\000\000\000\000\000\270\216\232\025\000\000\000\000\000\202ϰ\234", '\000' <repeats 12 times>"\202, а\234\000\000\000P\201а\234\000\000\000\030\215\232\025\000\000\000\000@\336\022\001\000\000\000\000\000\202а\234\000\000\000P\201а\234\000\000\000\060\216\377\377\377\177\000\000n\027I\000\000\000\000\000\350\215\377\377\377\177\000\000\000\205\377\377\377\177\000\000\270\266\232\025", '\000' <repeats 19 times>"\234, @\205\377\377\377\177\000\000\260"..., base = {count = 362458328,
              start = 0x159aacd8, end = 0x10a3580}, list = {prev = 0x159aacd8, next = 0x7fffffff8700}}, log = {heap = 0x0, used = 0,
            data = "8\252\030\001\000\000\000\000\001\000\000\000\000\000\000\000@\217\303\336\374\177\000\000\000\207\377\377\377\177\000\000\362\065J\000\000\000\000\000ح\232\025\000\000\000\000\n", '\000' <repeats 15 times>"\377, \377\377\377\000\000\000\000\070\071\n\001", '\000' <repeats 12 times>"\271, \273\360\337\000\000\000\000m+\347\071\000\000\000\000\t\000\000\000\000\000\000\000\002", '\000' <repeats 15 times>"\260, ", '\000' <repeats 31 times>, "\t\000\000\000\062\000\000\000[\000\000\000|\000\000\000w\000\000\000n", '\000' <repeats 11 times>"\200, \000\000\000\000\000\000\000\200\000\000\000\000\000\000\000\200\356u\366\377\177\000\000\250D\233\025\000\000\000\000\020", '\000' <repeats 15 times>"\270, zO\000\000\000\000\000\200", '\000' <repeats 15 times>"\300, \207\377\377\377\177\000\000\340\371\232\025\000\000\000\000\340\371\232\025\000\000\000\000"..., base = {count = 5208760, start = 0x9fd838, end = 0x7fffffff8930}, list = {prev = 0x7fffffff8940, next = 0x7fffffff8940}}, inside_ibuf = 1, modifications = 0, made_dirty = 1, n_log_recs = 0,
          n_freed_pages = 0, log_mode = 21, start_lsn = 362492840, end_lsn = 362497192}
        heap = <value optimized out>
        n_used = 1007
        table = <value optimized out>
        index = <value optimized out>
        error = <value optimized out>
#11 0x000000000057ae3f in dict_boot () at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/dict/dict0boot.cc:453
        heap = <value optimized out>
        mtr = {memo = {heap = 0x0, used = 16, data = "\002", '\000' <repeats 452 times>, "6P\301\000\000\000\234\232\204\203\351\000\000\t\351\000\020\000\000\377\377\377\377\377\377\377\377\000\000 ", '\000' <repeats 28 times>, base = {count = 0, start = 0x0,
              end = 0x0}, list = {prev = 0x0, next = 0x0}}, log = {heap = 0x0, used = 0,
            data = '\000' <repeats 168 times>, "\034\212\344\203\374<aI", '\000' <repeats 216 times>, "Jj\224b\000\000\000\000\000\000\240\335\374\177\000\000\000\000\000\000\000\000\000\000\302P6\000\000\000\000\000\377\377\377\377\377\377\377\377郄\232\234\000\000\000\261\321\022\333:\000\000\000\261\321\022\333:\000\000\000\377\377\377\377\377\377\377\377郄\232\234\000\000\000\360\214\377\377\377\177\000\000\000\000\000\000\n\000\000\000\265\065\260\004\000\000\000\000\270\266\232\025\000\000\000\000\303P6\000\000\000\000",
            base = {count = 0, start = 0x7fffffff8db0, end = 0xffffffffff60004d}, list = {prev = 0xc2354b0e, next = 0x0}}, inside_ibuf = 0, modifications = 0, made_dirty = 0, n_log_recs = 0, n_freed_pages = 0, log_mode = 21, start_lsn = 1386237741, end_lsn = 838883}
        err = <value optimized out>
        table = 0x159b33a8
        index = 0x159b44a8
        dict_hdr = 0x7ffd1f9a0026 ""
        error = <value optimized out>
#12 0x00000000004be5e9 in innobase_start_or_create_for_mysql () at /usr/src/debug/percona-xtrabackup-2.1.6/mysql-5.6/storage/innobase/srv/srv0start.cc:2322
        sum_of_data_file_sizes = <value optimized out>
        err = <value optimized out>
        i = 1
        logfile0 = 0x0
        unit = <value optimized out>
        min_flushed_lsn = 252783546801
        srv_n_log_files_found = 1
        dirnamelen = 2
        size = <value optimized out>
        io_limit = 256
        mtr = {memo = {heap = 0x0, used = 0,
            data = '\000' <repeats 49 times>"\310, \377\377\377\177\000\000\255\301G", '\000' <repeats 77 times>, "AoG", '\000' <repeats 37 times>, "r\306\377\377\377\177\000\000\201\310\377\377\377\177\000\000/tmp", '\000' <repeats 13 times>"\310, \377\377\377\177\000\000\032\000\000\000\000\000\000\000\000\310\377\377\377\177\000\000z\350\377\377\000\000\000\000\360\307\377\377\377\177\000\000\352}G\000\000\000\000\000./ib_log\370\017\000\000\000\000\000\000\000\020\002", '\000' <repeats 13 times>, "\020\312\377\377\377\177\000\000@\000\000\000\000\000\000\000\b\000\000\000\000\000\000\000 \020", '\000' <repeats 22 times>, "\001\000\000\000\000\000\000\000\000\001\000\000p\000\000\000c\000\000\000|\000\000\000w\000\000\000o", '\000' <repeats 11 times>"\260, \352\031\001\000\000\000\000\370\017\000\000\000\000\000\000\200"..., base = {count = 129119144, start = 0x7fffffffc860, end = 0x7fff00000002}, list = {prev = 0x0, next = 0x0}}, log = {heap = 0x40, used = 0,
            data = '\000' <repeats 16 times>, "\002\000\000\000\060\000\000\000[\000\000\000|\000\000\000w\000\000\000n", '\000' <repeats 11 times>, "Ⲝ\000\000\000\000\000\005\000\000\000\000\000\000\000\200\356u\366\377\177\000\000\005\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\330\312\377\377\377\177\000\000\221\231D\366\377\177\000\000Ⲝ\000\000\000\000\000\220\310\377\377\377\177\000\000\004\000\000\000\000\000\000\000\"dG\000\000\000\000\000Ⲝ\000\000\000\000\000\004\000\000\000\000\000\000\000\320\310\377\377\377\177\000\000沜\000\000\000\000\000\300\310\377\377\377\177\000\000\033\255{\000\000\000\000\000\000t\025\001\000\000\000\000Ⲝ\000\000\000\000\000Ⲝ\000\000\000\000\000\000t\025\001\000\000\000\000\020\313\377\377\377\177\000\000,\226G\000\000\000\000\000/tmp\00---Type <return> to continue, or q <return> to quit---
0\177\000\000\070\347\376\367\377\177\000\000\071\265\357\060\000\000\000\000Zn\336\367\377\177"..., base = {count = 140737328306272, start = 0x1, end = 0x1a}, list = {prev = 0x1021230, next = 0x7ffff675d860}}, inside_ibuf = 0, modifications = 0, made_dirty = 0,
          n_log_recs = 26, n_freed_pages = 16912944, log_mode = 4294961274, start_lsn = 1, end_lsn = 140737325626327}
        logfilename = "./ib_logfile0", '\000' <repeats 3115 times>, "^9D\366\377\177\000\000\000\302\377\377\377\177\000\000\360\241\377\377\377\177\000\000.\000\000\000\000\000\000\000^9D\366\377\177\000\000 \302\377\377\377\177\000\000\020\242\377\377\377\177\000\000P\000\000\000\000\000\000\000`\312\377\377\377\177\000\000\271\000\234\000\000\000\000\000g4A\366\377\177\000\000\360\000\234\000\000\000\000\000\067\000\000\000\000\000\000\000\001", '\000' <repeats 15 times>"\340, \240\377\377\377\177\000\000\000\000\000\000\000\000\000\000\350\342\233", '\000' <repeats 14 times>"\241, \377\377\377\177\000\000\000\000\000\000\000\000\000\000p\000\234\000\000\000\000\000h\241\377\377\377\177", '\000' <repeats 18 times>, "l\241\377\377\377\177\000\000\210\241\377\377\377\177\000\000\000\000\000\000\000\000\000\000\250\241\377\377\377\177", '\000' <repeats 22 times>"\257, \240\377\377М\377\377\377\177\000\000\000\000\000\000\377\377\377\377@\241\377\377\377\177\000\000\000\000\000\000"...
        create_new_db = 0
        max_flushed_lsn = 252783546801
        sum_of_new_sizes = 0
        tablespace_size_in_header = <value optimized out>
        ib_bh = <value optimized out>
#13 0x0000000000454d6b in innodb_init () at xtrabackup.cc:1438
        err = <value optimized out>
#14 xtrabackup_prepare_func () at xtrabackup.cc:5455
        err = 0
        node = 0x0
        metadata_path = "./xtrabackup_checkpoints\000;E\000\000\000\000\000\000\340\377\377\377\177\000\000\300\021\002\001", '\000' <repeats 12 times>"\340, \344\377\367\377\177\000\000p\340\377\377\377\177\000\000r\350\377\377\377\177\000\000\210\340\377\377\377\177\000\000%\027\337\367\001\000\000\000@\342\377\377\377\177\000\000h\234A\000\000\000\000\000/backup/2013-12-04/\000\000\000\020\002", '\000' <repeats 30 times>, "\037\000\000\000\067\000\000\000[\000\000\000|\000\000\000w\000\000\000n\000\000\000 \314=\366\377\177\000\000\220\371\376\367\377\177\000\000\340\001\000\000\000\000\000\000\377\377\377\377\000\000\000\000\340\001\000\000\000\000\000\000\005\000\000\000\000\000\000\000P\005\002\001", '\000' <repeats 12 times>...
        space = <value optimized out>
#15 0x000000000045713b in main (argc=0, argv=0x1174350) at xtrabackup.cc:6035
        ho_error = <value optimized out>
(gdb)

System:
[root@server]# uname -a
Linux server 2.6.32-358.23.2.el6.x86_64 #1 SMP Wed Oct 16 18:37:12 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
[root@server]# cat /etc/centos-release
CentOS release 6.4 (Final)

my.cnf

[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
user=mysql
innodb_file_per_table
default-storage-engine=InnoDB
lower_case_table_names=1
skip-secure-auth

###################### REPLICATION SETTINGS #########################
# The MySQL server
tmpdir=/var/lib/mysql/tmp

# SLAVE SETTINGS
server-id=21
relay-log=mysqld-relay-bin
###################################################################
innodb_buffer_pool_size=8000000000
query_cache_type=1
query_cache_size=120000000
query_cache_limit=2000000

###################################################################

#Aborted connections are not logged to the error log unless the value is greater than 1
log-warnings=2
max_connections=1500
connect_timeout=60
max_allowed_packet=64M

Question information

Language:
English Edit question
Status:
Answered
For:
Percona XtraBackup moved to https://jira.percona.com/projects/PXB Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Alexey Kopytov (akopytov) said :
#1

What was the server version for that backup?

Revision history for this message
Andrewk (andrewk-g) said :
#2

Hey Alexey,

[root@server ~]# mysqld --version
mysqld Ver 5.6.10 for Linux on x86_64 (MySQL Community Server (GPL))

[root@server ~]# rpm -qa |grep -i mysql
MySQL-client-5.6.10-1.el6.x86_64
MySQL-shared-5.6.10-1.el6.x86_64
MySQL-shared-compat-5.6.10-1.el6.x86_64
MySQL-server-5.6.10-1.el6.x86_64
MySQL-devel-5.6.10-1.el6.x86_64
MySQL-test-5.6.10-1.el6.x86_64

Andrew

Revision history for this message
Alexey Kopytov (akopytov) said :
#3

Andrew,

I'm fairly sure it's another occurrence of bug #1203669. I'm going to fix it in the next XtraBackup release by rebasing on the most recent InnoDB code.

As a workaround you can either upgrade to MySQL 5.6.11+, or use XtraBackup 2.0 which is not affected by this issue.

Can you help with this problem?

Provide an answer of your own, or ask Andrewk for more information if necessary.

To post a message you must log in.