Ubuntu

kernel crash after starting java with kernel 3.13.0-155

Asked by Dirk Brammertz

After upgrading from 3.13.0-153 to 3.13.0-155, I cannot start any oracle java process any more. Any suggestions?

java version: java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)

ug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.675704] java: Corrupted page table at address 7f03fbcd3000
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.676383] PGD 8000000035f64067 PUD bace9067 PMD b79c8067 PTE 80003ffffe17c225
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.677054] Bad pagetable: 000d [#9] SMP
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.677726] Modules linked in: vmw_vsock_vmci_transport vsock cpuid xt_multiport ip6t_REJECT xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 ipt_REJECT xt_LOG xt_limit xt_tcpudp xt_addrtype nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ip6table_filter ip6_tables nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ftp nf_conntrack iptable_filter ip_tables x_tables coretemp crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel ppdev aes_x86_64 lrw vmw_balloon gf128mul glue_helper ablk_helper vmwgfx cryptd serio_raw nfsd ttm drm i2c_piix4 auth_rpcgss nfs_acl shpchp mac_hid parport_pc nfs vmw_vmci lockd sunrpc fscache lp parport psmouse mptspi vmw_pvscsi mptscsih mptbase floppy vmxnet3 pata_acpi
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.683097] CPU: 0 PID: 12684 Comm: java Tainted: G B D 3.13.0-155-generic #205-Ubuntu
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.683755] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.685016] task: ffff8801b52ab000 ti: ffff880036740000 task.ti: ffff880036740000
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.685652] RIP: 0033:[<00007f03e5108e3d>] [<00007f03e5108e3d>] 0x7f03e5108e3d
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.686287] RSP: 002b:00007f03fbcc5658 EFLAGS: 00010206
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.686856] RAX: 00007f03b8178480 RBX: 00007f03b8178480 RCX: 00000000ff207ba0
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.687473] RDX: 00007f03e500835d RSI: 00000000ff207ba0 RDI: 0000000000000000
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.688100] RBP: 00007f03fbcc56b8 R08: 0000000040000000 R09: 0000000000000013
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.688697] R10: 00000001000aa0e8 R11: 000000002001541d R12: 0000000000000000
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.689284] R13: 00007f03fbcc5670 R14: 00007f03fbcc56c8 R15: 00007f03f400f000
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.689858] FS: 00007f03fbcc8700(0000) GS:ffff8801bfc00000(0000) knlGS:0000000000000000
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.690427] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.690986] CR2: 00007f03fbcd3000 CR3: 00000000ba3b2000 CR4: 0000000000040770
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.691526]
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.692064] RIP [<00007f03e5108e3d>] 0x7f03e5108e3d
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.692627] RSP <00007f03fbcc5658>
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.693153] ---[ end trace 64850948fe5f6b02 ]---
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.696115] BUG: Bad page map in process java pte:80003ffffe17c225 pmd:b79c8067
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.696656] addr:00007f03fbcd3000 vm_flags:08000071 anon_vma: (null) mapping: (null) index:7f03fbcd3
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.697583] CPU: 2 PID: 12714 Comm: java Tainted: G B D 3.13.0-155-generic #205-Ubuntu
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.698107] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.699137] 0000000000000000 ffff8801b2139a98 ffffffff8173983f 00007f03fbcd3000
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.699662] ffff880036452a80 ffff8801b2139ae8 ffffffff8117e374 80003ffffe17c225
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.700201] 00000000b79c8067 00000007f03fbcd3 ffff8800b79c8698 ffff8801b2139c58
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.700723] Call Trace:
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.701234] [<ffffffff8173983f>] dump_stack+0x64/0x80
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.701740] [<ffffffff8117e374>] print_bad_pte+0x1a4/0x250
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.702232] [<ffffffff8117f6ae>] vm_normal_page+0x6e/0x80
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.702715] [<ffffffff8117faa6>] unmap_page_range+0x3e6/0x830
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.703183] [<ffffffff8117ff71>] unmap_single_vma+0x81/0xf0
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.703639] [<ffffffff81181019>] unmap_vmas+0x49/0x90
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.704082] [<ffffffff8118a05c>] exit_mmap+0x9c/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.704520] [<ffffffff81118ee3>] ? __delayacct_add_tsk+0x153/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.704944] [<ffffffff8106a43c>] mmput+0x5c/0x120
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.705359] [<ffffffff8106fda4>] do_exit+0x264/0xa60
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.705761] [<ffffffff810df701>] ? __unqueue_futex+0x31/0x60
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.706152] [<ffffffff810e0b26>] ? futex_wait+0x126/0x290
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.706533] [<ffffffff8107061f>] do_group_exit+0x3f/0xb0
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.706907] [<ffffffff81080ba0>] get_signal_to_deliver+0x1d0/0x700
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.707281] [<ffffffff81014458>] do_signal+0x48/0xa30
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.707647] [<ffffffff8174aa35>] ? system_call_after_swapgs+0x14f/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.708032] [<ffffffff8174aa2e>] ? system_call_after_swapgs+0x148/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.708392] [<ffffffff8174aa27>] ? system_call_after_swapgs+0x141/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.708744] [<ffffffff8174aa20>] ? system_call_after_swapgs+0x13a/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.709090] [<ffffffff8174aa19>] ? system_call_after_swapgs+0x133/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.709426] [<ffffffff8174aa12>] ? system_call_after_swapgs+0x12c/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.709751] [<ffffffff8174aa0b>] ? system_call_after_swapgs+0x125/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.710065] [<ffffffff8174aa04>] ? system_call_after_swapgs+0x11e/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.710369] [<ffffffff8174a9fd>] ? system_call_after_swapgs+0x117/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.710667] [<ffffffff8174a9f6>] ? system_call_after_swapgs+0x110/0x170
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.710959] [<ffffffff81014ea9>] do_notify_resume+0x69/0xb0
Aug 15 09:55:12 hc-mprm1-dev kernel: [ 1046.711250] [<ffffffff8174ad70>] int_signal+0x12/0x17

Question information

Language:
English Edit question
Status:
Solved
For:
Ubuntu Edit question
Assignee:
No assignee Edit question
Solved by:
Dirk Brammertz
Solved:
Last query:
Last reply:
Revision history for this message
Markus Moormann (mamo85) said : 		#1

I can reproduce this. Though I see no kernel errors my tomcat instance is so low, that even the smallest application leads to a boottime of more then 10 seconds. Switching back to 3.13.0-153 solves the issue

Revision history for this message
actionparsnip (andrew-woodhead666) said : 		#2

I suggest you report a bug

Revision history for this message
Dirk Brammertz (dbrammertz) said : 		#3

Tracked as bug

Revision history for this message
picotech (infrapicotech) said : 		#4

Can also reproduce this on several hosts when running 3.13.0-155-generic, roll back to 3.13.0-153-generic and is ok

java -version
java version "1.7.0_181"
OpenJDK Runtime Environment (IcedTea 2.6.14) (7u181-2.6.14-0ubuntu0.2)
OpenJDK 64-Bit Server VM (build 24.181-b01, mixed mode)

jjjjjjjjjjj
[42582.720700] java: Corrupted page table at address 7faeda88e000
[42582.721788] PGD 80000000f1e56067 PUD e7192067 PMD f364e067 PTE 80003ffffe17c225
[42582.722856] Bad pagetable: 000d [#4] SMP
[42582.723897] Modules linked in: hid_generic joydev crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd
hid_hyperv hv_balloon hid hyperv_fb i2c_piix4 hyperv_keyboard serio_raw mac_hid lp parport hv_netvsc hv_utils hv_storvsc psmouse floppy hv_vmbus pata_acpi
[42582.724678] CPU: 3 PID: 28646 Comm: java Tainted: G B D 3.13.0-155-generic #205-Ubuntu
[42582.724678] Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090006 04/28/2016
[42582.724678] task: ffff8800f1744800 ti: ffff8800e7140000 task.ti: ffff8800e7140000
[42582.724678] RIP: 0033:[<00007faed03f4cf4>] [<00007faed03f4cf4>] 0x7faed03f4cf4
[42582.724678] RSP: 002b:00007faeda880dd8 EFLAGS: 00010202
[42582.724678] RAX: 00000000000006b9 RBX: 00007faeda880dc0 RCX: 00007faed41403a0
[42582.724678] RDX: 00007faed9a3b1e0 RSI: 00007faeda880d30 RDI: 00007faed400a000
[42582.724678] RBP: 00007faeda880e48 R08: 0000000000000000 R09: 00007faed9a152a0
[42582.724678] R10: 0000000000000001 R11: 0000000780aca0c0 R12: 0000000000000000
[42582.724678] R13: 00000000000006b9 R14: 000000066087ec08 R15: 00007faed400a000
[42582.724678] FS: 00007faeda882700(0000) GS:ffff880102e60000(0000) knlGS:0000000000000000
[42582.724678] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[42582.724678] CR2: 00007faeda88e000 CR3: 00000000e723a000 CR4: 0000000000020670
[42582.724678]
[42582.724678] RIP [<00007faed03f4cf4>] 0x7faed03f4cf4
[42582.724678] RSP <00007faeda880dd8>
[42582.724678] ---[ end trace fc47787e116a3916 ]---
[42582.755424] BUG: Bad page map in process java pte:80003ffffe17c225 pmd:f364e067
[42582.756846] addr:00007faeda88e000 vm_flags:08000071 anon_vma: (null) mapping: (null) index:7faeda88e
[42582.758268] CPU: 2 PID: 28667 Comm: java Tainted: G B D 3.13.0-155-generic #205-Ubuntu
[42582.759705] Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090006 04/28/2016
[42582.760830] 0000000000000000 ffff8800dc57ba98 ffffffff8173983f 00007faeda88e000
[42582.760830] ffff8800f1ef09c0 ffff8800dc57bae8 ffffffff8117e374 80003ffffe17c225
[42582.760830] 00000000f364e067 00000007faeda88e ffff8800f364e470 ffff8800dc57bc58
[42582.760830] Call Trace:
[42582.760830] [<ffffffff8173983f>] dump_stack+0x64/0x80
[42582.760830] [<ffffffff8117e374>] print_bad_pte+0x1a4/0x250
[42582.760830] [<ffffffff8117f6ae>] vm_normal_page+0x6e/0x80
[42582.760830] [<ffffffff8117faa6>] unmap_page_range+0x3e6/0x830
[42582.760830] [<ffffffff8117ff71>] unmap_single_vma+0x81/0xf0
[42582.760830] [<ffffffff81181019>] unmap_vmas+0x49/0x90
[42582.760830] [<ffffffff8118a05c>] exit_mmap+0x9c/0x170
[42582.760830] [<ffffffff81118ee3>] ? __delayacct_add_tsk+0x153/0x170
[42582.760830] [<ffffffff8106a43c>] mmput+0x5c/0x120
[42582.760830] [<ffffffff8106fda4>] do_exit+0x264/0xa60
[42582.760830] [<ffffffff8109553a>] ? hrtimer_cancel+0x1a/0x30
[42582.760830] [<ffffffff810e0bb2>] ? futex_wait+0x1b2/0x290
[42582.760830] [<ffffffff8107061f>] do_group_exit+0x3f/0xb0
[42582.760830] [<ffffffff81080ba0>] get_signal_to_deliver+0x1d0/0x700
[42582.760830] [<ffffffff81014458>] do_signal+0x48/0xa30
[42582.760830] [<ffffffff8174aa35>] ? system_call_after_swapgs+0x14f/0x170
[42582.760830] [<ffffffff8174aa2e>] ? system_call_after_swapgs+0x148/0x170
[42582.760830] [<ffffffff8174aa27>] ? system_call_after_swapgs+0x141/0x170
[42582.760830] [<ffffffff8174aa20>] ? system_call_after_swapgs+0x13a/0x170
[42582.760830] [<ffffffff8174aa19>] ? system_call_after_swapgs+0x133/0x170
[42582.760830] [<ffffffff8174aa12>] ? system_call_after_swapgs+0x12c/0x170
[42582.760830] [<ffffffff8174aa0b>] ? system_call_after_swapgs+0x125/0x170
[42582.760830] [<ffffffff8174aa04>] ? system_call_after_swapgs+0x11e/0x170
[42582.760830] [<ffffffff8174a9fd>] ? system_call_after_swapgs+0x117/0x170
[42582.760830] [<ffffffff8174a9f6>] ? system_call_after_swapgs+0x110/0x170
[42582.760830] [<ffffffff81014ea9>] do_notify_resume+0x69/0xb0
[42582.760830] [<ffffffff8174ad70>] int_signal+0x12/0x17

Revision history for this message
Sledge Sulaweyo (sledge-sulaweyo) said : 		#5

I can confirm this in my CI environement. 19 hosts "offline" so far