8.04 LTS crashes, kernel oops, NULL pointer dereference

Asked by smagister on 2009-11-05

Hi,

I'm running 8.04 LTS server, kernel 2.6.24-16-server, on a Dell tower with 3G of RAM. I'm using it as a backup server and it has a 3 disk software RAID array (mdadm). The OS is on a separate 4th disk.

While running a python script which calls rsync (the python script runs from the crontab), after a while the system crashes via "kernel oops". I've copied and pasted the /var/log/kern.log and /var/log/messages below.

I ran memtest for 24 hours and it showed no errors. I also ran smartctl on all disks and they all report "PASSED".

Any help would be greatly appreciated here.

OUTPUT OF /var/log/kern.log:
Nov 4 11:27:50 octo4 kernel: [72210.491421] Unable to handle kernel NULL pointer dereference at 0000000000000070 RIP:
Nov 4 11:27:50 octo4 kernel: [72210.491432] [<ffffffff80470a60>] _spin_lock+0x0/0x10
Nov 4 11:27:50 octo4 kernel: [72210.491482] PGD 0
Nov 4 11:27:50 octo4 kernel: [72210.491499] Oops: 0002 [1] SMP
Nov 4 11:27:50 octo4 kernel: [72210.491518] CPU 1
Nov 4 11:27:50 octo4 kernel: [72210.491534] Modules linked in: nfs lockd nfs_acl sunrpc autofs4 iptable_filter ip_tables x_tables ipv6 parport_pc lp parport loop af_packet serio_raw bu
tton psmouse snd_hda_intel snd_pcm snd_timer snd_page_alloc snd_hwdep snd dcdbas evdev soundcore intel_agp shpchp pci_hotplug iTCO_wdt iTCO_vendor_support pcspkr ext3 jbd mbcache sg sr_
mod cdrom sd_mod ata_generic 8139too pata_acpi 8139cp mii ata_piix libata scsi_mod ehci_hcd uhci_hcd e1000 usbcore raid10 raid456 async_xor async_memcpy async_tx xor raid1 raid0 multipa
th linear md_mod thermal processor fan fbcon tileblit font bitblit softcursor fuse
Nov 4 11:27:50 octo4 kernel: [72210.491813] Pid: 171, comm: kswapd0 Not tainted 2.6.24-16-server #1
Nov 4 11:27:50 octo4 kernel: [72210.491833] RIP: 0010:[<ffffffff80470a60>] [<ffffffff80470a60>] _spin_lock+0x0/0x10
Nov 4 11:27:50 octo4 kernel: [72210.491865] RSP: 0018:ffff8100b95f5d48 EFLAGS: 00010202
Nov 4 11:27:50 octo4 kernel: [72210.491884] RAX: 0000000000000001 RBX: ffff8100167d23c8 RCX: 0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.491905] RDX: 0000000000000001 RSI: 00000000000000d0 RDI: 0000000000000070
Nov 4 11:27:50 octo4 kernel: [72210.491926] RBP: ffff8100167d2550 R08: 0000000000000000 R09: 0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.491947] R10: ffff81000102cc60 R11: ffffffff802caa70 R12: 000000000000004e
Nov 4 11:27:50 octo4 kernel: [72210.491967] R13: ffff8100167d24d8 R14: 0000000000000000 R15: 0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.491989] FS: 0000000000000000(0000) GS:ffff8100bd001700(0000) knlGS:0000000000000000Nov 4 11:27:50 octo4 kernel: [72210.492020] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Nov 4 11:27:50 octo4 kernel: [72210.492039] CR2: 0000000000000070 CR3: 00000000b29e2000 CR4: 00000000000006e0
Nov 4 11:27:50 octo4 kernel: [72210.492060] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.492081] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Nov 4 11:27:50 octo4 kernel: [72210.492103] Process kswapd0 (pid: 171, threadinfo ffff8100b95f4000, task ffff8100b95ee7e0)
Nov 4 11:27:50 octo4 kernel: [72210.492135] Stack: ffffffff802dc5b2 ffff8100167d23c8 0000000000000080 000000000000004e
Nov 4 11:27:50 octo4 kernel: [72210.492178] ffff8100b95f5d80 000000000000004e ffffffff802cb244 ffff8100167d20d8
Nov 4 11:27:50 octo4 kernel: [72210.492216] ffff8100167249d8 000000000016d104 00000000000cca38 000000000000017b
Nov 4 11:27:50 octo4 kernel: [72210.492241] Call Trace:
Nov 4 11:27:50 octo4 kernel: [72210.492270] [remove_inode_buffers+0x42/0x100] remove_inode_buffers+0x42/0x100
Nov 4 11:27:50 octo4 kernel: [72210.492294] [shrink_icache_memory+0x1f4/0x2a0] shrink_icache_memory+0x1f4/0x2a0
Nov 4 11:27:50 octo4 kernel: [72210.492318] [shrink_slab+0x124/0x180] shrink_slab+0x124/0x180
Nov 4 11:27:50 octo4 kernel: [72210.492340] [kswapd+0x391/0x560] kswapd+0x391/0x560
Nov 4 11:27:50 octo4 kernel: [72210.492364] [<ffffffff80254200>] autoremove_wake_function+0x0/0x30
Nov 4 11:27:50 octo4 kernel: [72210.492388] [kswapd+0x0/0x560] kswapd+0x0/0x560
Nov 4 11:27:50 octo4 kernel: [72210.492407] [kthread+0x4b/0x80] kthread+0x4b/0x80
Nov 4 11:27:50 octo4 kernel: [72210.492428] [child_rip+0xa/0x12] child_rip+0xa/0x12
Nov 4 11:27:50 octo4 kernel: [72210.492453] [kthread+0x0/0x80] kthread+0x0/0x80
Nov 4 11:27:50 octo4 kernel: [72210.492472] [child_rip+0x0/0x12] child_rip+0x0/0x12
Nov 4 11:27:50 octo4 kernel: [72210.492491]
Nov 4 11:27:50 octo4 kernel: [72210.492504]
Nov 4 11:27:50 octo4 kernel: [72210.492505] Code: f0 ff 0f 79 09 f3 90 83 3f 00 7e f9 eb f2 c3 90 f0 81 2f 00
Nov 4 11:27:50 octo4 kernel: [72210.492591] RIP [<ffffffff80470a60>] _spin_lock+0x0/0x10
Nov 4 11:27:50 octo4 kernel: [72210.492612] RSP <ffff8100b95f5d48>
Nov 4 11:27:50 octo4 kernel: [72210.492630] CR2: 0000000000000070
Nov 4 11:27:50 octo4 kernel: [72210.492892] ---[ end trace 51aa3f03002ca8af ]---

OUTPUT OF /var/log/messages
Nov 4 11:27:50 octo4 kernel: [72210.491482] PGD 0
Nov 4 11:27:50 octo4 kernel: [72210.491518] CPU 1
Nov 4 11:27:50 octo4 kernel: [72210.491534] Modules linked in: nfs lockd nfs_acl sunrpc autofs4 iptable_filter ip_tables x_tables ipv6 parport_pc lp parport loop af_packet serio_raw button psmouse snd_hda_intel snd_pcm snd_timer snd_page_alloc snd_hwdep snd dcdbas evdev soundcore intel_agp shpchp pci_hotplug iTCO_wdt iTCO_vendor_support pcspkr ext3 jbd mbcache sg sr_mod cdrom sd_mod ata_generic 8139too pata_acpi 8139cp mii ata_piix libata scsi_mod ehci_hcd uhci_hcd e1000 usbcore raid10 raid456 async_xor async_memcpy async_tx xor raid1 raid0 multipath linear md_mod thermal processor fan fbcon tileblit font bitblit softcursor fuse
Nov 4 11:27:50 octo4 kernel: [72210.491813] Pid: 171, comm: kswapd0 Not tainted 2.6.24-16-server #1
Nov 4 11:27:50 octo4 kernel: [72210.491833] RIP: 0010:[<ffffffff80470a60>] [<ffffffff80470a60>] _spin_lock+0x0/0x10
Nov 4 11:27:50 octo4 kernel: [72210.491865] RSP: 0018:ffff8100b95f5d48 EFLAGS: 00010202
Nov 4 11:27:50 octo4 kernel: [72210.491884] RAX: 0000000000000001 RBX: ffff8100167d23c8 RCX: 0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.491905] RDX: 0000000000000001 RSI: 00000000000000d0 RDI: 0000000000000070
Nov 4 11:27:50 octo4 kernel: [72210.491926] RBP: ffff8100167d2550 R08: 0000000000000000 R09: 0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.491947] R10: ffff81000102cc60 R11: ffffffff802caa70 R12: 000000000000004e
Nov 4 11:27:50 octo4 kernel: [72210.491967] R13: ffff8100167d24d8 R14: 0000000000000000 R15: 0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.491989] FS: 0000000000000000(0000) GS:ffff8100bd001700(0000) knlGS:0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.492020] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Nov 4 11:27:50 octo4 kernel: [72210.492039] CR2: 0000000000000070 CR3: 00000000b29e2000 CR4: 00000000000006e0
Nov 4 11:27:50 octo4 kernel: [72210.492060] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Nov 4 11:27:50 octo4 kernel: [72210.492081] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Nov 4 11:27:50 octo4 kernel: [72210.492103] Process kswapd0 (pid: 171, threadinfo ffff8100b95f4000, task ffff8100b95ee7e0)
Nov 4 11:27:50 octo4 kernel: [72210.492135] Stack: ffffffff802dc5b2 ffff8100167d23c8 0000000000000080 000000000000004e
Nov 4 11:27:50 octo4 kernel: [72210.492178] ffff8100b95f5d80 000000000000004e ffffffff802cb244 ffff8100167d20d8
Nov 4 11:27:50 octo4 kernel: [72210.492216] ffff8100167249d8 000000000016d104 00000000000cca38 000000000000017b
Nov 4 11:27:50 octo4 kernel: [72210.492241] Call Trace:
Nov 4 11:27:50 octo4 kernel: [72210.492270] [remove_inode_buffers+0x42/0x100] remove_inode_buffers+0x42/0x100
Nov 4 11:27:50 octo4 kernel: [72210.492294] [shrink_icache_memory+0x1f4/0x2a0] shrink_icache_memory+0x1f4/0x2a0
Nov 4 11:27:50 octo4 kernel: [72210.492318] [shrink_slab+0x124/0x180] shrink_slab+0x124/0x180
Nov 4 11:27:50 octo4 kernel: [72210.492340] [kswapd+0x391/0x560] kswapd+0x391/0x560
Nov 4 11:27:50 octo4 kernel: [72210.492364] [<ffffffff80254200>] autoremove_wake_function+0x0/0x30
Nov 4 11:27:50 octo4 kernel: [72210.492388] [kswapd+0x0/0x560] kswapd+0x0/0x560
Nov 4 11:27:50 octo4 kernel: [72210.492407] [kthread+0x4b/0x80] kthread+0x4b/0x80
Nov 4 11:27:50 octo4 kernel: [72210.492428] [child_rip+0xa/0x12] child_rip+0xa/0x12
Nov 4 11:27:50 octo4 kernel: [72210.492453] [kthread+0x0/0x80] kthread+0x0/0x80
Nov 4 11:27:50 octo4 kernel: [72210.492472] [child_rip+0x0/0x12] child_rip+0x0/0x12
Nov 4 11:27:50 octo4 kernel: [72210.492491]
Nov 4 11:27:50 octo4 kernel: [72210.492504]
Nov 4 11:27:50 octo4 kernel: [72210.492505] Code: f0 ff 0f 79 09 f3 90 83 3f 00 7e f9 eb f2 c3 90 f0 81 2f 00
Nov 4 11:27:50 octo4 kernel: [72210.492612] RSP <ffff8100b95f5d48>
Nov 4 11:27:50 octo4 kernel: [72210.492892] ---[ end trace 51aa3f03002ca8af ]---

Question information

Language:
English Edit question
Status:
Answered
For:
Ubuntu Edit question
Assignee:
No assignee Edit question
Last query:
2009-11-05
Last reply:
2009-11-05
Colin Ian King (colin-king) said : #1

Best thing to do is to file a bug against the kernel for this to be looked into by the kernel developers.

Can you help with this problem?

Provide an answer of your own, or ask smagister for more information if necessary.

To post a message you must log in.