16.04LTS Causes Kernel Panic on AWS

While trying to use the cloud images from the AMI Locator (http://cloud-images.ubuntu.com/locator/ec2/) the AMIs listed seem to cause kernel panics when launching r3.x class instances. I've tried all the us-east-1 AMIs (ami-13be557e, ami-20a64d4d, ami-bcb853d1, ami-e8ae4585).

Any thoughts?

Result generally looks like this in the AWS Console System Log:

 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] smpboot: Allowing 15 CPUs, 13 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfbffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xffffffff]
[ 0.000000] e820: [mem 0xf0000000-0xfbffffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on Xen HVM
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:15 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 33 pages/cpu @ffff8803e0200000 s98008 r8192 d28968 u262144
[ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 3937380
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-22-generic root=LABEL=cloudimg-rootfs console=ttyS0
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Memory: 15653508K/15999604K available (8359K kernel code, 1278K rwdata, 3920K rodata, 1480K init, 1292K bss, 346096K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=15.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=15
[ 0.000000] NR_IRQS:16640 nr_irqs:952 16
[ 0.000000] xen:events: Using 2-level ABI
[ 0.000000] xen:events: Xen HVM callback vector for event delivery is enabled
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[ 0.000000] console [ttyS0] enabled
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns
[ 0.000000] tsc: Detected 2494.068 MHz processor
[ 0.008000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4988.13 BogoMIPS (lpj=9976272)
[ 0.008000] pid_max: default: 32768 minimum: 301
[ 0.008016] ACPI: Core revision 20150930
[ 0.017497] ACPI: 3 ACPI AML tables successfully acquired and loaded
[ 0.020183] Security Framework initialized
[ 0.022064] Yama: becoming mindful.
[ 0.024025] AppArmor: AppArmor initialized
[ 0.026739] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[ 0.033804] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.037502] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.040016] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.044240] Initializing cgroup subsys io
[ 0.046174] Initializing cgroup subsys memory
[ 0.048009] Initializing cgroup subsys devices
[ 0.050034] Initializing cgroup subsys freezer
[ 0.052003] Initializing cgroup subsys net_cls
[ 0.054108] Initializing cgroup subsys perf_event
[ 0.056003] Initializing cgroup subsys net_prio
[ 0.060003] Initializing cgroup subsys hugetlb
[ 0.062352] Initializing cgroup subsys pids
[ 0.064063] CPU: Physical Processor ID: 0
[ 0.066703] mce: CPU supports 2 MCE banks
[ 0.068024] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[ 0.072002] Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
[ 0.076162] Freeing SMP alternatives memory: 28K (ffffffff820b3000 - ffffffff820ba000)
[ 0.085116] ftrace: allocating 31906 entries in 125 pages
[ 0.116078] divide error: 0000 [#1] SMP
[ 0.118132] Modules linked in:
[ 0.119614] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.4.0-22-generic #40-Ubuntu
[ 0.120000] Hardware name: Xen HVM domU, BIOS 4.2.amazon 12/07/2015
[ 0.120000] task: ffff8803cea78000 ti: ffff8803cea74000 task.ti: ffff8803cea74000
[ 0.120000] RIP: 0010:[<ffffffff81f6f627>] [<ffffffff81f6f627>] smp_store_boot_cpu_info+0x51/0x17f
[ 0.120000] RSP: 0000:ffff8803cea77ea8 EFLAGS: 00010286
[ 0.120000] RAX: 000000000000000e RBX: ffffffff81f35160 RCX: 0000000000000000
[ 0.120000] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8803e020a180
[ 0.120000] RBP: ffff8803cea77ec8 R08: 0000000000000000 R09: 0000000000007fff
[ 0.120000] R10: ffffffff81a11e60 R11: ffffffff81a11e40 R12: 00000000ffffffff
[ 0.120000] R13: 000000000000a0a0 R14: 000000000000a192 R15: 0000000000000000
[ 0.120000] FS: 0000000000000000(0000) GS:ffff8803e0200000(0000) knlGS:0000000000000000
[ 0.120000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 0.120000] CR2: ffff8803e07ff000 CR3: 0000000001e0a000 CR4: 00000000001406f0
[ 0.120000] Stack:
[ 0.120000] ffffffff81f35160 0000000000000100 000000000000a0a0 0000000000000000
[ 0.120000] ffff8803cea77ef8 ffffffff81f6f7ac ffffffff8208aff8 ffff8803cea786a8
[ 0.120000] 0000000000000001 0000000000000000 ffff8803cea77f08 ffffffff81f64e41
[ 0.120000] Call Trace:
[ 0.120000] [<ffffffff81f6f7ac>] native_smp_prepare_cpus+0x57/0x2eb
[ 0.120000] [<ffffffff81f64e41>] xen_hvm_smp_prepare_cpus+0x9/0x2e
[ 0.120000] [<ffffffff81f5a0e5>] kernel_init_freeable+0xb3/0x212
[ 0.120000] [<ffffffff81818d40>] ? rest_init+0x80/0x80
[ 0.120000] [<ffffffff81818d4e>] kernel_init+0xe/0xe0
[ 0.120000] [<ffffffff8182568f>] ret_from_fork+0x3f/0x70
[ 0.120000] [<ffffffff81818d40>] ? rest_init+0x80/0x80
[ 0.120000] Code: 53 41 83 cc ff 49 c7 c6 92 a1 00 00 48 89 c7 f3 a5 66 c7 80 da 00 00 00 00 00 0f b7 35 6b 38 fc ff 8b 05 0d 98 27 00 8d 44 06 ff <f7> f6 31 d2 89 05 2f 4c fc ff 8d 86 ff 7f 00 00 f7 f6 be c0 00
[ 0.120000] RIP [<ffffffff81f6f627>] smp_store_boot_cpu_info+0x51/0x17f
[ 0.120000] RSP <ffff8803cea77ea8>
[ 0.216006] ---[ end trace e76f95806b8c0797 ]---
[ 0.218142] Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b
[ 0.218142]
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 4.4.0-22-generic (buildd@lgw01-41) (gcc version 5.3.1 20160413 (Ubuntu 5.3.1-14ubuntu2) ) #40-Ubuntu SMP Thu May 12 22:03:46 UTC 2016 (Ubuntu 4.4.0-22.40-generic 4.4.8)
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-22-generic root=LABEL=cloudimg-rootfs console=ttyS0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x02: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x04: 'AVX registers'
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] x86/fpu: Using 'eager' FPU context switches.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000efffffff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000003e08fffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.4 present.
[ 0.000000] Hypervisor detected: Xen
[ 0.000000] Xen version 4.2.
[ 0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[ 0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
[ 0.000000] You might have to change the root device
[ 0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
[ 0.000000] in your root= kernel command line option
[ 0.000000] e820: last_pfn = 0x3e0900 max_arch_pfn = 0x400000000
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
[ 0.000000] e820: last_pfn = 0xf0000 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000fbba0-0x000fbbaf] mapped at [ffff8800000fbba0]
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] RAMDISK: [mem 0x371b0000-0x378cffff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen )
[ 0.000000] ACPI: XSDT 0x00000000FC00F5A0 000054 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: FACP 0x00000000FC00F260 0000F4 (v04 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: DSDT 0x00000000FC0035E0 00BBF6 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] ACPI: FACS 0x00000000FC0035A0 000040
[ 0.000000] ACPI: FACS 0x00000000FC0035A0 000040
[ 0.000000] ACPI: APIC 0x00000000FC00F360 0000D8 (v02 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: HPET 0x00000000FC00F4B0 000038 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: WAET 0x00000000FC00F4F0 000028 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: SSDT 0x00000000FC00F520 000031 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] ACPI: SSDT 0x00000000FC00F560 000031 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x00000003e08fffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x3e08fb000-0x3e08fffff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x00000003e08fffff]
[ 0.000000] Device empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009dfff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x00000000efffffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x00000003e08fffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x00000003e08fffff]
[ 0.000000] ACPI: PM-Timer IO Port: 0xb008
[ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] smpboot: Allowing 15 CPUs, 13 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfbffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xffffffff]
[ 0.000000] e820: [mem 0xf0000000-0xfbffffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on Xen HVM
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:15 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 33 pages/cpu @ffff8803e0200000 s98008 r8192 d28968 u262144
[ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 3937380
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-22-generic root=LABEL=cloudimg-rootfs console=ttyS0
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Memory: 15653508K/15999604K available (8359K kernel code, 1278K rwdata, 3920K rodata, 1480K init, 1292K bss, 346096K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=15.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=15
[ 0.000000] NR_IRQS:16640 nr_irqs:952 16
[ 0.000000] xen:events: Using 2-level ABI
[ 0.000000] xen:events: Xen HVM callback vector for event delivery is enabled
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[ 0.000000] console [ttyS0] enabled
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns
[ 0.000000] tsc: Detected 2494.068 MHz processor
[ 0.008000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4988.13 BogoMIPS (lpj=9976272)
[ 0.009450] pid_max: default: 32768 minimum: 301
[ 0.012016] ACPI: Core revision 20150930
[ 0.020218] ACPI: 3 ACPI AML tables successfully acquired and loaded
[ 0.023797] Security Framework initialized
[ 0.024004] Yama: becoming mindful.
[ 0.025862] AppArmor: AppArmor initialized
[ 0.028857] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[ 0.038020] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.041507] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.044017] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.048239] Initializing cgroup subsys io
[ 0.052005] Initializing cgroup subsys memory
[ 0.054209] Initializing cgroup subsys devices
[ 0.056004] Initializing cgroup subsys freezer
[ 0.058125] Initializing cgroup subsys net_cls
[ 0.060003] Initializing cgroup subsys perf_event
[ 0.062240] Initializing cgroup subsys net_prio
[ 0.064003] Initializing cgroup subsys hugetlb
[ 0.066141] Initializing cgroup subsys pids
[ 0.068069] CPU: Physical Processor ID: 0
[ 0.072580] mce: CPU supports 2 MCE banks
[ 0.074616] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[ 0.076002] Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
[ 0.081207] Freeing SMP alternatives memory: 28K (ffffffff820b3000 - ffffffff820ba000)
[ 0.090124] ftrace: allocating 31906 entries in 125 pages
[ 0.124068] divide error: 0000 [#1] SMP
[ 0.126072] Modules linked in:
[ 0.127549] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.4.0-22-generic #40-Ubuntu
[ 0.128000] Hardware name: Xen HVM domU, BIOS 4.2.amazon 12/07/2015
[ 0.128000] task: ffff8803cea78000 ti: ffff8803cea74000 task.ti: ffff8803cea74000
[ 0.128000] RIP: 0010:[<ffffffff81f6f627>] [<ffffffff81f6f627>] smp_store_boot_cpu_info+0x51/0x17f
[ 0.128000] RSP: 0000:ffff8803cea77ea8 EFLAGS: 00010286
[ 0.128000] RAX: 000000000000000e RBX: ffffffff81f35160 RCX: 0000000000000000
[ 0.128000] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8803e020a180
[ 0.128000] RBP: ffff8803cea77ec8 R08: 0000000000000000 R09: 0000000000007fff
[ 0.128000] R10: ffffffff81a11e60 R11: ffffffff81a11e40 R12: 00000000ffffffff
[ 0.128000] R13: 000000000000a0a0 R14: 000000000000a192 R15: 0000000000000000
[ 0.128000] FS: 0000000000000000(0000) GS:ffff8803e0200000(0000) knlGS:0000000000000000
[ 0.128000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 0.128000] CR2: ffff8803e07ff000 CR3: 0000000001e0a000 CR4: 00000000001406f0
[ 0.128000] Stack:
[ 0.128000] ffffffff81f35160 0000000000000100 000000000000a0a0 0000000000000000
[ 0.128000] ffff8803cea77ef8 ffffffff81f6f7ac ffffffff8208aff8 ffff8803cea786a8
[ 0.128000] 0000000000000001 0000000000000000 ffff8803cea77f08 ffffffff81f64e41
[ 0.128000] Call Trace:
[ 0.128000] [<ffffffff81f6f7ac>] native_smp_prepare_cpus+0x57/0x2eb
[ 0.128000] [<ffffffff81f64e41>] xen_hvm_smp_prepare_cpus+0x9/0x2e
[ 0.128000] [<ffffffff81f5a0e5>] kernel_init_freeable+0xb3/0x212
[ 0.128000] [<ffffffff81818d40>] ? rest_init+0x80/0x80
[ 0.128000] [<ffffffff81818d4e>] kernel_init+0xe/0xe0
[ 0.128000] [<ffffffff8182568f>] ret_from_fork+0x3f/0x70
[ 0.128000] [<ffffffff81818d40>] ? rest_init+0x80/0x80
[ 0.128000] Code: 53 41 83 cc ff 49 c7 c6 92 a1 00 00 48 89 c7 f3 a5 66 c7 80 da 00 00 00 00 00 0f b7 35 6b 38 fc ff 8b 05 0d 98 27 00 8d 44 06 ff <f7> f6 31 d2 89 05 2f 4c fc ff 8d 86 ff 7f 00 00 f7 f6 be c0 00
[ 0.128000] RIP [<ffffffff81f6f627>] smp_store_boot_cpu_info+0x51/0x17f
[ 0.128000] RSP <ffff8803cea77ea8>
[ 0.220006] ---[ end trace 1c3c45e710ea50eb ]---
[ 0.222148] Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b
[ 0.222148]

***

[[NOTE: Log generally repeats as it seems to continue in a reboot cycle.]]