Attachment 909211 Details for Bug 1109967 – Full trace after reproducing inside a VM under virt-manager/kvm

Full trace after reproducing inside a VM under virt-manager/kvm

crash_rt.txt (text/plain), 40.56 KB, created by Herton R. Krzesinski on 2014-06-16 19:08:46 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Herton R. Krzesinski

Created: 2014-06-16 19:08:46 UTC

Size: 40.56 KB

patch

obsolete

>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#1] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 9 PID: 70 Comm: ksoftirqd/8 Not tainted 3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077af4800 ti: ffff880077afa000 task.ti: ffff880077afa000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077afbe48  EFLAGS: 00010297
>RAX: 0000000000000009 RBX: ffff880077a9e030 RCX: 0000000000000000
>RDX: ffff880077af4800 RSI: ffff880077af4800 RDI: 0000000000000008
>RBP: ffff880077afbeb8 R08: ffff880077afa000 R09: 0000000000000001
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff880077afa000
>R13: ffffffff81a35d20 R14: ffff880077afa010 R15: ffff880077afa010
>FS:  0000000000000000(0000) GS:ffff880079e40000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f5e03c29000 CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077af4800 ffff880077afa000 ffff880077afa010 ffff880077afa000
> ffff880077afa000 ffff880077af4800 ffff880077af4800 0000000000000000
> ffff880077afbeb8 ffff88003a6c3d08 ffff880077afbec8 ffff880077a9e030
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077afbe48>
>---[ end trace 0000000000000002 ]---
>note: ksoftirqd/8[70] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#2] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 9 PID: 68 Comm: rcuc/8 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077af1800 ti: ffff880077ab6000 task.ti: ffff880077ab6000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077ab7e48  EFLAGS: 00010297
>RAX: 0000000000000009 RBX: ffff880077a9e010 RCX: 0000000000000000
>RDX: ffff880077af1800 RSI: ffff880077af1800 RDI: 0000000000000008
>RBP: ffff880077ab7eb8 R08: ffff880077ab6000 R09: 0000000000000000
>R10: 000000000000059b R11: 0000000000000000 R12: ffff880077ab6000
>R13: ffffffff81a51a00 R14: ffff880077ab6010 R15: ffff880077ab6010
>FS:  0000000000000000(0000) GS:ffff880079e40000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007fa22c9e5790 CR3: 000000003a227000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077af1800 ffff880077ab6000 ffff880077ab6010 ffff880077ab6000
> ffff880077ab6000 ffff880077af1800 ffff880077af1800 0000000000000000
> ffff880077ab7eb8 ffff88003a6c3d08 ffff880077ab7ec8 ffff880077a9e010
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077ab7e48>
>---[ end trace 0000000000000003 ]---
>note: rcuc/8[68] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#3] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 11 PID: 85 Comm: ksoftirqd/10 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077b44800 ti: ffff880077b4c000 task.ti: ffff880077b4c000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077b4de48  EFLAGS: 00010297
>RAX: 000000000000000b RBX: ffff880077a9e0b0 RCX: 0000000000000000
>RDX: ffff880077b44800 RSI: ffff880077b44800 RDI: 000000000000000a
>RBP: ffff880077b4deb8 R08: ffff880077b4c000 R09: 0000000000000001
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff880077b4c000
>R13: ffffffff81a35d20 R14: ffff880077b4c010 R15: ffff880077b4c010
>FS:  0000000000000000(0000) GS:ffff880079ec0000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f4d1216c950 CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077b44800 ffff880077b4c000 ffff880077b4c010 ffff880077b4c000
> ffff880077b4c000 ffff880077b44800 ffff880077b44800 0000000000000000
> ffff880077b4deb8 ffff88003a6c3d08 ffff880077b4dec8 ffff880077a9e0b0
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077b4de48>
>---[ end trace 0000000000000004 ]---
>note: ksoftirqd/10[85] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#4] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 8 PID: 78 Comm: ksoftirqd/9 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077b29800 ti: ffff880077b24000 task.ti: ffff880077b24000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077b25e48  EFLAGS: 00010202
>RAX: 0000000000000008 RBX: ffff880077a9e070 RCX: 0000000000000000
>RDX: ffff880077b29800 RSI: ffff880077b29800 RDI: 0000000000000009
>RBP: ffff880077b25eb8 R08: ffff880077b24000 R09: 0000000000000000
>R10: 0140000000000000 R11: 0000000000000000 R12: ffff880077b24000
>R13: ffffffff81a35d20 R14: ffff880077b24010 R15: ffff880077b24010
>FS:  0000000000000000(0000) GS:ffff880079e00000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007fb5902d1000 CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077b29800 ffff880077b24000 ffff880077b24010 ffff880077b24000
> ffff880077b24000 ffff880077b29800 ffff880077b29800 0000000000000000
> ffff880077b25eb8 ffff88003a6c3d08 ffff880077b25ec8 ffff880077a9e070
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077b25e48>
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#5] PREEMPT SMP 
>---[ end trace 0000000000000005 ]---
>note: ksoftirqd/9[78] exited with preempt_count 1
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 10 PID: 92 Comm: ksoftirqd/11 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077b70000 ti: ffff880077b6c000 task.ti: ffff880077b6c000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077b6de48  EFLAGS: 00010202
>RAX: 000000000000000a RBX: ffff880077a9e0f0 RCX: 0000000000000000
>RDX: ffff880077b70000 RSI: ffff880077b70000 RDI: 000000000000000b
>RBP: ffff880077b6deb8 R08: ffff880077b6c000 R09: 0000000000000000
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff880077b6c000
>R13: ffffffff81a35d20 R14: ffff880077b6c010 R15: ffff880077b6c010
>FS:  0000000000000000(0000) GS:ffff880079e80000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f4d1265001a CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077b70000 ffff880077b6c000 ffff880077b6c010 ffff880077b6c000
> ffff880077b6c000 ffff880077b70000 ffff880077b70000 0000000000000000
> ffff880077b6deb8 ffff88003a6c3d08 ffff880077b6dec8 ffff880077a9e0f0
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077b6de48>
>---[ end trace 0000000000000006 ]---
>note: ksoftirqd/11[92] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#6] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 6 PID: 106 Comm: ksoftirqd/13 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077bc6000 ti: ffff880077bda000 task.ti: ffff880077bda000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077bdbe48  EFLAGS: 00010202
>RAX: 0000000000000006 RBX: ffff880077a9e170 RCX: 0000000000000000
>RDX: ffff880077bc6000 RSI: ffff880077bc6000 RDI: 000000000000000d
>RBP: ffff880077bdbeb8 R08: ffff880077bda000 R09: 00000000000e7ef0
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff880077bda000
>R13: ffffffff81a35d20 R14: ffff880077bda010 R15: ffff880077bda010
>FS:  0000000000000000(0000) GS:ffff88003bf80000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00000000006dea7c CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077bc6000 ffff880077bda000 ffff880077bda010 ffff880077bda000
> ffff880077bda000 ffff880077bc6000 ffff880077bc6000 0000000000000000
> ffff880077bdbeb8 ffff88003a6c3d08 ffff880077bdbec8 ffff880077a9e170
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077bdbe48>
>---[ end trace 0000000000000007 ]---
>note: ksoftirqd/13[106] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#7] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 15 PID: 113 Comm: ksoftirqd/14 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077000000 ti: ffff880077bfa000 task.ti: ffff880077bfa000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077bfbe48  EFLAGS: 00010297
>RAX: 000000000000000f RBX: ffff880077a9e1b0 RCX: 0000000000000000
>RDX: ffff880077000000 RSI: ffff880077000000 RDI: 000000000000000e
>RBP: ffff880077bfbeb8 R08: ffff880077bfa000 R09: 0000000000000000
>R10: 0140000000000000 R11: 0000000000000000 R12: ffff880077bfa000
>R13: ffffffff81a35d20 R14: ffff880077bfa010 R15: ffff880077bfa010
>FS:  0000000000000000(0000) GS:ffff880079fc0000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f4d1265001a CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077000000 ffff880077bfa000 ffff880077bfa010 ffff880077bfa000
> ffff880077bfa000 ffff880077000000 ffff880077000000 0000000000000000
> ffff880077bfbeb8 ffff88003a6c3d08 ffff880077bfbec8 ffff880077a9e1b0
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077bfbe48>
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#8] PREEMPT SMP 
>---[ end trace 0000000000000008 ]---
>note: ksoftirqd/14[113] exited with preempt_count 1
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 13 PID: 99 Comm: ksoftirqd/12 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077bab000 ti: ffff880077bb2000 task.ti: ffff880077bb2000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077bb3e48  EFLAGS: 00010297
>RAX: 000000000000000d RBX: ffff880077a9e130 RCX: ffff880077bc3018
>RDX: ffff880077bab000 RSI: 0000000000000282 RDI: 000000000000000c
>RBP: ffff880077bb3eb8 R08: ffffffff81605e20 R09: 0000000000000100
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff880077bb2000
>R13: ffffffff81a35d20 R14: ffff880077bb2010 R15: ffff880077bb2010
>FS:  0000000000000000(0000) GS:ffff880079f40000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007fd01091d000 CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077bab000 ffff880077bb2000 ffff880077bb2010 ffff880077bb2000
> ffff880077bb2000 ffff880077bab000 ffff880077bab000 0000000000000000
> ffff880077bb3eb8 ffff88003a6c3d08 ffff880077bb3ec8 ffff880077a9e130
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077bb3e48>
>---[ end trace 0000000000000009 ]---
>note: ksoftirqd/12[99] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#9] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 12 PID: 104 Comm: rcuc/13 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077bc3000 ti: ffff880077bce000 task.ti: ffff880077bce000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077bcfe48  EFLAGS: 00010202
>RAX: 000000000000000c RBX: ffff880077a9e150 RCX: ffff880077ba8018
>RDX: ffff880077bc3000 RSI: 0000000000000282 RDI: 000000000000000d
>RBP: ffff880077bcfeb8 R08: ffffffff81605da0 R09: 0000000000000100
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff880077bce000
>R13: ffffffff81a51a00 R14: ffff880077bce010 R15: ffff880077bce010
>FS:  0000000000000000(0000) GS:ffff880079f00000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f4d1265001a CR3: 0000000074abd000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077bc3000 ffff880077bce000 ffff880077bce010 ffff880077bce000
> ffff880077bce000 ffff880077bc3000 ffff880077bc3000 0000000000000000
> ffff880077bcfeb8 ffff88003a6c3d08 ffff880077bcfec8 ffff880077a9e150
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077bcfe48>
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#10] PREEMPT SMP 
>---[ end trace 000000000000000a ]---
>note: rcuc/13[104] exited with preempt_count 1
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 8 PID: 97 Comm: rcuc/12 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077ba8000 ti: ffff880077b9e000 task.ti: ffff880077b9e000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077b9fe48  EFLAGS: 00010202
>RAX: 0000000000000008 RBX: ffff880077a9e110 RCX: 0000000000000000
>RDX: ffff880077ba8000 RSI: ffff880077ba8000 RDI: 000000000000000c
>RBP: ffff880077b9feb8 R08: ffff880077b9e000 R09: 0000000000000000
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff880077b9e000
>R13: ffffffff81a51a00 R14: ffff880077b9e010 R15: ffff880077b9e010
>FS:  0000000000000000(0000) GS:ffff880079e00000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007fb5902d1000 CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077ba8000 ffff880077b9e000 ffff880077b9e010 ffff880077b9e000
> ffff880077b9e000 ffff880077ba8000 ffff880077ba8000 0000000000000000
> ffff880077b9feb8 ffff88003a6c3d08 ffff880077b9fec8 ffff880077a9e110
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077b9fe48>
>---[ end trace 000000000000000b ]---
>note: rcuc/12[97] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#11] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 11 PID: 83 Comm: rcuc/10 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077b41800 ti: ffff880077b48000 task.ti: ffff880077b48000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077b49e48  EFLAGS: 00010297
>RAX: 000000000000000b RBX: ffff880077a9e090 RCX: 0000000000000000
>RDX: ffff880077b41800 RSI: ffff880077b41800 RDI: 000000000000000a
>RBP: ffff880077b49eb8 R08: ffff880077b48000 R09: 0000000000000001
>R10: 0140000000000000 R11: 0000000000000000 R12: ffff880077b48000
>R13: ffffffff81a51a00 R14: ffff880077b48010 R15: ffff880077b48010
>FS:  0000000000000000(0000) GS:ffff880079ec0000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f4d1216c950 CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077b41800 ffff880077b48000 ffff880077b48010 ffff880077b48000
> ffff880077b48000 ffff880077b41800 ffff880077b41800 0000000000000000
> ffff880077b49eb8 ffff88003a6c3d08 ffff880077b49ec8 ffff880077a9e090
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077b49e48>
>---[ end trace 000000000000000c ]---
>note: rcuc/10[83] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#12] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 10 PID: 90 Comm: rcuc/11 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077b54800 ti: ffff880077b68000 task.ti: ffff880077b68000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077b69e48  EFLAGS: 00010202
>RAX: 000000000000000a RBX: ffff880077a9e0d0 RCX: 0000000000000000
>RDX: ffff880077b54800 RSI: ffff880077b54800 RDI: 000000000000000b
>RBP: ffff880077b69eb8 R08: ffff880077b68000 R09: 0000000000000001
>R10: 0140000000000000 R11: 0000000000000000 R12: ffff880077b68000
>R13: ffffffff81a51a00 R14: ffff880077b68010 R15: ffff880077b68010
>FS:  0000000000000000(0000) GS:ffff880079e80000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f7c2619f2c0 CR3: 00000000388ee000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077b54800 ffff880077b68000 ffff880077b68010 ffff880077b68000
> ffff880077b68000 ffff880077b54800 ffff880077b54800 0000000000000000
> ffff880077b69eb8 ffff88003a6c3d08 ffff880077b69ec8 ffff880077a9e0d0
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077b69e48>
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#13] PREEMPT SMP 
>---[ end trace 000000000000000d ]---
>note: rcuc/11[90] exited with preempt_count 1
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 14 PID: 120 Comm: ksoftirqd/15 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff88007701b000 ti: ffff880077022000 task.ti: ffff880077022000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077023e48  EFLAGS: 00010202
>RAX: 000000000000000e RBX: ffff880077a9e1f0 RCX: 0000000000000000
>RDX: ffff88007701b000 RSI: ffff88007701b000 RDI: 000000000000000f
>RBP: ffff880077023eb8 R08: ffff880077022000 R09: 0000000000000000
>R10: 0140000000000000 R11: 0000000000000000 R12: ffff880077022000
>R13: ffffffff81a35d20 R14: ffff880077022010 R15: ffff880077022010
>FS:  0000000000000000(0000) GS:ffff880079f80000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007fd0d5cf8000 CR3: 000000003a227000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff88007701b000 ffff880077022000 ffff880077022010 ffff880077022000
> ffff880077022000 ffff88007701b000 ffff88007701b000 0000000000000000
> ffff880077023eb8 ffff88003a6c3d08 ffff880077023ec8 ffff880077a9e1f0
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077023e48>
>---[ end trace 000000000000000e ]---
>note: ksoftirqd/15[120] exited with preempt_count 1
>------------[ cut here ]------------
>WARNING: at kernel/workqueue.c:2132 process_one_work+0x26d/0x5a0()
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 12 PID: 449 Comm: kworker/0:1 Tainted: G      D      3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
> ffffffff817d07a5 ffff88003a38fda8 ffffffff815727ce ffff88003a38fde8
> ffffffff8104d3e0 ffff88003a38e000 ffff88003a210540 ffff88003be13a40
> ffff88003be17a00 0000000000000000 ffff88003a210570 ffff88003a38fdf8
>Call Trace:
> [<ffffffff815727ce>] dump_stack+0x19/0x1b
> [<ffffffff8104d3e0>] warn_slowpath_common+0x70/0xa0
> [<ffffffff8104d42a>] warn_slowpath_null+0x1a/0x20
> [<ffffffff8106f7ed>] process_one_work+0x26d/0x5a0
> [<ffffffff81070b44>] worker_thread+0x124/0x3f0
> [<ffffffff81070a20>] ? manage_workers+0x2e0/0x2e0
> [<ffffffff81070a20>] ? manage_workers+0x2e0/0x2e0
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>---[ end trace 000000000000000f ]---
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#14] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 8 PID: 76 Comm: rcuc/9 Tainted: G      D W    3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077b06000 ti: ffff880077b20000 task.ti: ffff880077b20000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077b21e48  EFLAGS: 00010202
>RAX: 0000000000000008 RBX: ffff880077a9e050 RCX: 0000000000000000
>RDX: ffff880077b06000 RSI: ffff880077b06000 RDI: 0000000000000009
>RBP: ffff880077b21eb8 R08: ffff880077b20000 R09: 0000000000000000
>R10: 0140000000000000 R11: 0000000000000000 R12: ffff880077b20000
>R13: ffffffff81a51a00 R14: ffff880077b20010 R15: ffff880077b20010
>FS:  0000000000000000(0000) GS:ffff880079e00000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007fb5902d1000 CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077b06000 ffff880077b20000 ffff880077b20010 ffff880077b20000
> ffff880077b20000 ffff880077b06000 ffff880077b06000 0000000000000000
> ffff880077b21eb8 ffff88003a6c3d08 ffff880077b21ec8 ffff880077a9e050
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077b21e48>
>---[ end trace 0000000000000010 ]---
>note: rcuc/9[76] exited with preempt_count 1
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#15] PREEMPT SMP 
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 15 PID: 111 Comm: rcuc/14 Tainted: G      D W    3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077be4800 ti: ffff880077bee000 task.ti: ffff880077bee000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff880077befe48  EFLAGS: 00010297
>RAX: 000000000000000f RBX: ffff880077a9e190 RCX: ffff880077018018
>RDX: ffff880077be4800 RSI: 0000000000000282 RDI: 000000000000000e
>RBP: ffff880077befeb8 R08: ffffffff81605e60 R09: 0000000000000100
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff880077bee000
>R13: ffffffff81a51a00 R14: ffff880077bee010 R15: ffff880077bee010
>FS:  0000000000000000(0000) GS:ffff880079fc0000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f4d1265001a CR3: 0000000001a0f000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077be4800 ffff880077bee000 ffff880077bee010 ffff880077bee000
> ffff880077bee000 ffff880077be4800 ffff880077be4800 0000000000000000
> ffff880077befeb8 ffff88003a6c3d08 ffff880077befec8 ffff880077a9e190
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Code: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff880077befe48>
>------------[ cut here ]------------
>kernel BUG at kernel/smpboot.c:134!
>invalid opcode: 0000 [#16] PREEMPT SMP 
>---[ end trace 0000000000000011 ]---
>note: rcuc/14[111] exited with preempt_count 1
>Modules linked in: autofs4 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ip6table_filter ip6_tables ipv6 ppdev parport_pc parport joydev sg microcode snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore snd_page_alloc i2c_piix4 i2c_core pcspkr e1000 ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom sym53c8xx scsi_transport_spi pata_acpi ata_generic ata_piix floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mperf]
>CPU: 14 PID: 118 Comm: rcuc/15 Tainted: G      D W    3.10.33-rt32.34.el6rt.x86_64 #1
>Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
>task: ffff880077018000 ti: ffff88007700e000 task.ti: ffff88007700e000
>RIP: 0010:[<ffffffff8107ff06>]  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
>RSP: 0018:ffff88007700fe48  EFLAGS: 00010202
>RAX: 000000000000000e RBX: ffff880077a9e1d0 RCX: 0000000000000000
>RDX: ffff880077018000 RSI: ffff880077018000 RDI: 000000000000000f
>RBP: ffff88007700feb8 R08: ffff88007700e000 R09: 0000000000000000
>R10: 0140000000000000 R11: 0000000000000000 R12: ffff88007700e000
>R13: ffffffff81a51a00 R14: ffff88007700e010 R15: ffff88007700e010
>FS:  0000000000000000(0000) GS:ffff880079f80000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007fd0d5cf8000 CR3: 000000003a227000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Stack:
> ffff880077018000 ffff88007700e000 ffff88007700e010 ffff88007700e000
> ffff88007700e000 ffff880077018000 ffff880077018000 0000000000000000
> ffff88007700feb8 ffff88003a6c3d08 ffff88007700fec8 ffff880077a9e1d0
>Call Trace:
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076cbe>] kthread+0xbe/0xd0
> [<ffffffff8107fc60>] ? smpboot_park_threads+0x90/0x90
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
> [<ffffffff8157e2ec>] ret_from_fork+0x7c/0xb0
> [<ffffffff81076c00>] ? kthreadd+0x1e0/0x1e0
>Cod: 65 58 00 0f a3 3a 19 d2 31 f6 85 d2 40 0f 95 c6 ff d0 48 89 df e8 5b 0e 0f 00 48 83 c4 48 31 c0 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <0f> 0b eb fe e8 61 3f 4f 00 90 e9 33 ff ff ff e8 56 3f 4f 00 66 
>RIP  [<ffffffff8107ff06>] smpboot_thread_fn+0x2a6/0x310
> RSP <ffff88007700fe48>
>---[ end trace 0000000000000012 ]---
>note: rcuc/15[118] exited with preempt_count 1

Actions: View

Attachments on bug 1109967: 909211 | 910105 | 911799