Attachment 689121 Details for Bug 885351 – Crash 'log' output

Crash 'log' output

log1.txt (text/plain), 247.96 KB, created by r3obh on 2013-01-28 16:55:43 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: r3obh

Created: 2013-01-28 16:55:43 UTC

Size: 247.96 KB

patch

obsolete

>
>crash 6.1.0-1.fc17
>Copyright (C) 2002-2012  Red Hat, Inc.
>Copyright (C) 2004, 2005, 2006, 2010  IBM Corporation
>Copyright (C) 1999-2006  Hewlett-Packard Co
>Copyright (C) 2005, 2006, 2011, 2012  Fujitsu Limited
>Copyright (C) 2006, 2007  VA Linux Systems Japan K.K.
>Copyright (C) 2005, 2011  NEC Corporation
>Copyright (C) 1999, 2002, 2007  Silicon Graphics, Inc.
>Copyright (C) 1999, 2000, 2001, 2002  Mission Critical Linux, Inc.
>This program is free software, covered by the GNU General Public License,
>and you are welcome to change it and/or distribute copies of it under
>certain conditions.  Enter "help copying" to see the conditions.
>This program has absolutely no warranty.  Enter "help warranty" for details.
> 
>NOTE: stdin: not a tty
>
>GNU gdb (GDB) 7.3.1
>Copyright (C) 2011 Free Software Foundation, Inc.
>License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
>This is free software: you are free to change and redistribute it.
>There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
>and "show warranty" for details.
>This GDB was configured as "x86_64-unknown-linux-gnu"...
>
>
please wait... (gathering kmem slab cache data)

please wait... (gathering module symbol data)

please wait... (gathering task table data)

please wait... (determining panic task)
                                        
      KERNEL: /usr/lib/debug/lib/modules/3.7.4-204.fc18.x86_64/vmlinux
>    DUMPFILE: /var/crash/127.0.0.1-2013.01.27-19:57:27/vmcore  [PARTIAL DUMP]
>        CPUS: 24
>        DATE: Sun Jan 27 14:56:43 2013
>      UPTIME: 04:52:02
>LOAD AVERAGE: 24.00, 24.04, 24.23
>       TASKS: 678
>    NODENAME: research0.localdomain
>     RELEASE: 3.7.4-204.fc18.x86_64
>     VERSION: #1 SMP Wed Jan 23 16:44:29 UTC 2013
>     MACHINE: x86_64  (2799 Mhz)
>      MEMORY: 60 GB
>       PANIC: "Kernel panic - not syncing: An NMI occurred, please see the Integrated Management Log for details.."
>         PID: 10014
>     COMMAND: "quad.29"
>        TASK: ffff880ee556ae40  [THREAD_INFO: ffff880ef34a8000]
>         CPU: 21
>       STATE: TASK_RUNNING (PANIC)
>
>[    1.461387] Initializing XFRM netlink socket
>[    1.461499] NET: Registered protocol family 10
>[    1.461670] mip6: Mobile IPv6
>[    1.461672] NET: Registered protocol family 17
>[    1.462488] PM: Hibernation image not present or could not be loaded.
>[    1.462491] Loading module verification certificates
>[    1.463328] MODSIGN: Loaded cert 'Fedora kernel signing key: a5c8adf0039400029ed2a19f36cec62183cc1480'
>[    1.463336] registered taskstats version 1
>[    1.466038]   Magic number: 13:755:235
>[    1.467063] rtc_cmos 00:0a: setting system clock to 2013-01-27 15:14:42 UTC (1359299682)
>[    1.496064] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
>[    1.859251] usb 6-1: new full-speed USB device number 2 using uhci_hcd
>[    1.994595] usb 6-1: New USB device found, idVendor=03f0, idProduct=7029
>[    1.994600] usb 6-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
>[    1.994603] usb 6-1: Product: Virtual Keyboard 
>[    1.994605] usb 6-1: Manufacturer: HP 
>[    2.001457] input: HP  Virtual Keyboard  as /devices/pci0000:00/0000:00:1c.4/0000:02:00.4/usb6/6-1/6-1:1.0/input/input2
>[    2.001731] hid-generic 0003:03F0:7029.0001: input,hidraw0: USB HID v1.01 Keyboard [HP  Virtual Keyboard ] on usb-0000:02:00.4-1/input0
>[    2.005349] input: HP  Virtual Keyboard  as /devices/pci0000:00/0000:00:1c.4/0000:02:00.4/usb6/6-1/6-1:1.1/input/input3
>[    2.005682] hid-generic 0003:03F0:7029.0002: input,hidraw1: USB HID v1.01 Mouse [HP  Virtual Keyboard ] on usb-0000:02:00.4-1/input1
>[    2.065624] ata2.00: SATA link down (SStatus 4 SControl 300)
>[    2.065642] ata2.01: SATA link down (SStatus 4 SControl 300)
>[    2.099644] tsc: Refined TSC clocksource calibration: 2799.204 MHz
>[    2.099650] Switching to clocksource tsc
>[    2.205510] ata1.00: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
>[    2.205525] ata1.01: SATA link down (SStatus 4 SControl 300)
>[    2.205536] ata1.01: link offline, clearing class 3 to NONE
>[    2.224573] ata1.00: ATAPI: TEAC    DV-W28S-VS, G.V0, max UDMA/100
>[    2.246506] ata1.00: configured for UDMA/100
>[    2.251363] scsi 0:0:0:0: CD-ROM            TEAC     DV-W28S-VS       G.V0 PQ: 0 ANSI: 5
>[    2.255446] sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
>[    2.255450] cdrom: Uniform CD-ROM driver Revision: 3.20
>[    2.255685] sr 0:0:0:0: Attached scsi CD-ROM sr0
>[    2.255906] sr 0:0:0:0: Attached scsi generic sg0 type 5
>[    2.260394] Freeing unused kernel memory: 1068k freed
>[    2.260615] Write protecting the kernel read-only data: 12288k
>[    2.272083] Freeing unused kernel memory: 1772k freed
>[    2.273801] input: PS/2 Logitech Mouse as /devices/platform/i8042/serio1/input/input4
>[    2.280280] Freeing unused kernel memory: 1404k freed
>[    2.314203] usb 4-1: new full-speed USB device number 2 using uhci_hcd
>[    2.367076] systemd[1]: systemd 197 running in system mode. (+PAM +LIBWRAP +AUDIT +SELINUX +IMA +SYSVINIT +LIBCRYPTSETUP +GCRYPT +ACL +XZ)
>[    2.367180] systemd[1]: Running in initial RAM disk.
>[    2.367271] systemd[1]: No hostname configured.
>[    2.367275] systemd[1]: Set hostname to <localhost>.
>[    2.367349] systemd[1]: Initializing machine ID from random generator.
>[    2.384691] systemd[1]: Starting Encrypted Volumes.
>[    2.384704] systemd[1]: Reached target Encrypted Volumes.
>[    2.384753] systemd[1]: Starting udev Kernel Socket.
>[    2.384778] systemd[1]: Listening on udev Kernel Socket.
>[    2.384818] systemd[1]: Starting udev Control Socket.
>[    2.384842] systemd[1]: Listening on udev Control Socket.
>[    2.384850] systemd[1]: Starting Journal Socket.
>[    2.384883] systemd[1]: Listening on Journal Socket.
>[    2.385040] systemd[1]: Started Load Kernel Modules.
>[    2.385048] systemd[1]: Starting Journal Service...
>[    2.400093] systemd[1]: Started Journal Service.
>[    2.400396] systemd[1]: Starting Sockets.
>[    2.400409] systemd[1]: Reached target Sockets.
>[    2.400419] systemd[1]: Starting dracut cmdline hook...
>[    2.416046] systemd[1]: Starting Swap.
>[    2.416057] systemd[1]: Reached target Swap.
>[    2.416064] systemd[1]: Starting Local File Systems.
>[    2.416071] systemd[1]: Reached target Local File Systems.
>[    2.466515] usb 4-1: New USB device found, idVendor=045e, idProduct=0745
>[    2.466520] usb 4-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
>[    2.466523] usb 4-1: Product: Microsoft.. Nano Transceiver v2.0
>[    2.466526] usb 4-1: Manufacturer: Microsoft
>[    2.472751] input: Microsoft Microsoft.. Nano Transceiver v2.0 as /devices/pci0000:00/0000:00:1d.2/usb4/4-1/4-1:1.0/input/input5
>[    2.472984] hid-generic 0003:045E:0745.0003: input,hidraw2: USB HID v1.11 Keyboard [Microsoft Microsoft.. Nano Transceiver v2.0] on usb-0000:00:1d.2-1/input0
>[    2.479948] input: Microsoft Microsoft.. Nano Transceiver v2.0 as /devices/pci0000:00/0000:00:1d.2/usb4/4-1/4-1:1.1/input/input6
>[    2.480219] hid-generic 0003:045E:0745.0004: input,hidraw3: USB HID v1.11 Mouse [Microsoft Microsoft.. Nano Transceiver v2.0] on usb-0000:00:1d.2-1/input1
>[    2.504610] input: Microsoft Microsoft.. Nano Transceiver v2.0 as /devices/pci0000:00/0000:00:1d.2/usb4/4-1/4-1:1.2/input/input7
>[    2.504893] hid-generic 0003:045E:0745.0005: input,hiddev0,hidraw4: USB HID v1.11 Device [Microsoft Microsoft.. Nano Transceiver v2.0] on usb-0000:00:1d.2-1/input2
>[    2.720529] RPC: Registered named UNIX socket transport module.
>[    2.720531] RPC: Registered udp transport module.
>[    2.720532] RPC: Registered tcp transport module.
>[    2.720533] RPC: Registered tcp NFSv4.1 backchannel transport module.
>[    2.778601] systemd-udevd[311]: starting version 197
>[    2.951526] bnx2: Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.2.3 (June 27, 2012)
>[    2.951528] HP HPSA Driver (v 2.0.2-1)
>[    2.951613] hpsa 0000:05:00.0: MSIX
>[    2.951694] hpsa 0000:05:00.0: irq 68 for MSI/MSI-X
>[    2.951704] hpsa 0000:05:00.0: irq 69 for MSI/MSI-X
>[    2.951713] hpsa 0000:05:00.0: irq 70 for MSI/MSI-X
>[    2.951721] hpsa 0000:05:00.0: irq 71 for MSI/MSI-X
>[    2.951729] hpsa 0000:05:00.0: irq 72 for MSI/MSI-X
>[    2.951737] hpsa 0000:05:00.0: irq 73 for MSI/MSI-X
>[    2.951745] hpsa 0000:05:00.0: irq 74 for MSI/MSI-X
>[    2.951753] hpsa 0000:05:00.0: irq 75 for MSI/MSI-X
>[    2.952187] bnx2 0000:03:00.0 eth0: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f4000000, IRQ 16, node addr 1c:c1:de:22:d2:a2
>[    2.952777] bnx2 0000:03:00.1 eth1: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f2000000, IRQ 17, node addr 1c:c1:de:22:d2:a4
>[    2.953359] bnx2 0000:04:00.0 eth2: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f8000000, IRQ 18, node addr 1c:c1:de:22:d2:a6
>[    2.953962] bnx2 0000:04:00.1 eth3: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f6000000, IRQ 19, node addr 1c:c1:de:22:d2:a8
>[    2.956713] [drm] Initialized drm 1.1.0 20060810
>[    2.971720] hpsa 0000:05:00.0: hpsa0: <0x323a> at IRQ 68 using DAC
>[    2.982717] [drm] radeon defaulting to kernel modesetting.
>[    2.982719] [drm] radeon kernel modesetting enabled.
>[    2.982780] checking generic (e8000000 300000) vs hw (e8000000 8000000)
>[    2.982781] fb: conflicting fb hw usage radeondrmfb vs VESA VGA - removing generic driver
>[    2.982795] Console: switching to colour dummy device 80x25
>[    2.983278] [drm] initializing kernel modesetting (RV100 0x1002:0x515E 0x103C:0x31FB).
>[    2.983797] [drm] register mmio base: 0xF1CF0000
>[    2.983799] [drm] register mmio size: 65536
>[    2.983865] radeon 0000:01:03.0: VRAM: 128M 0x00000000E8000000 - 0x00000000EFFFFFFF (64M used)
>[    2.983867] radeon 0000:01:03.0: GTT: 512M 0x00000000C8000000 - 0x00000000E7FFFFFF
>[    2.983871] [drm] Supports vblank timestamp caching Rev 1 (10.10.2010).
>[    2.983872] [drm] Driver supports precise vblank timestamp query.
>[    2.983879] [drm] radeon: irq initialized.
>[    3.006064] [drm] Detected VRAM RAM=128M, BAR=128M
>[    3.006067] [drm] RAM width 16bits DDR
>[    3.006171] [TTM] Zone  kernel: Available graphics memory: 30854026 kiB
>[    3.006172] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
>[    3.006173] [TTM] Initializing pool allocator
>[    3.006188] [TTM] Initializing DMA pool allocator
>[    3.006222] [drm] radeon: 64M of VRAM memory ready
>[    3.006223] [drm] radeon: 512M of GTT memory ready.
>[    3.006239] [drm] GART: num cpu pages 131072, num gpu pages 131072
>[    3.006461] scsi2 : hpsa
>[    3.010076] hpsa 0000:05:00.0: RAID              device c2b3t0l0 added.
>[    3.010079] hpsa 0000:05:00.0: Direct-Access     device c2b0t0l0 added.
>[    3.010473] scsi 2:3:0:0: RAID              HP       P410i            3.66 PQ: 0 ANSI: 5
>[    3.010855] scsi 2:0:0:0: Direct-Access     HP       LOGICAL VOLUME   3.66 PQ: 0 ANSI: 5
>[    3.011166] scsi 2:3:0:0: Attached scsi generic sg1 type 12
>[    3.011697] sd 2:0:0:0: Attached scsi generic sg2 type 0
>[    3.011914] sd 2:0:0:0: [sda] 1720099632 512-byte logical blocks: (880 GB/820 GiB)
>[    3.012360] sd 2:0:0:0: [sda] Write Protect is off
>[    3.012362] sd 2:0:0:0: [sda] Mode Sense: 6b 00 00 08
>[    3.012523] sd 2:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
>[    3.014488]  sda: sda1 sda2
>[    3.015404] sd 2:0:0:0: [sda] Attached SCSI disk
>[    3.027355] [drm] PCI GART of 512M enabled (table at 0x0000000035E00000).
>[    3.027387] radeon 0000:01:03.0: WB disabled
>[    3.027390] radeon 0000:01:03.0: fence driver on ring 0 use gpu addr 0x00000000c8000000 and cpu addr 0xffff880035cbe000
>[    3.027424] [drm] Loading R100 Microcode
>[    3.027903] [drm] radeon: ring at 0x00000000C8001000
>[    3.027928] [drm] ring test succeeded in 1 usecs
>[    3.036654] systemd-udevd[363]: renamed network interface eth2 to em3
>[    3.043673] systemd-udevd[355]: renamed network interface eth0 to em1
>[    3.051601] systemd-udevd[356]: renamed network interface eth1 to em2
>[    3.482587] [drm] ib test succeeded in 0 usecs
>[    3.482779] [drm] Radeon Display Connectors
>[    3.482782] [drm] Connector 0:
>[    3.482784] [drm]   VGA-1
>[    3.482786] [drm]   DDC: 0x60 0x60 0x60 0x60 0x60 0x60 0x60 0x60
>[    3.482787] [drm]   Encoders:
>[    3.482789] [drm]     CRT1: INTERNAL_DAC1
>[    3.482791] [drm] Connector 1:
>[    3.482792] [drm]   VGA-2
>[    3.482794] [drm]   DDC: 0x6c 0x6c 0x6c 0x6c 0x6c 0x6c 0x6c 0x6c
>[    3.482795] [drm]   Encoders:
>[    3.482797] [drm]     CRT2: INTERNAL_DAC2
>[    3.557963] [drm] fb mappable at 0xE8040000
>[    3.557967] [drm] vram apper at 0xE8000000
>[    3.557969] [drm] size 1310720
>[    3.557971] [drm] fb depth is 8
>[    3.557972] [drm]    pitch is 1280
>[    3.558097] fbcon: radeondrmfb (fb0) is primary device
>[    3.708019] Console: switching to colour frame buffer device 160x64
>[    3.720887] fb0: radeondrmfb frame buffer device
>[    3.720888] drm: registered panic notifier
>[    3.720900] [drm] Initialized radeon 2.24.0 20080528 for 0000:01:03.0 on minor 0
>[    3.859180] bio: create slab <bio-1> at 1
>[    4.012189] EXT4-fs (dm-0): INFO: recovery required on readonly filesystem
>[    4.012193] EXT4-fs (dm-0): write access will be enabled during recovery
>[    4.105689] EXT4-fs (dm-0): orphan cleanup on readonly fs
>[    4.134560] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 1704949
>[    4.151948] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 141808
>[    4.173578] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 918522
>[    4.190529] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 12428
>[    4.204383] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 10485
>[    4.210465] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 139489
>[    4.211822] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 142649
>[    4.228751] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 14292
>[    4.229735] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 15859
>[    4.229800] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 142672
>[    4.242470] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 143175
>[    4.256011] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 138560
>[    4.262872] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 141681
>[    4.268179] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 142000
>[    4.278389] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 140655
>[    4.280978] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 131739
>[    4.294815] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 1835206
>[    4.313760] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 668977
>[    4.327952] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098848
>[    4.327998] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098847
>[    4.328019] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098846
>[    4.328032] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098845
>[    4.328044] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098844
>[    4.328055] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098843
>[    4.328067] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098842
>[    4.328078] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098841
>[    4.328090] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098840
>[    4.337292] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 133908
>[    4.341833] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147474
>[    4.346772] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 144551
>[    4.346802] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098839
>[    4.353812] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098624
>[    4.353839] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147472
>[    4.360621] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 137149
>[    4.364054] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 530316
>[    4.370578] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 525003
>[    4.371272] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 146173
>[    4.378369] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 137990
>[    4.378395] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 140616
>[    4.382111] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098623
>[    4.382132] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098622
>[    4.382149] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098621
>[    4.382160] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098620
>[    4.382172] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098619
>[    4.382184] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147463
>[    4.385193] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147452
>[    4.386135] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098618
>[    4.386155] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098617
>[    4.386172] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098616
>[    4.386184] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098341
>[    4.386196] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098340
>[    4.386210] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 2098339
>[    4.386222] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 146239
>[    4.386235] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 137171
>[    4.390209] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 144380
>[    4.390234] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 144111
>[    4.390248] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 139765
>[    4.390260] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147333
>[    4.390278] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 143139
>[    4.395110] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 133302
>[    4.395136] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147289
>[    4.396154] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 139235
>[    4.396381] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147137
>[    4.396396] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 141814
>[    4.396427] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 136855
>[    4.403313] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 135233
>[    4.404111] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 145235
>[    4.404131] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147053
>[    4.404144] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147049
>[    4.404160] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147047
>[    4.404172] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 147042
>[    4.404184] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 138344
>[    4.404197] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 133178
>[    4.404239] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 139561
>[    4.410678] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 132498
>[    4.413484] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 136085
>[    4.414946] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 146983
>[    4.414971] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 144440
>[    4.414989] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 146974
>[    4.415004] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 133137
>[    4.415019] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 146129
>[    4.415676] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 136536
>[    4.415730] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 146122
>[    4.416360] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 145910
>[    4.416405] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 144759
>[    4.416421] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 141845
>[    4.421218] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 141227
>[    4.424513] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 140026
>[    4.424541] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 139737
>[    4.424563] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 133209
>[    4.428096] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 4177
>[    4.428124] EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 785
>[    4.428145] EXT4-fs (dm-0): 92 orphan inodes deleted
>[    4.428147] EXT4-fs (dm-0): recovery complete
>[    4.451218] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
>[    4.535479] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
>[    4.969342] systemd-journald[204]: Received SIGTERM
>[    5.413491] type=1404 audit(1359299686.455:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
>[    5.537241] SELinux: 2048 avtab hash slots, 94432 rules.
>[    5.553114] SELinux: 2048 avtab hash slots, 94432 rules.
>[    5.663553] SELinux:  9 users, 15 roles, 4360 types, 238 bools, 1 sens, 1024 cats
>[    5.663557] SELinux:  83 classes, 94432 rules
>[    5.667561] SELinux:  Completing initialization.
>[    5.667580] SELinux:  Setting up existing superblocks.
>[    5.667586] SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
>[    5.667592] SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
>[    5.667601] SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
>[    5.667604] SELinux: initialized (dev proc, type proc), uses genfs_contexts
>[    5.667611] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
>[    5.667636] SELinux: initialized (dev devtmpfs, type devtmpfs), uses transition SIDs
>[    5.668489] SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
>[    5.668493] SELinux: initialized (dev debugfs, type debugfs), uses genfs_contexts
>[    5.668998] SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
>[    5.669002] SELinux: initialized (dev anon_inodefs, type anon_inodefs), uses genfs_contexts
>[    5.669004] SELinux: initialized (dev devpts, type devpts), uses transition SIDs
>[    5.669016] SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses transition SIDs
>[    5.669022] SELinux: initialized (dev mqueue, type mqueue), uses transition SIDs
>[    5.669027] SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
>[    5.669035] SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
>[    5.669374] SELinux: initialized (dev securityfs, type securityfs), uses genfs_contexts
>[    5.669376] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
>[    5.669382] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
>[    5.669466] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
>[    5.669491] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669494] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669498] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669510] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669515] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669517] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669520] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669523] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669526] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
>[    5.669530] SELinux: initialized (dev rpc_pipefs, type rpc_pipefs), uses genfs_contexts
>[    5.669538] SELinux: initialized (dev dm-0, type ext4), uses xattr
>[    5.703566] type=1403 audit(1359299686.746:3): policy loaded auid=4294967295 ses=4294967295
>[    5.716548] systemd[1]: Successfully loaded SELinux policy in 329ms 310us.
>[    5.808873] systemd[1]: Relabelled /dev and /run in 28ms 646us.
>[    6.867433] SELinux: initialized (dev autofs, type autofs), uses genfs_contexts
>[    6.893563] SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses transition SIDs
>[    7.250381] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
>[    7.397847] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
>[    7.399506] SELinux: initialized (dev nfsd, type nfsd), uses genfs_contexts
>[    7.584027] systemd-udevd[607]: starting version 197
>[    7.901375] EXT4-fs (dm-0): re-mounted. Opts: (null)
>[    7.986765] SELinux: initialized (dev configfs, type configfs), uses genfs_contexts
>[    8.432630] microcode: CPU0 sig=0x206c2, pf=0x1, revision=0x14
>[    8.460194] microcode: CPU1 sig=0x206c2, pf=0x1, revision=0x14
>[    8.460962] microcode: CPU2 sig=0x206c2, pf=0x1, revision=0x14
>[    8.461799] microcode: CPU3 sig=0x206c2, pf=0x1, revision=0x14
>[    8.462557] microcode: CPU4 sig=0x206c2, pf=0x1, revision=0x14
>[    8.463318] microcode: CPU5 sig=0x206c2, pf=0x1, revision=0x14
>[    8.464248] microcode: CPU6 sig=0x206c2, pf=0x1, revision=0x14
>[    8.464951] microcode: CPU7 sig=0x206c2, pf=0x1, revision=0x14
>[    8.465787] microcode: CPU8 sig=0x206c2, pf=0x1, revision=0x14
>[    8.466586] microcode: CPU9 sig=0x206c2, pf=0x1, revision=0x14
>[    8.467406] microcode: CPU10 sig=0x206c2, pf=0x1, revision=0x14
>[    8.468097] microcode: CPU11 sig=0x206c2, pf=0x1, revision=0x14
>[    8.468917] microcode: CPU12 sig=0x206c2, pf=0x1, revision=0x14
>[    8.469735] microcode: CPU13 sig=0x206c2, pf=0x1, revision=0x14
>[    8.470559] microcode: CPU14 sig=0x206c2, pf=0x1, revision=0x14
>[    8.471273] microcode: CPU15 sig=0x206c2, pf=0x1, revision=0x14
>[    8.472120] microcode: CPU16 sig=0x206c2, pf=0x1, revision=0x14
>[    8.472906] microcode: CPU17 sig=0x206c2, pf=0x1, revision=0x14
>[    8.473766] microcode: CPU18 sig=0x206c2, pf=0x1, revision=0x14
>[    8.474512] microcode: CPU19 sig=0x206c2, pf=0x1, revision=0x14
>[    8.475290] microcode: CPU20 sig=0x206c2, pf=0x1, revision=0x14
>[    8.476113] microcode: CPU21 sig=0x206c2, pf=0x1, revision=0x14
>[    8.476953] microcode: CPU22 sig=0x206c2, pf=0x1, revision=0x14
>[    8.477724] microcode: CPU23 sig=0x206c2, pf=0x1, revision=0x14
>[    8.478621] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
>[    8.586300] power_meter ACPI000D:00: Found ACPI power meter.
>[    8.586320] power_meter ACPI000D:00: Ignoring unsafe software power cap!
>[    8.927708] kvm: VM_EXIT_LOAD_IA32_PERF_GLOBAL_CTRL does not work properly. Using workaround
>[    9.256835] Adding 64126972k swap on /dev/mapper/VolGroup-lv_swap.  Priority:-1 extents:1 across:64126972k 
>[    9.330732] hpwdt 0000:02:00.0: HP Watchdog Timer Driver: NMI decoding initialized, allow kernel dump: ON (default = 0/OFF)
>[    9.330943] hpwdt 0000:02:00.0: HP Watchdog Timer Driver: 1.3.0, timer margin: 30 seconds (nowayout=0).
>[    9.340157] ACPI Warning: 0x0000000000000928-0x000000000000092f SystemIO conflicts with Region \SGPE 1 (20120913/utaddress-251)
>[    9.340162] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
>[    9.340180] lpc_ich: Resource conflict(s) found affecting gpio_ich
>[    9.487413] EDAC MC: Ver: 3.0.0
>[    9.494287] iTCO_vendor_support: vendor-support=0
>[    9.630378] EDAC MC1: Giving out device to 'i7core_edac.c' 'i7 core #1': DEV 0000:3e:03.0
>[    9.630422] EDAC PCI0: Giving out device to module 'i7core_edac' controller 'EDAC PCI controller': DEV '0000:3e:03.0' (POLLED)
>[    9.630430] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.10
>[    9.630449] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
>[    9.630868] EDAC MC0: Giving out device to 'i7core_edac.c' 'i7 core #0': DEV 0000:3f:03.0
>[    9.630909] EDAC PCI1: Giving out device to module 'i7core_edac' controller 'EDAC PCI controller': DEV '0000:3f:03.0' (POLLED)
>[    9.631827] EDAC i7core: Driver loaded, 2 memory controller(s) found.
>[   10.608157] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
>[   10.608221] SELinux: initialized (dev sda1, type ext4), uses xattr
>[   23.627249] EXT4-fs (dm-2): mounted filesystem with ordered data mode. Opts: (null)
>[   23.627256] SELinux: initialized (dev dm-2, type ext4), uses xattr
>[   23.755365] SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
>[   24.137370] ip6_tables: (C) 2000-2006 Netfilter Core Team
>[   24.157519] Ebtables v2.0 registered
>[   24.213259] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
>[   24.441573] Loading iSCSI transport class v2.0-870.
>[   24.455221] iscsi: registered transport (tcp)
>[   24.468809] systemd-journald[618]: Received SIGUSR1
>[   24.491437] iscsi: registered transport (iser)
>[   24.502986] libcxgbi:libcxgbi_init_module: tag itt 0x1fff, 13 bits, age 0xf, 4 bits.
>[   24.502989] libcxgbi:ddp_setup_host_page_size: system PAGE 4096, ddp idx 0.
>[   24.521123] Chelsio T3 iSCSI Driver cxgb3i v2.0.0 (Jun. 2010)
>[   24.521143] iscsi: registered transport (cxgb3i)
>[   24.539661] Chelsio T4 iSCSI Driver cxgb4i v0.9.1 (Aug. 2010)
>[   24.539692] iscsi: registered transport (cxgb4i)
>[   24.557075] cnic: Broadcom NetXtreme II CNIC Driver cnic v2.5.14 (Sep 30, 2012)
>[   24.557112] bnx2 0000:03:00.0 em1: Added CNIC device
>[   24.557137] bnx2 0000:03:00.1 em2: Added CNIC device
>[   24.557163] bnx2 0000:04:00.0 em3: Added CNIC device
>[   24.557188] bnx2 0000:04:00.1 eth3: Added CNIC device
>[   24.564444] Broadcom NetXtreme II iSCSI Driver bnx2i v2.7.2.2 (Apr 25, 2012)
>[   24.564470] iscsi: registered transport (bnx2i)
>[   24.565161] scsi3 : Broadcom Offload iSCSI Initiator
>[   24.565901] scsi4 : Broadcom Offload iSCSI Initiator
>[   24.566122] scsi5 : Broadcom Offload iSCSI Initiator
>[   24.566466] scsi6 : Broadcom Offload iSCSI Initiator
>[   24.582120] iscsi: registered transport (be2iscsi)
>[   24.582124] In beiscsi_module_init, tt=ffffffffa04c8000
>[   24.914570] bnx2 0000:03:00.0: irq 76 for MSI/MSI-X
>[   24.914586] bnx2 0000:03:00.0: irq 77 for MSI/MSI-X
>[   24.914599] bnx2 0000:03:00.0: irq 78 for MSI/MSI-X
>[   24.914607] bnx2 0000:03:00.0: irq 79 for MSI/MSI-X
>[   24.914618] bnx2 0000:03:00.0: irq 80 for MSI/MSI-X
>[   24.914626] bnx2 0000:03:00.0: irq 81 for MSI/MSI-X
>[   24.914636] bnx2 0000:03:00.0: irq 82 for MSI/MSI-X
>[   24.914646] bnx2 0000:03:00.0: irq 83 for MSI/MSI-X
>[   24.914655] bnx2 0000:03:00.0: irq 84 for MSI/MSI-X
>[   24.958547] bnx2 0000:03:00.0 em1: using MSIX
>[   24.958735] IPv6: ADDRCONF(NETDEV_UP): em1: link is not ready
>[   24.960560] bnx2i [03:00.00]: ISCSI_INIT passed
>[   25.122511] bnx2 0000:03:00.1: irq 85 for MSI/MSI-X
>[   25.122525] bnx2 0000:03:00.1: irq 86 for MSI/MSI-X
>[   25.122532] bnx2 0000:03:00.1: irq 87 for MSI/MSI-X
>[   25.122539] bnx2 0000:03:00.1: irq 88 for MSI/MSI-X
>[   25.122546] bnx2 0000:03:00.1: irq 89 for MSI/MSI-X
>[   25.122553] bnx2 0000:03:00.1: irq 90 for MSI/MSI-X
>[   25.122559] bnx2 0000:03:00.1: irq 91 for MSI/MSI-X
>[   25.122568] bnx2 0000:03:00.1: irq 92 for MSI/MSI-X
>[   25.122575] bnx2 0000:03:00.1: irq 93 for MSI/MSI-X
>[   25.166219] bnx2 0000:03:00.1 em2: using MSIX
>[   25.166270] IPv6: ADDRCONF(NETDEV_UP): em2: link is not ready
>[   25.167910] bnx2i [03:00.01]: ISCSI_INIT passed
>[   25.173877] bnx2 0000:04:00.0: irq 94 for MSI/MSI-X
>[   25.173890] bnx2 0000:04:00.0: irq 95 for MSI/MSI-X
>[   25.173902] bnx2 0000:04:00.0: irq 96 for MSI/MSI-X
>[   25.173913] bnx2 0000:04:00.0: irq 97 for MSI/MSI-X
>[   25.173924] bnx2 0000:04:00.0: irq 98 for MSI/MSI-X
>[   25.173935] bnx2 0000:04:00.0: irq 99 for MSI/MSI-X
>[   25.173946] bnx2 0000:04:00.0: irq 100 for MSI/MSI-X
>[   25.173957] bnx2 0000:04:00.0: irq 101 for MSI/MSI-X
>[   25.173967] bnx2 0000:04:00.0: irq 102 for MSI/MSI-X
>[   25.218157] bnx2 0000:04:00.0 em3: using MSIX
>[   25.218200] IPv6: ADDRCONF(NETDEV_UP): em3: link is not ready
>[   25.219764] bnx2i [04:00.00]: ISCSI_INIT passed
>[   25.225320] bnx2 0000:04:00.1: irq 103 for MSI/MSI-X
>[   25.225333] bnx2 0000:04:00.1: irq 104 for MSI/MSI-X
>[   25.225344] bnx2 0000:04:00.1: irq 105 for MSI/MSI-X
>[   25.225355] bnx2 0000:04:00.1: irq 106 for MSI/MSI-X
>[   25.225365] bnx2 0000:04:00.1: irq 107 for MSI/MSI-X
>[   25.225376] bnx2 0000:04:00.1: irq 108 for MSI/MSI-X
>[   25.225387] bnx2 0000:04:00.1: irq 109 for MSI/MSI-X
>[   25.225397] bnx2 0000:04:00.1: irq 110 for MSI/MSI-X
>[   25.225407] bnx2 0000:04:00.1: irq 111 for MSI/MSI-X
>[   25.271010] bnx2 0000:04:00.1 eth3: using MSIX
>[   25.271057] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
>[   25.272689] bnx2i [04:00.01]: ISCSI_INIT passed
>[   25.384634] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
>[   25.391858] NFSD: starting 90-second grace period
>[   26.592012] bnx2 0000:03:00.0 em1: NIC Copper Link is Up, 100 Mbps full duplex
>[   26.592015] , receive & transmit flow control ON
>[   26.592098] IPv6: ADDRCONF(NETDEV_CHANGE): em1: link becomes ready
>[   35.121060] nf_conntrack: automatic helper assignment is deprecated and it will be removed soon. Use the iptables CT target to attach helpers instead.
>[ 6586.915130] fuse init (API version 7.20)
>[ 6587.019530] SELinux: initialized (dev fuse, type fuse), uses genfs_contexts
>[ 6617.361513] type=1400 audit(1359305712.913:4): avc:  denied  { create } for  pid=9396 comm="npviewer.bin" name="C:\nppdf32Log\debuglog.txt" scontext=unconfined_u:unconfined_r:mozilla_plugin_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:user_home_dir_t:s0 tclass=file
>[ 6617.361568] type=1400 audit(1359305712.913:5): avc:  denied  { create } for  pid=9396 comm="npviewer.bin" name="C:\nppdf32Log\debuglog.txt" scontext=unconfined_u:unconfined_r:mozilla_plugin_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:user_home_dir_t:s0 tclass=file
>[ 6617.368651] type=1400 audit(1359305712.920:6): avc:  denied  { create } for  pid=9396 comm="npviewer.bin" name="C:\nppdf32Log\debuglog.txt" scontext=unconfined_u:unconfined_r:mozilla_plugin_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:user_home_dir_t:s0 tclass=file
>[ 8294.723863] ------------[ cut here ]------------
>[ 8294.723874] WARNING: at kernel/watchdog.c:245 watchdog_overflow_callback+0x9c/0xd0()
>[ 8294.723875] Hardware name: ProLiant DL380 G7
>[ 8294.723877] Watchdog detected hard LOCKUP on cpu 17
>[ 8294.723879] Modules linked in:
>[ 8294.723880]  fuse nf_conntrack_netbios_ns nf_conntrack_broadcast be2iscsi iscsi_boot_sysfs ipt_MASQUERADE bnx2i cnic uio cxgb4i cxgb4 cxgb3i cxgb3 mdio libcxgbi ib_iser rdma_cm ib_addr iw_cm ib_cm ib_sa ib_mad ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip6table_mangle ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat iptable_mangle nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables binfmt_misc iTCO_wdt i7core_edac iTCO_vendor_support edac_core lpc_ich hpwdt mfd_core coretemp hpilo kvm_intel kvm acpi_power_meter microcode uinput nfsd auth_rpcgss nfs_acl lockd radeon i2c_algo_bit drm_kms_helper ttm drm crc32c_intel ghash_clmulni_intel i2c_core bnx2 hpsa sunrpc
>[ 8294.723930] Pid: 10028, comm: quad.79 Not tainted 3.7.4-204.fc18.x86_64 #1
>[ 8294.723932] Call Trace:
>[ 8294.723934]  <NMI>  [<ffffffff8105e67f>] warn_slowpath_common+0x7f/0xc0
>[ 8294.723946]  [<ffffffff8105e776>] warn_slowpath_fmt+0x46/0x50
>[ 8294.723949]  [<ffffffff810eb420>] ? touch_nmi_watchdog+0x80/0x80
>[ 8294.723953]  [<ffffffff810eb4bc>] watchdog_overflow_callback+0x9c/0xd0
>[ 8294.723958]  [<ffffffff81126d1d>] __perf_event_overflow+0x9d/0x230
>[ 8294.723963]  [<ffffffff81024e97>] ? x86_perf_event_set_period+0xd7/0x160
>[ 8294.723966]  [<ffffffff81127924>] perf_event_overflow+0x14/0x20
>[ 8294.723971]  [<ffffffff8102a85e>] intel_pmu_handle_irq+0x1ae/0x330
>[ 8294.723978]  [<ffffffff816375cd>] perf_event_nmi_handler+0x1d/0x20
>[ 8294.723981]  [<ffffffff81636d91>] nmi_handle.isra.0+0x51/0x80
>[ 8294.723984]  [<ffffffff81636ea0>] do_nmi+0xe0/0x350
>[ 8294.723988]  [<ffffffff816363b0>] end_repeat_nmi+0x1e/0x2e
>[ 8294.723990]  <<EOE>> 
>[ 8294.723991] ---[ end trace 20e1d02cece8513c ]---
>[ 8343.363457] INFO: rcu_sched detected stalls on CPUs/tasks: { 17} (detected by 13, t=60002 jiffies)
>[ 8343.363465] sending NMI to all CPUs:
>[ 8343.363470] NMI backtrace for cpu 0
>[ 8343.363473] CPU 0 
>[ 8343.363477] Pid: 10011, comm: quad.17 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.363479] RIP: 0033:[<0000000000401247>]  [<0000000000401247>] 0x401246
>[ 8343.363496] RSP: 002b:00007fffd2a7cf00  EFLAGS: 00000217
>[ 8343.363498] RAX: 00000000e1ff389c RBX: 62f226f7e5f169a7 RCX: 00000005e5b28bb9
>[ 8343.363499] RDX: 0000000e79d24c5c RSI: 00000002083c752a RDI: 00000000e1ff389c
>[ 8343.363501] RBP: 73ce971e0339fcce R08: 000000000000005d R09: 0000000b788b2977
>[ 8343.363503] R10: 000000000000005d R11: 000000000000000a R12: 0000000f5bd184d7
>[ 8343.363505] R13: a06f20c6a3b1aee7 R14: 0000000f5bd184d6 R15: 0000000000000005
>[ 8343.363507] FS:  00007fdaa6de7740(0000) GS:ffff880781c00000(0000) knlGS:0000000000000000
>[ 8343.363509] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.363510] CR2: 00007fdaa6d91000 CR3: 000000072877f000 CR4: 00000000000007f0
>[ 8343.363512] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.363514] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.363516] Process quad.17 (pid: 10011, threadinfo ffff880ef1c6a000, task ffff880ef25bdc80)
>[ 8343.363517] 
>[ 8343.363569] NMI backtrace for cpu 1
>[ 8343.363571] CPU 1 
>[ 8343.363575] Pid: 10021, comm: quad.53 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.363576] RIP: 0033:[<000000000040123d>]  [<000000000040123d>] 0x40123c
>[ 8343.363590] RSP: 002b:00007fff0a16d9f0  EFLAGS: 00000283
>[ 8343.363592] RAX: 00000008f5e5c56f RBX: 9dd130ebb0e2fae5 RCX: 00000009ec99dcd8
>[ 8343.363593] RDX: 00000006273c9be4 RSI: 0000000850cee696 RDI: fffffff9d8c36462
>[ 8343.363595] RBP: 5485947d4995a9fd R08: 0000000000000046 R09: 00000004e3fe15e7
>[ 8343.363596] R10: 00000000000000bf R11: 00000000000000fc R12: 0000000f1d22610d
>[ 8343.363598] R13: 7ebdee7bcb1a55c5 R14: 0000000f1d22610c R15: 0000000000000077
>[ 8343.363600] FS:  00007f3ea5239740(0000) GS:ffff880f1fc00000(0000) knlGS:0000000000000000
>[ 8343.363602] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.363603] CR2: 00007f3ea51e2000 CR3: 0000000ee564f000 CR4: 00000000000007e0
>[ 8343.363605] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.363606] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.363608] Process quad.53 (pid: 10021, threadinfo ffff880ee5d12000, task ffff880ef22b5c80)
>[ 8343.363609] 
>[ 8343.363669] NMI backtrace for cpu 2
>[ 8343.363672] CPU 2 
>[ 8343.363675] Pid: 10009, comm: quad.11 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.363677] RIP: 0033:[<000000000040121c>]  [<000000000040121c>] 0x40121b
>[ 8343.363684] RSP: 002b:00007fffcf5047c0  EFLAGS: 00000297
>[ 8343.363685] RAX: 0000000507555a95 RBX: f4e7fea1d53596c0 RCX: fffffff5b302b2e8
>[ 8343.363687] RDX: 0000000a4cfd4e8b RSI: 0000000d45faafb3 RDI: 0000000c278d9790
>[ 8343.363689] RBP: 78661d011f40a2f1 R08: 00000015e3188d7d R09: 000000068ec5e5d0
>[ 8343.363691] R10: 00000000000000d7 R11: 0000000000000173 R12: 0000000f5452a7ad
>[ 8343.363692] R13: 512a6a168a4d5425 R14: 0000000f5452a7ac R15: 00000000000000a1
>[ 8343.363694] FS:  00007fcea51fc740(0000) GS:ffff880781c20000(0000) knlGS:0000000000000000
>[ 8343.363696] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.363698] CR2: 00007fcea51a6000 CR3: 000000072f914000 CR4: 00000000000007e0
>[ 8343.363700] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.363701] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.363703] Process quad.11 (pid: 10009, threadinfo ffff880ee5e56000, task ffff880ee7602e40)
>[ 8343.363704] 
>[ 8343.363769] NMI backtrace for cpu 3
>[ 8343.363772] CPU 3 
>[ 8343.363775] Pid: 10019, comm: quad.47 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.363777] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[ 8343.363784] RSP: 002b:00007fffb25fb250  EFLAGS: 00000a17
>[ 8343.363786] RAX: 85f6741a47346985 RBX: 1613d027bf1442dd RCX: 0000000000000066
>[ 8343.363787] RDX: 0000000855fb3782 RSI: 0000000625302dab RDI: 0000000a19c0fba4
>[ 8343.363789] RBP: 85f6741a47346985 R08: 0000001246f939d4 R09: 000000033553af5f
>[ 8343.363791] R10: 00000000000000cc R11: 0000000000000066 R12: 0000000f11a58a75
>[ 8343.363793] R13: 404e6267129075dd R14: 0000000f11a58a74 R15: 000000000000003e
>[ 8343.363795] FS:  00007f98e8d49740(0000) GS:ffff880f1fc20000(0000) knlGS:0000000000000000
>[ 8343.363797] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.363799] CR2: 00007fc107aa9000 CR3: 0000000ef579a000 CR4: 00000000000007e0
>[ 8343.363801] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.363803] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.363805] Process quad.47 (pid: 10019, threadinfo ffff880ee5d76000, task ffff880ee8901720)
>[ 8343.363806] 
>[ 8343.363869] NMI backtrace for cpu 4
>[ 8343.363872] CPU 4 
>[ 8343.363875] Pid: 10016, comm: quad.37 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.363877] RIP: 0033:[<0000000000401297>]  [<0000000000401297>] 0x401296
>[ 8343.363883] RSP: 002b:00007fff110c3e40  EFLAGS: 00000202
>[ 8343.363885] RAX: 0000001cb191dc20 RBX: 8df7a50f9f7dc498 RCX: 0000000e58c8ee10
>[ 8343.363887] RDX: 0000000c3bf5a97c RSI: 0000000e5048b3be RDI: 0000000620fd73c6
>[ 8343.363889] RBP: dc69b802df59ca41 R08: 000000031a3c724f R09: 00000000fd692dad
>[ 8343.363890] R10: 0000000f56321bbd R11: 000000000000001d R12: 0000000f56321bbd
>[ 8343.363892] R13: 8f3dc3f950457795 R14: 0000000f56321bbc R15: 0000000000000004
>[ 8343.363894] FS:  00007f22a5f07740(0000) GS:ffff880781c40000(0000) knlGS:0000000000000000
>[ 8343.363896] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[ 8343.363898] CR2: 00007f22a5eb1000 CR3: 0000000775d73000 CR4: 00000000000007e0
>[ 8343.363900] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.363901] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.363903] Process quad.37 (pid: 10016, threadinfo ffff880ee5de4000, task ffff880ef6b2c560)
>[ 8343.363905] 
>[ 8343.363969] NMI backtrace for cpu 5
>[ 8343.363972] CPU 5 
>[ 8343.363975] Pid: 10030, comm: quad.89 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.363977] RIP: 0033:[<000000000040125a>]  [<000000000040125a>] 0x401259
>[ 8343.363983] RSP: 002b:00007fffa41223d0  EFLAGS: 00000a13
>[ 8343.363985] RAX: 43c4e6928f0e6300 RBX: 94af5d17f18e3e99 RCX: 0000000ecfff7d71
>[ 8343.363987] RDX: 000000077a70936b RSI: 000000000000003a RDI: 0000000809c170b4
>[ 8343.363989] RBP: 195589272c726f99 R08: 00000000000000c7 R09: 000000000000003a
>[ 8343.363991] R10: 00000000000000c7 R11: 0000000000000036 R12: 0000000f118aec49
>[ 8343.363993] R13: 9332c4610facc5f9 R14: 0000000f118aec48 R15: 0000000000000035
>[ 8343.363995] FS:  00007fe38119d740(0000) GS:ffff880f1fc40000(0000) knlGS:0000000000000000
>[ 8343.363997] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.363999] CR2: 00007fe381146000 CR3: 0000000ee711d000 CR4: 00000000000007e0
>[ 8343.364001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364002] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364005] Process quad.89 (pid: 10030, threadinfo ffff880ee5d5e000, task ffff880ee7538000)
>[ 8343.364006] 
>[ 8343.364069] NMI backtrace for cpu 6
>[ 8343.364071] CPU 6 
>[ 8343.364075] Pid: 10008, comm: quad.7 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364076] RIP: 0033:[<0000000000401134>]  [<0000000000401134>] 0x401133
>[ 8343.364083] RSP: 002b:00007fff4c37a3d0  EFLAGS: 00000206
>[ 8343.364085] RAX: 00000009f766a753 RBX: 6c86825595590ff6 RCX: 0000000569999a5c
>[ 8343.364086] RDX: 00000009f766a753 RSI: 0000000000001521 RDI: 0000000f610041af
>[ 8343.364088] RBP: 0000000f6100419b R08: 00000002d1468c47 R09: 0000000000000003
>[ 8343.364090] R10: 000000195866e902 R11: 0000000000000079 R12: 0000000f610041af
>[ 8343.364091] R13: 4e268ee2daf5b54f R14: 0000000f610041ae R15: 0000000f610041d3
>[ 8343.364094] FS:  00007f3f63c59740(0000) GS:ffff880781c60000(0000) knlGS:0000000000000000
>[ 8343.364096] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.364097] CR2: 00007f3f63c03000 CR3: 00000007755a1000 CR4: 00000000000007e0
>[ 8343.364099] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364101] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364103] Process quad.7 (pid: 10008, threadinfo ffff880ee8f34000, task ffff880ee7605c80)
>[ 8343.364104] 
>[ 8343.364169] NMI backtrace for cpu 7
>[ 8343.364171] CPU 7 
>[ 8343.364175] Pid: 10023, comm: quad.61 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364176] RIP: 0033:[<0000000000400f99>]  [<0000000000400f99>] 0x400f98
>[ 8343.364183] RSP: 002b:00007fff52029e30  EFLAGS: 00000293
>[ 8343.364185] RAX: 0000000000035ce4 RBX: c0cf4eb177f9ff3d RCX: 00000000bfffffef
>[ 8343.364186] RDX: 000000000003e398 RSI: 0000000000001ae7 RDI: 000000000000005a
>[ 8343.364188] RBP: 0000000f1fe5dcc1 R08: 000000089b9c9faa R09: 000000000000003f
>[ 8343.364190] R10: 000000000000007e R11: 0000000000000005 R12: 0000000f1fe5dcc3
>[ 8343.364192] R13: e6ffeb2c9a5b6327 R14: 0000000f1fe5dcbe R15: 0000000f1fe5dcd9
>[ 8343.364194] FS:  00007fce4f642740(0000) GS:ffff880f1fc60000(0000) knlGS:0000000000000000
>[ 8343.364196] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.364198] CR2: 00007fce4f5eb000 CR3: 0000000ef3d1e000 CR4: 00000000000007e0
>[ 8343.364199] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364201] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364203] Process quad.61 (pid: 10023, threadinfo ffff880ef27fc000, task ffff880ee50b1720)
>[ 8343.364204] 
>[ 8343.364269] NMI backtrace for cpu 8
>[ 8343.364271] CPU 8 
>[ 8343.364275] Pid: 10014, comm: quad.29 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364276] RIP: 0033:[<00000000004012b1>]  [<00000000004012b1>] 0x4012b0
>[ 8343.364283] RSP: 002b:00007fff29bf4f80  EFLAGS: 00000202
>[ 8343.364285] RAX: 00000001ba82a451 RBX: d3e9a6cf7779fcb4 RCX: 000000088daf30d8
>[ 8343.364286] RDX: 00000003750548a2 RSI: 000000045993594e RDI: 000000086476a900
>[ 8343.364288] RBP: c5ef1e4547e87fb4 R08: 00000006883d88ff R09: 00000003750548a2
>[ 8343.364290] R10: 0000000da659190e R11: 0000000f60dbbd5f R12: 0000000f60dbbd5f
>[ 8343.364291] R13: 4efec6414cd3de9f R14: 0000000f60dbbd5e R15: 000000000000000b
>[ 8343.364293] FS:  00007f281508b740(0000) GS:ffff880781c80000(0000) knlGS:0000000000000000
>[ 8343.364295] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.364297] CR2: 00007f2815035000 CR3: 000000072cbb9000 CR4: 00000000000007e0
>[ 8343.364299] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364301] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364303] Process quad.29 (pid: 10014, threadinfo ffff880ef34a8000, task ffff880ee556ae40)
>[ 8343.364304] 
>[ 8343.364369] NMI backtrace for cpu 9
>[ 8343.364371] CPU 9 
>[ 8343.364375] Pid: 10010, comm: quad.13 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364377] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[ 8343.364383] RSP: 002b:00007fff18a2cc80  EFLAGS: 00000206
>[ 8343.364385] RAX: 000000000002eedc RBX: 00007f0c456d7010 RCX: 0000000000000015
>[ 8343.364387] RDX: 0000000000001774 RSI: 0000000001091b50 RDI: 0000000000000047
>[ 8343.364388] RBP: 0000000000200000 R08: 0000000000000001 R09: 0000000000000012
>[ 8343.364390] R10: 00007f0c45696010 R11: 000000000000578b R12: 0000000000000058
>[ 8343.364392] R13: a16fa101998c49e5 R14: 0000000f1bfbcbf6 R15: 0000000f1bfbcc11
>[ 8343.364394] FS:  00007f0c45718740(0000) GS:ffff880f1fc80000(0000) knlGS:0000000000000000
>[ 8343.364396] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.364398] CR2: 00007f0c456c1000 CR3: 0000000ee55e2000 CR4: 00000000000007e0
>[ 8343.364399] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364401] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364403] Process quad.13 (pid: 10010, threadinfo ffff880ee71f0000, task ffff880ee7601720)
>[ 8343.364404] 
>[ 8343.364470] NMI backtrace for cpu 10
>[ 8343.364480] CPU 10 
>[ 8343.364489] Pid: 10018, comm: quad.43 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364499] RIP: 0033:[<000000000040131a>]  [<000000000040131a>] 0x401319
>[ 8343.364517] RSP: 002b:00007fffc3c95020  EFLAGS: 00000297
>[ 8343.364526] RAX: 0000000d8890f34b RBX: 07b1251b81732acf RCX: 0000000a74ab4c01
>[ 8343.364535] RDX: 0000001b1121e696 RSI: 000000073aa9fd68 RDI: fffffffb129449ac
>[ 8343.364544] RBP: 4ffb44014e27b9d4 R08: 00000004b87f3430 R09: 0000000795b226db
>[ 8343.364553] R10: 0000000f038273ec R11: 00000003e6326dbd R12: 0000000f62170255
>[ 8343.364562] R13: ba09b85f359deafd R14: 0000000f62170254 R15: 000000000000005e
>[ 8343.364571] FS:  00007fbdccb72740(0000) GS:ffff880781ca0000(0000) knlGS:0000000000000000
>[ 8343.364581] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.364590] CR2: 00007f0957b02000 CR3: 00000007286ba000 CR4: 00000000000007e0
>[ 8343.364598] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364607] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364615] Process quad.43 (pid: 10018, threadinfo ffff880eed742000, task ffff880ef609c560)
>[ 8343.364623] 
>[ 8343.364632] NMI backtrace for cpu 11
>[ 8343.364637] CPU 11 
>[ 8343.364643] Pid: 10020, comm: quad.49 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364649] RIP: 0033:[<0000000000401280>]  [<0000000000401280>] 0x40127f
>[ 8343.364657] RSP: 002b:00007fff9f9d0710  EFLAGS: 00000217
>[ 8343.364659] RAX: 0000000d6843c8a9 RBX: fb606e1651f0c777 RCX: 000000005092804f
>[ 8343.364661] RDX: 00000001b313214e RSI: 0000000447bf22c5 RDI: 000000084f0a657f
>[ 8343.364663] RBP: 4d75183c7e9fb310 R08: 0000000d6843c8a9 R09: 0000000000000014
>[ 8343.364664] R10: 0000000000000040 R11: 0000000000000053 R12: 0000000f1b56e9b7
>[ 8343.364666] R13: e5b675e215cd4407 R14: 0000000f1b56e9b6 R15: 0000000000000040
>[ 8343.364668] FS:  00007f2ccb02b740(0000) GS:ffff880f1fca0000(0000) knlGS:0000000000000000
>[ 8343.364670] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.364672] CR2: 00007f2ccafd4000 CR3: 0000000ee5d80000 CR4: 00000000000007e0
>[ 8343.364674] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364675] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364677] Process quad.49 (pid: 10020, threadinfo ffff880ee87e2000, task ffff880ef32f0000)
>[ 8343.364678] 
>[ 8343.364680] NMI backtrace for cpu 12
>[ 8343.364682] CPU 12 
>[ 8343.364685] Pid: 10025, comm: quad.71 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364687] RIP: 0033:[<00000000004011ce>]  [<00000000004011ce>] 0x4011cd
>[ 8343.364691] RSP: 002b:00007fff01f2eaf0  EFLAGS: 00000a07
>[ 8343.364693] RAX: 85e959fad2433a63 RBX: 64bf8ebb7f948488 RCX: 0000000b0d3f77a1
>[ 8343.364695] RDX: 000000000000005e RSI: 0000000b30cf081b RDI: 000000087254cb59
>[ 8343.364696] RBP: b5cceca8bac66698 R08: 0000000c6c7c9602 R09: 0000000efb8cbccc
>[ 8343.364698] R10: 0000000b0d3f77a1 R11: 000000015f3d1e61 R12: 0000000f60d314ef
>[ 8343.364699] R13: c9e002373b969a0f R14: 0000000f60d314ee R15: 000000000000001f
>[ 8343.364701] FS:  00007f7c7489e740(0000) GS:ffff880781cc0000(0000) knlGS:0000000000000000
>[ 8343.364703] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.364705] CR2: 00007f7c74848000 CR3: 0000000ee7653000 CR4: 00000000000007e0
>[ 8343.364706] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364708] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364710] Process quad.71 (pid: 10025, threadinfo ffff880ee5dae000, task ffff880ee5e68000)
>[ 8343.364711] 
>[ 8343.364768] NMI backtrace for cpu 13
>[ 8343.364769] CPU 13 
>[ 8343.364772] Pid: 10029, comm: quad.83 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364774] RIP: 0010:[<ffffffff81039889>]  [<ffffffff81039889>] default_send_IPI_mask_sequence_phys+0x79/0x100
>[ 8343.364780] RSP: 0000:ffff880f1fcc3d98  EFLAGS: 00000046
>[ 8343.364782] RAX: ffff880781ce0000 RBX: 000000000000b03a RCX: 000000000000000e
>[ 8343.364783] RDX: 000000000000000e RSI: 0000000000000011 RDI: 0000000000000080
>[ 8343.364785] RBP: ffff880f1fcc3dd8 R08: ffffffff81cdc590 R09: 0000000000000000
>[ 8343.364787] R10: 0000000000000000 R11: 000000000000055e R12: ffffffff81cdc590
>[ 8343.364788] R13: 0000000000000400 R14: 0000000000000092 R15: 0000000000000002
>[ 8343.364790] FS:  00007f3d4a262740(0000) GS:ffff880f1fcc0000(0000) knlGS:0000000000000000
>[ 8343.364792] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[ 8343.364793] CR2: 00007f3d4a20b000 CR3: 0000000ef435f000 CR4: 00000000000007e0
>[ 8343.364795] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364796] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364798] Process quad.83 (pid: 10029, threadinfo ffff880eed508000, task ffff880ee5e6dc80)
>[ 8343.364799] Stack:
>[ 8343.364800]  ffffffff00000021 000000000000000d ffff880f1fcc3df8 0000000000002710
>[ 8343.364805]  000000000000000d ffff880eed508000 ffffffff81c3c6c0 ffffffff81c3c600
>[ 8343.364809]  ffff880f1fcc3de8 ffffffff8103d887 ffff880f1fcc3e08 ffffffff81039a8d
>[ 8343.364813] Call Trace:
>[ 8343.364814]  <IRQ> 
>[ 8343.364817] 
>[ 8343.364821]  [<ffffffff8103d887>] physflat_send_IPI_all+0x17/0x20
>[ 8343.364824]  [<ffffffff81039a8d>] arch_trigger_all_cpu_backtrace+0x5d/0xa0
>[ 8343.364829]  [<ffffffff810f5435>] rcu_check_callbacks+0x5b5/0x650
>[ 8343.364832]  [<ffffffff8106fa48>] update_process_times+0x48/0x90
>[ 8343.364837]  [<ffffffff810b61ae>] tick_sched_timer+0x6e/0xe0
>[ 8343.364840]  [<ffffffff81086123>] __run_hrtimer+0x73/0x1d0
>[ 8343.364843]  [<ffffffff810b6140>] ? tick_nohz_handler+0x110/0x110
>[ 8343.364848]  [<ffffffff81067066>] ? __do_softirq+0x136/0x210
>[ 8343.364851]  [<ffffffff81086a47>] hrtimer_interrupt+0xf7/0x230
>[ 8343.364855]  [<ffffffff8163fbc9>] smp_apic_timer_interrupt+0x69/0x99
>[ 8343.364860]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8343.364862]  <EOI> 
>[ 8343.364863] Code: 
>[ 8343.364864] 00 00 4c 89 e7 48 63 d2 e8 f5 e8 2b 00 89 c2 48 63 05 30 3e ca 00 48 39 c2 73 55 48 8b 04 d5 a0 ae cd 81 41 83 ff 02 0f b7 34 03 <74> 5c 8b 04 25 00 a3 5f ff f6 c4 10 74 17 66 0f 1f 84 00 00 00 
>[ 8343.364889] NMI backtrace for cpu 14
>[ 8343.364891] CPU 14 
>[ 8343.364894] Pid: 10012, comm: quad.19 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364896] RIP: 0033:[<0000000000401006>]  [<0000000000401006>] 0x401005
>[ 8343.364902] RSP: 002b:00007fff03c73680  EFLAGS: 00000a83
>[ 8343.364904] RAX: bbbbbbbe1e704297 RBX: d9109b5ad3b1ef6f RCX: 00000000ffffffbd
>[ 8343.364905] RDX: 00000002b9f2e343 RSI: 0000000000000355 RDI: 000000000000005a
>[ 8343.364907] RBP: 0000000f55f63e5b R08: 00000004358be4a6 R09: 000000000000005a
>[ 8343.364908] R10: 0000000000000097 R11: 00000000000000f3 R12: 0000000f55f63e5d
>[ 8343.364910] R13: b08a9cdce90dc201 R14: 0000000f55f63e5c R15: 0000000f55f63e65
>[ 8343.364912] FS:  00007ffe77d4e740(0000) GS:ffff880781ce0000(0000) knlGS:0000000000000000
>[ 8343.364914] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.364915] CR2: 00007ffe77cf8000 CR3: 0000000728486000 CR4: 00000000000007e0
>[ 8343.364917] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.364919] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.364921] Process quad.19 (pid: 10012, threadinfo ffff880ee5204000, task ffff880ef2f8dc80)
>[ 8343.364922] 
>[ 8343.364989] NMI backtrace for cpu 15
>[ 8343.364991] CPU 15 
>[ 8343.364994] Pid: 10027, comm: quad.77 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.364995] RIP: 0033:[<000000000040101a>]  [<000000000040101a>] 0x401019
>[ 8343.365000] RSP: 002b:00007fffe107ea70  EFLAGS: 00000216
>[ 8343.365002] RAX: 0000000000000053 RBX: 05cdd3382f51e095 RCX: 00000000f5ffffff
>[ 8343.365004] RDX: 0000000f183c5268 RSI: 0000000000001124 RDI: 000000000000005a
>[ 8343.365005] RBP: 0000000f183c52b5 R08: 0000000530bffc27 R09: 0000000000000002
>[ 8343.365007] R10: 00000000000000ba R11: 0000000000000026 R12: 0000000f183c52bb
>[ 8343.365009] R13: 33c228e5e2848dd3 R14: 0000000f183c52ba R15: 0000000f183c530b
>[ 8343.365011] FS:  00007f7f2abe2740(0000) GS:ffff880f1fce0000(0000) knlGS:0000000000000000
>[ 8343.365013] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365014] CR2: 000000000135b6c8 CR3: 0000000ee5a3c000 CR4: 00000000000007e0
>[ 8343.365016] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365018] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365020] Process quad.77 (pid: 10027, threadinfo ffff880ee7576000, task ffff880ee5e6ae40)
>[ 8343.365021] 
>[ 8343.365091] NMI backtrace for cpu 16
>[ 8343.365100] CPU 16 
>[ 8343.365108] Pid: 10017, comm: quad.41 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.365116] RIP: 0033:[<0000000000401272>]  [<0000000000401272>] 0x401271
>[ 8343.365130] RSP: 002b:00007ffff44fe870  EFLAGS: 00000a17
>[ 8343.365132] RAX: 331c77d0b9fa4954 RBX: 331c77d0b9fa4954 RCX: 0000000c13d68724
>[ 8343.365133] RDX: 0000000940908c80 RSI: 000000092ac7cb20 RDI: 00000005cf6da71b
>[ 8343.365135] RBP: 21234cf438ce0958 R08: 0000000000000025 R09: 000000000000007e
>[ 8343.365137] R10: 0000000000000025 R11: 000000000000005d R12: 0000000f56b81901
>[ 8343.365138] R13: 4cca1a1c92b8e701 R14: 0000000f56b81900 R15: 0000000000000008
>[ 8343.365140] FS:  00007f4ecf4fd740(0000) GS:ffff880781d00000(0000) knlGS:0000000000000000
>[ 8343.365142] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365144] CR2: 00007fc11b4f7019 CR3: 00000007284f6000 CR4: 00000000000007e0
>[ 8343.365145] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365147] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365149] Process quad.41 (pid: 10017, threadinfo ffff880ee754c000, task ffff880ef2e64560)
>[ 8343.365150] 
>[ 8343.365195] NMI backtrace for cpu 17
>[ 8343.365196] CPU 17 
>[ 8343.365199] Pid: 10028, comm: quad.79 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.365200] RIP: 0033:[<000000000040fb90>]  [<000000000040fb90>] 0x40fb8f
>[ 8343.365205] RSP: 002b:00007fff0acd25e0  EFLAGS: 00000206
>[ 8343.365207] RAX: 0000000000013515 RBX: 00007fd30accb010 RCX: 0000000000000008
>[ 8343.365208] RDX: 000000000003e248 RSI: 00000000010dbb50 RDI: 000000000000000d
>[ 8343.365214] RBP: 0000000000000100 R08: 0000000000000001 R09: 0000000000000004
>[ 8343.365218] R10: 00007fd30ac8a010 R11: 000000000000577e R12: 0000000000000040
>[ 8343.365223] R13: ee97738878b34cdf R14: 0000000f15ab6f94 R15: 0000000f15ab6fb1
>[ 8343.365229] FS:  00007fd30ad0c740(0000) GS:ffff880f1fd00000(0000) knlGS:0000000000000000
>[ 8343.365233] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365239] CR2: 00007fd30acb5000 CR3: 0000000ef58d8000 CR4: 00000000000007e0
>[ 8343.365244] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365250] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365255] Process quad.79 (pid: 10028, threadinfo ffff880ef3866000, task ffff880ee5e6c560)
>[ 8343.365260] 
>[ 8343.365295] NMI backtrace for cpu 18
>[ 8343.365303] CPU 18 
>[ 8343.365312] Pid: 10013, comm: quad.23 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.365320] RIP: 0033:[<00000000004011d4>]  [<00000000004011d4>] 0x4011d3
>[ 8343.365328] RSP: 002b:00007fff63b18020  EFLAGS: 00000a17
>[ 8343.365330] RAX: 791b50668ecce883 RBX: 845aba00c69b80b0 RCX: 000000055a1f571f
>[ 8343.365332] RDX: 00000000000000b6 RSI: 0000000bef402e15 RDI: 0000000f4a197a37
>[ 8343.365334] RBP: 0a0fe81c68c44819 R08: 00000003acb2b10e R09: 791b50668ecce883
>[ 8343.365335] R10: 000000055a1f571f R11: 0000000dad1a0ab0 R12: 0000000f5a86b0c1
>[ 8343.365337] R13: 0bf6a38e3015df41 R14: 0000000f5a86b0c0 R15: 00000000000000b6
>[ 8343.365339] FS:  00007fc7b2139740(0000) GS:ffff880781d20000(0000) knlGS:0000000000000000
>[ 8343.365341] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365342] CR2: 00007fc7b20e3000 CR3: 00000007259a1000 CR4: 00000000000007e0
>[ 8343.365344] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365346] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365347] Process quad.23 (pid: 10013, threadinfo ffff880eed482000, task ffff880ee5568000)
>[ 8343.365349] 
>[ 8343.365395] NMI backtrace for cpu 19
>[ 8343.365397] CPU 19 
>[ 8343.365400] Pid: 10007, comm: quad.1 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.365402] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[ 8343.365408] RSP: 002b:00007fff7c59e3b0  EFLAGS: 00000206
>[ 8343.365410] RAX: 000000000000c4d4 RBX: 00007f7cdfe5b010 RCX: 000000000000000b
>[ 8343.365413] RDX: 0000000000000625 RSI: 0000000001510b50 RDI: 0000000000000029
>[ 8343.365415] RBP: 0000000000000800 R08: 0000000000000001 R09: 000000000000000b
>[ 8343.365416] R10: 00007f7cdfe1a010 R11: 00000000000057ce R12: 0000000f322740f3
>[ 8343.365418] R13: a1c6ab5d3160b1f9 R14: 0000000f322740ee R15: 0000000f32274101
>[ 8343.365420] FS:  00007f7cdfe9c740(0000) GS:ffff880f1fd20000(0000) knlGS:0000000000000000
>[ 8343.365422] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365424] CR2: 00007f7cdfe45000 CR3: 0000000eed7e9000 CR4: 00000000000007e0
>[ 8343.365425] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365427] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365429] Process quad.1 (pid: 10007, threadinfo ffff880ee7526000, task ffff880ee7604560)
>[ 8343.365430] 
>[ 8343.365494] NMI backtrace for cpu 20
>[ 8343.365496] CPU 20 
>[ 8343.365499] Pid: 10026, comm: quad.73 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.365501] RIP: 0033:[<000000000040136b>]  [<000000000040136b>] 0x40136a
>[ 8343.365505] RSP: 002b:00007fff42211af0  EFLAGS: 00000282
>[ 8343.365507] RAX: 00000006ba41914f RBX: df01957733df2669 RCX: 000000058696b01e
>[ 8343.365509] RDX: 00000008a4b69fbd RSI: 000000038ad353a8 RDI: 00000001237d9146
>[ 8343.365510] RBP: 0c6e9a010e34edd6 R08: 00000006ba41914f R09: 0000000000000005
>[ 8343.365512] R10: 000000000000013b R11: 0000000000000064 R12: 0000000f5ef82fd1
>[ 8343.365514] R13: 7153f93854688931 R14: 0000000f5ef82fd0 R15: 0000000000000062
>[ 8343.365516] FS:  00007f229adcb740(0000) GS:ffff880781d40000(0000) knlGS:0000000000000000
>[ 8343.365518] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365519] CR2: 00007f229ad75000 CR3: 000000072872f000 CR4: 00000000000007e0
>[ 8343.365521] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365523] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365525] Process quad.73 (pid: 10026, threadinfo ffff880ee55da000, task ffff880ee5e69720)
>[ 8343.365526] 
>[ 8343.365594] NMI backtrace for cpu 21
>[ 8343.365596] CPU 21 
>[ 8343.365599] Pid: 10024, comm: quad.67 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.365601] RIP: 0033:[<0000000000400fb5>]  [<0000000000400fb5>] 0x400fb4
>[ 8343.365607] RSP: 002b:00007fff4ab1e640  EFLAGS: 00000206
>[ 8343.365609] RAX: 000000000002146c RBX: 5768b7c07a6c6d69 RCX: 0000000001439b50
>[ 8343.365611] RDX: 000000000000000c RSI: 00000000000010a3 RDI: 000000000000005a
>[ 8343.365612] RBP: 0000000f16fda395 R08: 0000000a5fbf4f9b R09: 000000000000003d
>[ 8343.365614] R10: 0000000000000040 R11: 000000000000002d R12: 0000000f16fda397
>[ 8343.365615] R13: 4735c3d6910d9f1b R14: 0000000f16fda394 R15: 0000000f16fda39d
>[ 8343.365618] FS:  00007f77d7fc0740(0000) GS:ffff880f1fd40000(0000) knlGS:0000000000000000
>[ 8343.365619] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365621] CR2: 00007f77d7f69000 CR3: 0000000ef36fd000 CR4: 00000000000007e0
>[ 8343.365622] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365624] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365626] Process quad.67 (pid: 10024, threadinfo ffff880ee5520000, task ffff880ee50b4560)
>[ 8343.365627] 
>[ 8343.365694] NMI backtrace for cpu 22
>[ 8343.365696] CPU 22 
>[ 8343.365699] Pid: 10015, comm: quad.31 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.365701] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[ 8343.365705] RSP: 002b:00007fffd392bda0  EFLAGS: 00000a13
>[ 8343.365707] RAX: d5493ee6cf3f8982 RBX: 46cba198f621974e RCX: 0000000000000139
>[ 8343.365709] RDX: 0000000f220248a5 RSI: 00000009d78f73bd RDI: 0000000bc4003c16
>[ 8343.365710] RBP: d5493ee6cf3f8982 R08: 00000013807fbd36 R09: 0000000423b0c5b3
>[ 8343.365712] R10: 0000000000000091 R11: 0000000000000139 R12: 0000000f5ccef783
>[ 8343.365714] R13: cd49ed50e7c94f2b R14: 0000000f5ccef782 R15: 0000000000000073
>[ 8343.365716] FS:  00007f29fe59d740(0000) GS:ffff880781d60000(0000) knlGS:0000000000000000
>[ 8343.365718] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365720] CR2: 00007f29fe547000 CR3: 00000007755cc000 CR4: 00000000000007e0
>[ 8343.365721] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365723] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365725] Process quad.31 (pid: 10015, threadinfo ffff880ee8cde000, task ffff880ef600c560)
>[ 8343.365726] 
>[ 8343.365794] NMI backtrace for cpu 23
>[ 8343.365795] CPU 23 
>[ 8343.365798] Pid: 10022, comm: quad.59 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8343.365800] RIP: 0033:[<0000000000401236>]  [<0000000000401236>] 0x401235
>[ 8343.365804] RSP: 002b:00007fffa5538da0  EFLAGS: 00000a07
>[ 8343.365806] RAX: c0e1422f05936f00 RBX: 67047dcfed9510a6 RCX: 000000096865bc37
>[ 8343.365808] RDX: 00000002f04324fc RSI: 00000007552adca7 RDI: 0000000000000009
>[ 8343.365809] RBP: d3bb1e26508422a6 R08: 0000000000000009 R09: 00000001c282bd00
>[ 8343.365811] R10: 000000000000002a R11: 0000000000000028 R12: 0000000f1ceade91
>[ 8343.365812] R13: c2c077d019bca271 R14: 0000000f1ceade90 R15: 0000000000000028
>[ 8343.365814] FS:  00007fe61b3e6740(0000) GS:ffff880f1fd60000(0000) knlGS:0000000000000000
>[ 8343.365816] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8343.365818] CR2: 00007fe61b38f000 CR3: 0000000ee5e50000 CR4: 00000000000007e0
>[ 8343.365819] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8343.365821] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8343.365823] Process quad.59 (pid: 10022, threadinfo ffff880ee5d38000, task ffff880ee50b0000)
>[ 8343.365824] 
>[ 8519.683410] ------------[ cut here ]------------
>[ 8519.683421] WARNING: at kernel/watchdog.c:245 watchdog_overflow_callback+0x9c/0xd0()
>[ 8519.683423] Hardware name: ProLiant DL380 G7
>[ 8519.683424] Watchdog detected hard LOCKUP on cpu 5
>[ 8519.683425] Modules linked in:
>[ 8519.683427]  fuse nf_conntrack_netbios_ns nf_conntrack_broadcast be2iscsi iscsi_boot_sysfs ipt_MASQUERADE bnx2i cnic uio cxgb4i cxgb4 cxgb3i cxgb3 mdio libcxgbi ib_iser rdma_cm ib_addr iw_cm ib_cm ib_sa ib_mad ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip6table_mangle ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat iptable_mangle nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables binfmt_misc iTCO_wdt i7core_edac iTCO_vendor_support edac_core lpc_ich hpwdt mfd_core coretemp hpilo kvm_intel kvm acpi_power_meter microcode uinput nfsd auth_rpcgss nfs_acl lockd radeon i2c_algo_bit drm_kms_helper ttm drm crc32c_intel ghash_clmulni_intel i2c_core bnx2 hpsa sunrpc
>[ 8519.683471] Pid: 10030, comm: quad.89 Tainted: G        W    3.7.4-204.fc18.x86_64 #1
>[ 8519.683473] Call Trace:
>[ 8519.683474]  <NMI>  [<ffffffff8105e67f>] warn_slowpath_common+0x7f/0xc0
>[ 8519.683485]  [<ffffffff8105e776>] warn_slowpath_fmt+0x46/0x50
>[ 8519.683489]  [<ffffffff810eb420>] ? touch_nmi_watchdog+0x80/0x80
>[ 8519.683492]  [<ffffffff810eb4bc>] watchdog_overflow_callback+0x9c/0xd0
>[ 8519.683497]  [<ffffffff81126d1d>] __perf_event_overflow+0x9d/0x230
>[ 8519.683501]  [<ffffffff81024e97>] ? x86_perf_event_set_period+0xd7/0x160
>[ 8519.683504]  [<ffffffff81127924>] perf_event_overflow+0x14/0x20
>[ 8519.683509]  [<ffffffff8102a85e>] intel_pmu_handle_irq+0x1ae/0x330
>[ 8519.683514]  [<ffffffff81016814>] ? show_regs+0x94/0x270
>[ 8519.683520]  [<ffffffff816375cd>] perf_event_nmi_handler+0x1d/0x20
>[ 8519.683523]  [<ffffffff81636d91>] nmi_handle.isra.0+0x51/0x80
>[ 8519.683526]  [<ffffffff81636ea0>] do_nmi+0xe0/0x350
>[ 8519.683529]  [<ffffffff816363b0>] end_repeat_nmi+0x1e/0x2e
>[ 8519.683531]  <<EOE>> 
>[ 8519.683532] ---[ end trace 20e1d02cece8513d ]---
>[ 8786.499670] Clocksource tsc unstable (delta = 299966049310 ns)
>[ 8786.501392] Switching to clocksource hpet
>[ 8804.614820] INFO: rcu_sched self-detected stall on CPU { 5}  (t=303000 jiffies)
>[ 8804.614826] sending NMI to all CPUs:
>[ 8804.614832] NMI backtrace for cpu 0
>[ 8804.614835] CPU 0 
>[ 8804.614839] Pid: 10011, comm: quad.17 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.614841] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[ 8804.614860] RSP: 002b:00007fffd2a7ced0  EFLAGS: 00000206
>[ 8804.614862] RAX: 000000000003f07f RBX: 00007fdaa6da6010 RCX: 0000000000000012
>[ 8804.614863] RDX: 0000000000001f83 RSI: 0000000001ea6b50 RDI: 000000000000000d
>[ 8804.614865] RBP: 0000000000040000 R08: 0000000000000001 R09: 0000000000000004
>[ 8804.614867] R10: 00007fdaa6d65010 R11: 0000000000006551 R12: 00000014d9a124b9
>[ 8804.614869] R13: d9162af5172d1ab3 R14: 00000014d9a124b6 R15: 00000014d9a124c5
>[ 8804.614871] FS:  00007fdaa6de7740(0000) GS:ffff880781c00000(0000) knlGS:0000000000000000
>[ 8804.614873] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.614875] CR2: 00000000006e2b98 CR3: 000000072877f000 CR4: 00000000000007f0
>[ 8804.614877] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.614879] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.614881] Process quad.17 (pid: 10011, threadinfo ffff880ef1c6a000, task ffff880ef25bdc80)
>[ 8804.614882] 
>[ 8804.614930] NMI backtrace for cpu 1
>[ 8804.614933] CPU 1 
>[ 8804.614936] Pid: 10021, comm: quad.53 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.614938] RIP: 0033:[<0000000000401314>]  [<0000000000401314>] 0x401313
>[ 8804.614952] RSP: 002b:00007fff0a16d9f0  EFLAGS: 00000202
>[ 8804.614954] RAX: 000000019a349ef1 RBX: 0e2a33f26b3af603 RCX: 0000001607246fd9
>[ 8804.614956] RDX: 0000000334693de2 RSI: 0000000fcb5b62fd RDI: ffffffff0e29db87
>[ 8804.614958] RBP: a2dcb0f0f1c29bcb R08: 00000000d85da660 R09: 0000001394922a88
>[ 8804.614959] R10: 0000000843a56722 R11: 0000000abc1f39bd R12: 0000001486684f01
>[ 8804.614961] R13: 470e8b22d2f8b101 R14: 0000001486684f00 R15: 000000000000000a
>[ 8804.614963] FS:  00007f3ea5239740(0000) GS:ffff880f1fc00000(0000) knlGS:0000000000000000
>[ 8804.614965] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.614971] CR2: 00007f3ea51e9000 CR3: 0000000ee564f000 CR4: 00000000000007e0
>[ 8804.614972] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.614974] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.614976] Process quad.53 (pid: 10021, threadinfo ffff880ee5d12000, task ffff880ef22b5c80)
>[ 8804.614977] 
>[ 8804.615031] NMI backtrace for cpu 2
>[ 8804.615033] CPU 2 
>[ 8804.615037] Pid: 10009, comm: quad.11 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615039] RIP: 0033:[<0000000000401006>]  [<0000000000401006>] 0x401005
>[ 8804.615046] RSP: 002b:00007fffcf5047c0  EFLAGS: 00000a83
>[ 8804.615048] RAX: 4444444781ab8739 RBX: b89acd1842d849e2 RCX: 00000000fdffffff
>[ 8804.615050] RDX: 00000003b3e3ba3c RSI: 0000000000001b7a RDI: 000000000000005a
>[ 8804.615052] RBP: 00000014d3e0f76d R08: 000000111b9fbd06 R09: 0000000000000021
>[ 8804.615054] R10: 000000000000019c R11: 00000000000000a0 R12: 00000014d3e0f793
>[ 8804.615055] R13: 932762be8539e0e9 R14: 00000014d3e0f792 R15: 00000014d3e0f7b3
>[ 8804.615058] FS:  00007fcea51fc740(0000) GS:ffff880781c20000(0000) knlGS:0000000000000000
>[ 8804.615060] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615062] CR2: 0000000000453b90 CR3: 000000072f914000 CR4: 00000000000007e0
>[ 8804.615063] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615065] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615067] Process quad.11 (pid: 10009, threadinfo ffff880ee5e56000, task ffff880ee7602e40)
>[ 8804.615068] 
>[ 8804.615096] INFO: rcu_sched detected stalls on CPUs/tasks: { 5} (detected by 16, t=303000 jiffies)
>[ 8804.615130] NMI backtrace for cpu 3
>[ 8804.615133] CPU 3 
>[ 8804.615136] Pid: 10019, comm: quad.47 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615138] RIP: 0010:[<ffffffff8146f890>]  [<ffffffff8146f890>] uhci_check_ports+0x40/0x160
>[ 8804.615146] RSP: 0000:ffff880f1fc23d60  EFLAGS: 00000006
>[ 8804.615148] RAX: ffff880035c10080 RBX: 0000000000000012 RCX: 0000000000000000
>[ 8804.615149] RDX: 0000000000003c12 RSI: ffff880ef33e7df0 RDI: ffff880ef33e7da0
>[ 8804.615151] RBP: ffff880f1fc23d90 R08: ffff880ef6a394a8 R09: dead000000200200
>[ 8804.615152] R10: 0000000000000000 R11: 0000000000000004 R12: 0000000000000001
>[ 8804.615154] R13: ffff880ef33e7da0 R14: ffff880ef33e7ca8 R15: ffff880f1fc23dea
>[ 8804.615156] FS:  00007f98e8d49740(0000) GS:ffff880f1fc20000(0000) knlGS:0000000000000000
>[ 8804.615158] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615160] CR2: 00007f98e8cf9000 CR3: 0000000ef579a000 CR4: 00000000000007e0
>[ 8804.615161] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615163] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615165] Process quad.47 (pid: 10019, threadinfo ffff880ee5d76000, task ffff880ee8901720)
>[ 8804.615166] Stack:
>[ 8804.615167]  ffff880f1fc23d80 ffff880ef33e7da0 ffff880ef33e7e30 0000000000000286
>[ 8804.615173]  ffff880ef33e7c00 ffff880f1fc23dea ffff880f1fc23dd0 ffffffff81472e90
>[ 8804.615176]  0000000000000001 ffff880ef33e7c00 ffff880ef33e7ca8 0000000000000100
>[ 8804.615180] Call Trace:
>[ 8804.615182]  <IRQ> 
>[ 8804.615184] 
>[ 8804.615187]  [<ffffffff81472e90>] uhci_hub_status_data+0x90/0x210
>[ 8804.615192]  [<ffffffff8144aed0>] ? usb_hcd_poll_rh_status+0x170/0x170
>[ 8804.615196]  [<ffffffff8144adb5>] usb_hcd_poll_rh_status+0x55/0x170
>[ 8804.615199]  [<ffffffff8144aed0>] ? usb_hcd_poll_rh_status+0x170/0x170
>[ 8804.615202]  [<ffffffff8144aede>] rh_timer_func+0xe/0x10
>[ 8804.615209]  [<ffffffff8106d23a>] call_timer_fn+0x3a/0x120
>[ 8804.615212]  [<ffffffff8144aed0>] ? usb_hcd_poll_rh_status+0x170/0x170
>[ 8804.615216]  [<ffffffff8106efce>] run_timer_softirq+0x1fe/0x2b0
>[ 8804.615219]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.615225]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.615231]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.615236]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.615239]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.615241]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.615245]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.615246]  <EOI> 
>[ 8804.615248] Code: 
>[ 8804.615249] 55 49 89 fd 41 54 45 31 e4 53 bb 10 00 00 00 48 83 ec 08 8b 97 58 01 00 00 85 d2 74 2b 66 0f 1f 44 00 00 41 8b 55 08 01 da 66 ed <f6> c4 02 0f b7 c8 75 24 83 e1 40 75 78 41 83 c4 01 83 c3 02 45 
>[ 8804.615274] NMI backtrace for cpu 4
>[ 8804.615276] CPU 4 
>[ 8804.615279] Pid: 10016, comm: quad.37 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615281] RIP: 0010:[<ffffffff8106ee96>]  [<ffffffff8106ee96>] run_timer_softirq+0xc6/0x2b0
>[ 8804.615288] RSP: 0000:ffff880781c43e70  EFLAGS: 00000086
>[ 8804.615289] RAX: ffff880776fcc988 RBX: ffff880776fcc000 RCX: ffff880781c43ea0
>[ 8804.615290] RDX: ffff880776fcc960 RSI: ffff880781c43ea0 RDI: ffff880776fcc000
>[ 8804.615292] RBP: ffff880781c43ee0 R08: ffff880781c53cc0 R09: 0000000000000000
>[ 8804.615293] R10: 0000000000000000 R11: 0000000000000004 R12: 0000000000000096
>[ 8804.615294] R13: ffffffff8106dcb0 R14: 0000000000000000 R15: 00000014d551c4f7
>[ 8804.615296] FS:  00007f22a5f07740(0000) GS:ffff880781c40000(0000) knlGS:0000000000000000
>[ 8804.615298] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615299] CR2: 00007fbfcb578000 CR3: 0000000775d73000 CR4: 00000000000007e0
>[ 8804.615300] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615302] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615303] Process quad.37 (pid: 10016, threadinfo ffff880ee5de4000, task ffff880ef6b2c560)
>[ 8804.615304] Stack:
>[ 8804.615305]  ffff880776fcdc28 ffff880776fcd828 ffff880776fcd428 ffff880776fcd028
>[ 8804.615310]  ffff8807736bae40 ffff880781c43ea0 ffff880781c43ea0 ffff880781c43ea0
>[ 8804.615313]  ffff880ef6b2c560 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.615317] Call Trace:
>[ 8804.615318]  <IRQ> 
>[ 8804.615320] 
>[ 8804.615323]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.615327]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.615332]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.615336]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.615338]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.615341]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.615344]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.615345]  <EOI> 
>[ 8804.615346] Code: 
>[ 8804.615347] 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 <48> 89 42 28 48 89 40 08 66 90 4c 8b 65 c0 4c 3b 65 b8 0f 84 96 
>[ 8804.615369] NMI backtrace for cpu 5
>[ 8804.615370] CPU 5 
>[ 8804.615373] Pid: 10030, comm: quad.89 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615375] RIP: 0010:[<ffffffff81039889>]  [<ffffffff81039889>] default_send_IPI_mask_sequence_phys+0x79/0x100
>[ 8804.615381] RSP: 0000:ffff880f1fc43d98  EFLAGS: 00000046
>[ 8804.615382] RAX: ffff880781c60000 RBX: 000000000000b03a RCX: 0000000000000006
>[ 8804.615384] RDX: 0000000000000006 RSI: 0000000000000014 RDI: 0000000000000080
>[ 8804.615386] RBP: ffff880f1fc43dd8 R08: ffffffff81cdc590 R09: 0000000000000000
>[ 8804.615387] R10: 0000000000000000 R11: 0000000000000725 R12: ffffffff81cdc590
>[ 8804.615389] R13: 0000000000000400 R14: 0000000000000092 R15: 0000000000000002
>[ 8804.615391] FS:  00007fe38119d740(0000) GS:ffff880f1fc40000(0000) knlGS:0000000000000000
>[ 8804.615393] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615394] CR2: 00007fe38114d000 CR3: 0000000ee711d000 CR4: 00000000000007e0
>[ 8804.615396] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615398] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615399] Process quad.89 (pid: 10030, threadinfo ffff880ee5d5e000, task ffff880ee7538000)
>[ 8804.615401] Stack:
>[ 8804.615402]  ffffffff00000024 0000000000000005 ffff880f1fc43df8 0000000000002710
>[ 8804.615406]  0000000000000005 ffff880ee5d5e000 ffffffff81c3c6c0 ffffffff81c3c600
>[ 8804.615410]  ffff880f1fc43de8 ffffffff8103d887 ffff880f1fc43e08 ffffffff81039a8d
>[ 8804.615414] Call Trace:
>[ 8804.615415]  <IRQ> 
>[ 8804.615417] 
>[ 8804.615421]  [<ffffffff8103d887>] physflat_send_IPI_all+0x17/0x20
>[ 8804.615424]  [<ffffffff81039a8d>] arch_trigger_all_cpu_backtrace+0x5d/0xa0
>[ 8804.615429]  [<ffffffff810f5140>] rcu_check_callbacks+0x2c0/0x650
>[ 8804.615433]  [<ffffffff8106fa48>] update_process_times+0x48/0x90
>[ 8804.615437]  [<ffffffff810b61ae>] tick_sched_timer+0x6e/0xe0
>[ 8804.615441]  [<ffffffff81086123>] __run_hrtimer+0x73/0x1d0
>[ 8804.615444]  [<ffffffff810b6140>] ? tick_nohz_handler+0x110/0x110
>[ 8804.615447]  [<ffffffff81086a47>] hrtimer_interrupt+0xf7/0x230
>[ 8804.615450]  [<ffffffff8163fbc9>] smp_apic_timer_interrupt+0x69/0x99
>[ 8804.615454]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.615455]  <EOI> 
>[ 8804.615456] Code: 
>[ 8804.615458] 00 00 4c 89 e7 48 63 d2 e8 f5 e8 2b 00 89 c2 48 63 05 30 3e ca 00 48 39 c2 73 55 48 8b 04 d5 a0 ae cd 81 41 83 ff 02 0f b7 34 03 <74> 5c 8b 04 25 00 a3 5f ff f6 c4 10 74 17 66 0f 1f 84 00 00 00 
>[ 8804.615484] NMI backtrace for cpu 6
>[ 8804.615487] CPU 6 
>[ 8804.615490] Pid: 10008, comm: quad.7 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615492] RIP: 0010:[<ffffffff8106ee87>]  [<ffffffff8106ee87>] run_timer_softirq+0xb7/0x2b0
>[ 8804.615497] RSP: 0000:ffff880781c63e70  EFLAGS: 00000082
>[ 8804.615499] RAX: ffff8807768183d8 RBX: ffff880776818000 RCX: ffff8807768183d8
>[ 8804.615501] RDX: ffff8807768183b0 RSI: ffff880781c63ea0 RDI: ffff880776818000
>[ 8804.615503] RBP: ffff880781c63ee0 R08: ffff880781c6e4a0 R09: dead000000200200
>[ 8804.615504] R10: 0000000000000000 R11: 0000000000000004 R12: 000000000000003b
>[ 8804.615506] R13: ffffffff8107c570 R14: 0000000000000002 R15: 00000014e20b8d59
>[ 8804.615508] FS:  00007f3f63c59740(0000) GS:ffff880781c60000(0000) knlGS:0000000000000000
>[ 8804.615510] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615512] CR2: 00007f3f63c09000 CR3: 00000007755a1000 CR4: 00000000000007e0
>[ 8804.615514] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615516] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615518] Process quad.7 (pid: 10008, threadinfo ffff880ee8f34000, task ffff880ee7605c80)
>[ 8804.615519] Stack:
>[ 8804.615520]  ffff880776819c28 ffff880776819828 ffff880776819428 ffff880776819028
>[ 8804.615525]  ffff880781c70760 ffff880781c63ea0 ffff880781c63ea0 ffff880781c63ea0
>[ 8804.615529]  ffff880ee7605c80 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.615533] Call Trace:
>[ 8804.615534]  <IRQ> 
>[ 8804.615536] 
>[ 8804.615539]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.615542]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.615546]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.615550]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.615553]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.615556]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.615560]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.615561]  <EOI> 
>[ 8804.615562] Code: 
>[ 8804.615564] 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 <48> 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 48 89 42 28 48 89 
>[ 8804.615590] NMI backtrace for cpu 7
>[ 8804.615593] CPU 7 
>[ 8804.615596] Pid: 10023, comm: quad.61 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615598] RIP: 0010:[<ffffffff8106ee70>]  [<ffffffff8106ee70>] run_timer_softirq+0xa0/0x2b0
>[ 8804.615602] RSP: 0000:ffff880f1fc63e70  EFLAGS: 00000006
>[ 8804.615604] RAX: 00000001007e617c RBX: ffff880ef6aec000 RCX: ffff880f1fc63ea0
>[ 8804.615606] RDX: 000000000000007c RSI: ffff880f1fc63ea0 RDI: ffff880ef6aec000
>[ 8804.615607] RBP: ffff880f1fc63ee0 R08: ffff880ef6aec828 R09: dead000000200200
>[ 8804.615609] R10: 0000000000000000 R11: 0000000000000004 R12: 000000000000007c
>[ 8804.615611] R13: ffffffff812cebe0 R14: 0000000000000000 R15: 0000000000000003
>[ 8804.615613] FS:  00007fce4f642740(0000) GS:ffff880f1fc60000(0000) knlGS:0000000000000000
>[ 8804.615615] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615616] CR2: 00007f5e3ad486b8 CR3: 0000000ef3d1e000 CR4: 00000000000007e0
>[ 8804.615618] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615619] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615621] Process quad.61 (pid: 10023, threadinfo ffff880ef27fc000, task ffff880ee50b1720)
>[ 8804.615622] Stack:
>[ 8804.615624]  ffff880ef6aedc28 ffff880ef6aed828 ffff880ef6aed428 ffff880ef6aed028
>[ 8804.615628]  ffff8807709587c8 ffff880f1fc63ea0 ffff880f1fc63ea0 ffff880f1fc63ea0
>[ 8804.615632]  ffff880ee50b1720 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.615636] Call Trace:
>[ 8804.615637]  <IRQ> 
>[ 8804.615639] 
>[ 8804.615641]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.615644]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.615648]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.615651]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.615654]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.615657]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.615660]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.615661]  <EOI> 
>[ 8804.615663] Code: 
>[ 8804.615664] 28 1c 00 00 48 89 55 a0 48 89 4d 98 48 89 75 90 0f 1f 00 49 89 c4 41 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 43 10 01 <48> 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 
>[ 8804.615689] NMI backtrace for cpu 8
>[ 8804.615692] CPU 8 
>[ 8804.615695] Pid: 10014, comm: quad.29 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615697] RIP: 0010:[<ffffffff8106ee7f>]  [<ffffffff8106ee7f>] run_timer_softirq+0xaf/0x2b0
>[ 8804.615702] RSP: 0000:ffff880781c83e70  EFLAGS: 00000086
>[ 8804.615704] RAX: 00000001007e7fa6 RBX: ffff880776864000 RCX: ffff880776864a88
>[ 8804.615706] RDX: ffff880776864a60 RSI: ffff880781c83ea0 RDI: ffff880776864000
>[ 8804.615708] RBP: ffff880781c83ee0 R08: ffff880781c8e4a0 R09: dead000000200200
>[ 8804.615710] R10: 0000000000000000 R11: 0000000000000004 R12: 00000000000000a6
>[ 8804.615712] R13: ffffffff8107c570 R14: 0000000000000002 R15: 0000000000000011
>[ 8804.615715] FS:  00007f281508b740(0000) GS:ffff880781c80000(0000) knlGS:0000000000000000
>[ 8804.615717] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615718] CR2: 00007f281503b000 CR3: 000000072cbb9000 CR4: 00000000000007e0
>[ 8804.615720] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615722] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615724] Process quad.29 (pid: 10014, threadinfo ffff880ef34a8000, task ffff880ee556ae40)
>[ 8804.615729] Stack:
>[ 8804.615730]  ffff880776865c28 ffff880776865828 ffff880776865428 ffff880776865028
>[ 8804.615735]  ffffffff81cae168 ffff880781c83ea0 ffff880781c83ea0 ffff880781c83ea0
>[ 8804.615739]  ffff880ee556ae40 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.615743] Call Trace:
>[ 8804.615744]  <IRQ> 
>[ 8804.615746] 
>[ 8804.615748]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.615752]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.615756]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.615759]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.615762]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.615765]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.615768]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.615769]  <EOI> 
>[ 8804.615770] Code: 
>[ 8804.615772] 90 0f 1f 00 49 89 c4 41 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 <48> 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 
>[ 8804.615798] NMI backtrace for cpu 9
>[ 8804.615800] CPU 9 
>[ 8804.615803] Pid: 10010, comm: quad.13 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615805] RIP: 0010:[<ffffffff8106eea4>]  [<ffffffff8106eea4>] run_timer_softirq+0xd4/0x2b0
>[ 8804.615809] RSP: 0000:ffff880f1fc83e70  EFLAGS: 00000082
>[ 8804.615811] RAX: ffff880ef6b38298 RBX: ffff880ef6b38000 RCX: ffff880f1fc83ea0
>[ 8804.615813] RDX: ffff880ef6b38270 RSI: ffff880f1fc83ea0 RDI: ffff880ef6b38000
>[ 8804.615814] RBP: ffff880f1fc83ee0 R08: ffff880f1fc8e4a0 R09: dead000000200200
>[ 8804.615816] R10: 0000000000000000 R11: 0000000000000004 R12: ffff880f1fc83ea0
>[ 8804.615818] R13: ffffffff8107c570 R14: 0000000000000002 R15: 0000001481a1d899
>[ 8804.615821] FS:  00007f0c45718740(0000) GS:ffff880f1fc80000(0000) knlGS:0000000000000000
>[ 8804.615822] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615824] CR2: 00007f0c456c8000 CR3: 0000000ee55e2000 CR4: 00000000000007e0
>[ 8804.615826] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615827] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615829] Process quad.13 (pid: 10010, threadinfo ffff880ee71f0000, task ffff880ee7601720)
>[ 8804.615830] Stack:
>[ 8804.615832]  ffff880ef6b39c28 ffff880ef6b39828 ffff880ef6b39428 ffff880ef6b39028
>[ 8804.615836]  ffff880f1fc90760 ffff880f1fc83ea0 ffff880f1fc83ea0 ffff880f1fc83ea0
>[ 8804.615840]  ffff880ee7601720 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.615844] Call Trace:
>[ 8804.615845]  <IRQ> 
>[ 8804.615847] 
>[ 8804.615849]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.615852]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.615856]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.615859]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.615862]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.615865]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.615868]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.615869]  <EOI> 
>[ 8804.615871] Code: 
>[ 8804.615872] 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 48 89 42 28 48 89 40 08 66 90 4c 8b 65 c0 <4c> 3b 65 b8 0f 84 96 00 00 00 49 8b 54 24 28 4d 8b 4c 24 18 4d 
>[ 8804.615897] NMI backtrace for cpu 10
>[ 8804.615900] CPU 10 
>[ 8804.615903] Pid: 10018, comm: quad.43 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.615905] RIP: 0010:[<ffffffff8106ee7f>]  [<ffffffff8106ee7f>] run_timer_softirq+0xaf/0x2b0
>[ 8804.615910] RSP: 0000:ffff880781ca3e70  EFLAGS: 00000086
>[ 8804.615911] RAX: 00000001007ee2b9 RBX: ffff8807768d8000 RCX: ffff8807768d8bb8
>[ 8804.615913] RDX: ffff8807768d8b90 RSI: ffff880781ca3ea0 RDI: ffff8807768d8000
>[ 8804.615915] RBP: ffff880781ca3ee0 R08: ffff880781cae4a0 R09: dead000000200200
>[ 8804.615917] R10: 0000000000000000 R11: 0000000000000004 R12: 00000000000000b9
>[ 8804.615918] R13: ffffffff8107c570 R14: 0000000000000002 R15: 00000014e2441311
>[ 8804.615920] FS:  00007fbdccb72740(0000) GS:ffff880781ca0000(0000) knlGS:0000000000000000
>[ 8804.615922] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.615924] CR2: 00007f0957b02000 CR3: 00000007286ba000 CR4: 00000000000007e0
>[ 8804.615926] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.615927] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.615929] Process quad.43 (pid: 10018, threadinfo ffff880eed742000, task ffff880ef609c560)
>[ 8804.615931] Stack:
>[ 8804.615932]  ffff8807768d9c28 ffff8807768d9828 ffff8807768d9428 ffff8807768d9028
>[ 8804.615936]  ffff880781cb0760 ffff880781ca3ea0 ffff880781ca3ea0 ffff880781ca3ea0
>[ 8804.615940]  ffff880ef609c560 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.615944] Call Trace:
>[ 8804.615945]  <IRQ> 
>[ 8804.615947] 
>[ 8804.615950]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.615953]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.615957]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.615960]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.615963]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.615966]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.615970]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.615971]  <EOI> 
>[ 8804.615973] Code: 
>[ 8804.615974] 90 0f 1f 00 49 89 c4 41 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 <48> 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 
>[ 8804.616001] NMI backtrace for cpu 11
>[ 8804.616003] CPU 11 
>[ 8804.616006] Pid: 10020, comm: quad.49 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616008] RIP: 0010:[<ffffffff8106ef4f>]  [<ffffffff8106ef4f>] run_timer_softirq+0x17f/0x2b0
>[ 8804.616013] RSP: 0000:ffff880f1fca3e70  EFLAGS: 00000046
>[ 8804.616015] RAX: 00000001007f368b RBX: ffff880ef6b84000 RCX: ffff880f1fca3ea0
>[ 8804.616016] RDX: 0000000100821215 RSI: ffff880f1fca3ea0 RDI: ffff880ef6b84000
>[ 8804.616018] RBP: ffff880f1fca3ee0 R08: ffff880f1fcae4a0 R09: dead000000200200
>[ 8804.616020] R10: 0000000000000000 R11: 0000000000000004 R12: ffff880f1fca3ea0
>[ 8804.616021] R13: ffffffff8107c570 R14: 0000000000000002 R15: 0000001483305fe1
>[ 8804.616024] FS:  00007f2ccb02b740(0000) GS:ffff880f1fca0000(0000) knlGS:0000000000000000
>[ 8804.616025] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616027] CR2: 00007f2ccafdb000 CR3: 0000000ee5d80000 CR4: 00000000000007e0
>[ 8804.616029] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616031] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616033] Process quad.49 (pid: 10020, threadinfo ffff880ee87e2000, task ffff880ef32f0000)
>[ 8804.616034] Stack:
>[ 8804.616035]  ffff880ef6b85c28 ffff880ef6b85828 ffff880ef6b85428 ffff880ef6b85028
>[ 8804.616039]  ffff880f1fcb0760 ffff880f1fca3ea0 ffff880f1fca3ea0 ffff880f1fca3ea0
>[ 8804.616043]  ffff880ef32f0000 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616047] Call Trace:
>[ 8804.616049]  <IRQ> 
>[ 8804.616051] 
>[ 8804.616053]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616056]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616060]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616063]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616066]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616069]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616072]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616074]  <EOI> 
>[ 8804.616075] Code: 
>[ 8804.616076] 89 e7 4c 89 ee e8 d2 e2 ff ff 48 89 df e8 aa 67 5c 00 4c 8b 65 c0 4c 3b 65 b8 0f 85 6a ff ff ff 48 8b 15 b5 60 c7 00 48 8b 43 10 <48> 39 c2 0f 89 00 ff ff ff 48 c7 43 08 00 00 00 00 80 03 01 fb 
>[ 8804.616103] NMI backtrace for cpu 12
>[ 8804.616104] CPU 12 
>[ 8804.616107] Pid: 10025, comm: quad.71 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616108] RIP: 0010:[<ffffffff8106ee96>]  [<ffffffff8106ee96>] run_timer_softirq+0xc6/0x2b0
>[ 8804.616112] RSP: 0000:ffff880781cc3e70  EFLAGS: 00000086
>[ 8804.616114] RAX: ffff880776920f18 RBX: ffff880776920000 RCX: ffff880781cc3ea0
>[ 8804.616115] RDX: ffff880776920ef0 RSI: ffff880781cc3ea0 RDI: ffff880776920000
>[ 8804.616116] RBP: ffff880781cc3ee0 R08: ffff880781cce4a0 R09: dead000000200200
>[ 8804.616117] R10: 0000000000000000 R11: 0000000000000004 R12: 00000000000000ef
>[ 8804.616119] R13: ffffffff8107c570 R14: 0000000000000002 R15: 00000014dfbb3a49
>[ 8804.616120] FS:  00007f7c7489e740(0000) GS:ffff880781cc0000(0000) knlGS:0000000000000000
>[ 8804.616122] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616123] CR2: 00007f7c7484e000 CR3: 0000000ee7653000 CR4: 00000000000007e0
>[ 8804.616124] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616125] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616127] Process quad.71 (pid: 10025, threadinfo ffff880ee5dae000, task ffff880ee5e68000)
>[ 8804.616128] Stack:
>[ 8804.616129]  ffff880776921c28 ffff880776921828 ffff880776921428 ffff880776921028
>[ 8804.616132]  ffff880781cd0760 ffff880781cc3ea0 ffff880781cc3ea0 ffff880781cc3ea0
>[ 8804.616136]  ffff880ee5e68000 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616139] Call Trace:
>[ 8804.616140]  <IRQ> 
>[ 8804.616142] 
>[ 8804.616144]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616146]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616149]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616152]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616155]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616157]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616160]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616161]  <EOI> 
>[ 8804.616162] Code: 
>[ 8804.616163] 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 <48> 89 42 28 48 89 40 08 66 90 4c 8b 65 c0 4c 3b 65 b8 0f 84 96 
>[ 8804.616184] NMI backtrace for cpu 13
>[ 8804.616185] CPU 13 
>[ 8804.616188] Pid: 10029, comm: quad.83 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616190] RIP: 0010:[<ffffffff8106ee58>]  [<ffffffff8106ee58>] run_timer_softirq+0x88/0x2b0
>[ 8804.616195] RSP: 0000:ffff880f1fcc3e70  EFLAGS: 00000006
>[ 8804.616197] RAX: 00000001007f9675 RBX: ffff880ef6bd0000 RCX: ffff880f1fcc3ea0
>[ 8804.616198] RDX: 0000000100821215 RSI: ffff880f1fcc3ea0 RDI: ffff880ef6bd0000
>[ 8804.616200] RBP: ffff880f1fcc3ee0 R08: ffff880f1fcce4a0 R09: dead000000200200
>[ 8804.616202] R10: 0000000000000000 R11: 0000000000000004 R12: ffff880f1fcc3ea0
>[ 8804.616203] R13: ffffffff8107c570 R14: 0000000000000002 R15: 00000014840e7ee1
>[ 8804.616206] FS:  00007f3d4a262740(0000) GS:ffff880f1fcc0000(0000) knlGS:0000000000000000
>[ 8804.616207] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616209] CR2: 00007f3d4a212000 CR3: 0000000ef435f000 CR4: 00000000000007e0
>[ 8804.616211] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616213] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616215] Process quad.83 (pid: 10029, threadinfo ffff880eed508000, task ffff880ee5e6dc80)
>[ 8804.616216] Stack:
>[ 8804.616217]  ffff880ef6bd1c28 ffff880ef6bd1828 ffff880ef6bd1428 ffff880ef6bd1028
>[ 8804.616221]  ffffffffa002fd00 ffff880f1fcc3ea0 ffff880f1fcc3ea0 ffff880f1fcc3ea0
>[ 8804.616225]  ffff880ee5e6dc80 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616230] Call Trace:
>[ 8804.616231]  <IRQ> 
>[ 8804.616235] 
>[ 8804.616237]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616240]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616244]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616247]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616250]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616253]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616256]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616258]  <EOI> 
>[ 8804.616259] Code: 
>[ 8804.616260] 10 00 00 48 8d 93 28 14 00 00 48 8d 8b 28 18 00 00 48 89 75 a8 48 8d b3 28 1c 00 00 48 89 55 a0 48 89 4d 98 48 89 75 90 0f 1f 00 <49> 89 c4 41 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 
>[ 8804.616286] NMI backtrace for cpu 14
>[ 8804.616288] CPU 14 
>[ 8804.616291] Pid: 10012, comm: quad.19 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616293] RIP: 0010:[<ffffffff8106ee58>]  [<ffffffff8106ee58>] run_timer_softirq+0x88/0x2b0
>[ 8804.616298] RSP: 0000:ffff880781ce3e70  EFLAGS: 00000012
>[ 8804.616299] RAX: 00000001007fa996 RBX: ffff88077696c000 RCX: ffff880781ce3ea0
>[ 8804.616301] RDX: 0000000100821215 RSI: ffff880781ce3ea0 RDI: ffff88077696c000
>[ 8804.616303] RBP: ffff880781ce3ee0 R08: ffff880781cee4a0 R09: dead000000200200
>[ 8804.616304] R10: 0000000000000000 R11: 0000000000000004 R12: ffff880781ce3ea0
>[ 8804.616306] R13: ffffffff8107c570 R14: 0000000000000002 R15: 00000014d6cfc7c9
>[ 8804.616308] FS:  00007ffe77d4e740(0000) GS:ffff880781ce0000(0000) knlGS:0000000000000000
>[ 8804.616310] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616312] CR2: 00007ffe77cfe000 CR3: 0000000728486000 CR4: 00000000000007e0
>[ 8804.616313] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616315] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616317] Process quad.19 (pid: 10012, threadinfo ffff880ee5204000, task ffff880ef2f8dc80)
>[ 8804.616318] Stack:
>[ 8804.616319]  ffff88077696dc28 ffff88077696d828 ffff88077696d428 ffff88077696d028
>[ 8804.616324]  ffff880781cf0760 ffff880781ce3ea0 ffff880781ce3ea0 ffff880781ce3ea0
>[ 8804.616328]  ffff880ef2f8dc80 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616332] Call Trace:
>[ 8804.616333]  <IRQ> 
>[ 8804.616335] 
>[ 8804.616337]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616341]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616345]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616348]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616351]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616353]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616357]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616358]  <EOI> 
>[ 8804.616359] Code: 
>[ 8804.616360] 10 00 00 48 8d 93 28 14 00 00 48 8d 8b 28 18 00 00 48 89 75 a8 48 8d b3 28 1c 00 00 48 89 55 a0 48 89 4d 98 48 89 75 90 0f 1f 00 <49> 89 c4 41 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 
>[ 8804.616387] NMI backtrace for cpu 15
>[ 8804.616388] CPU 15 
>[ 8804.616391] Pid: 10027, comm: quad.77 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616393] RIP: 0010:[<ffffffff8106ee87>]  [<ffffffff8106ee87>] run_timer_softirq+0xb7/0x2b0
>[ 8804.616397] RSP: 0000:ffff880f1fce3e70  EFLAGS: 00000086
>[ 8804.616398] RAX: ffff880ef6018a58 RBX: ffff880ef6018000 RCX: ffff880ef6018a58
>[ 8804.616399] RDX: ffff880ef6018a30 RSI: ffff880f1fce3ea0 RDI: ffff880ef6018000
>[ 8804.616401] RBP: ffff880f1fce3ee0 R08: ffff880ef6019318 R09: dead000000200200
>[ 8804.616402] R10: 0000000000000000 R11: 0000000000000004 R12: 00000000000000a3
>[ 8804.616404] R13: ffffffff8107c570 R14: 0000000000000002 R15: 0000000000000069
>[ 8804.616406] FS:  00007f7f2abe2740(0000) GS:ffff880f1fce0000(0000) knlGS:0000000000000000
>[ 8804.616408] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616410] CR2: 000000000135b6c8 CR3: 0000000ee5a3c000 CR4: 00000000000007e0
>[ 8804.616411] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616413] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616415] Process quad.77 (pid: 10027, threadinfo ffff880ee7576000, task ffff880ee5e6ae40)
>[ 8804.616416] Stack:
>[ 8804.616417]  ffff880ef6019c28 ffff880ef6019828 ffff880ef6019428 ffff880ef6019028
>[ 8804.616422]  ffffffff81ca97a8 ffff880f1fce3ea0 ffff880f1fce3ea0 ffff880f1fce3ea0
>[ 8804.616426]  ffff880ee5e6ae40 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616430] Call Trace:
>[ 8804.616431]  <IRQ> 
>[ 8804.616433] 
>[ 8804.616435]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616438]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616441]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616444]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616447]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616450]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616453]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616454]  <EOI> 
>[ 8804.616455] Code: 
>[ 8804.616456] 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 <48> 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 48 89 42 28 48 89 
>[ 8804.616483] NMI backtrace for cpu 16
>[ 8804.616485] CPU 16 
>[ 8804.616488] Pid: 10017, comm: quad.41 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616489] RIP: 0010:[<ffffffff8106ee8b>]  [<ffffffff8106ee8b>] run_timer_softirq+0xbb/0x2b0
>[ 8804.616493] RSP: 0000:ffff880781d03e70  EFLAGS: 00000086
>[ 8804.616495] RAX: ffff8807769bc3e8 RBX: ffff8807769bc000 RCX: ffff8807769bc3e8
>[ 8804.616497] RDX: ffff8807769bc3c0 RSI: ffff880781d03ea0 RDI: ffff8807769bc000
>[ 8804.616498] RBP: ffff880781d03ee0 R08: ffff880781d0e4a0 R09: dead000000200200
>[ 8804.616500] R10: 0000000000000000 R11: 000000000000002f R12: 000000000000003c
>[ 8804.616502] R13: ffffffff8107c570 R14: 0000000000000002 R15: 00000014c47f0141
>[ 8804.616504] FS:  00007f4ecf4fd740(0000) GS:ffff880781d00000(0000) knlGS:0000000000000000
>[ 8804.616506] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616507] CR2: 00007fc11d7c8019 CR3: 00000007284f6000 CR4: 00000000000007e0
>[ 8804.616509] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616511] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616512] Process quad.41 (pid: 10017, threadinfo ffff880ee754c000, task ffff880ef2e64560)
>[ 8804.616514] Stack:
>[ 8804.616515]  ffff8807769bdc28 ffff8807769bd828 ffff8807769bd428 ffff8807769bd028
>[ 8804.616520]  ffff880781d10760 ffff880781d03ea0 ffff8807769bc3e8 ffff880781d03ea0
>[ 8804.616524]  ffff880ef2e64560 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616528] Call Trace:
>[ 8804.616529]  <IRQ> 
>[ 8804.616530] 
>[ 8804.616533]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616536]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616539]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616542]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616545]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616548]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616551]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616552]  <EOI> 
>[ 8804.616553] Code: 
>[ 8804.616555] 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 <48> 8b 4a 30 48 89 4d c8 48 89 31 48 89 42 28 48 89 40 08 66 90 
>[ 8804.616583] NMI backtrace for cpu 17
>[ 8804.616585] CPU 17 
>[ 8804.616587] Pid: 10028, comm: quad.79 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616589] RIP: 0010:[<ffffffff8106ee96>]  [<ffffffff8106ee96>] run_timer_softirq+0xc6/0x2b0
>[ 8804.616593] RSP: 0000:ffff880f1fd03e70  EFLAGS: 00000086
>[ 8804.616594] RAX: ffff880ef6084388 RBX: ffff880ef6084000 RCX: ffff880f1fd03ea0
>[ 8804.616596] RDX: ffff880ef6084360 RSI: ffff880f1fd03ea0 RDI: ffff880ef6084000
>[ 8804.616597] RBP: ffff880f1fd03ee0 R08: ffff880f1fd0e4a0 R09: dead000000200200
>[ 8804.616599] R10: 0000000000000000 R11: 0000000000000004 R12: 0000000000000036
>[ 8804.616600] R13: ffffffff8107c570 R14: 0000000000000002 R15: 00000014837ab84b
>[ 8804.616602] FS:  00007fd30ad0c740(0000) GS:ffff880f1fd00000(0000) knlGS:0000000000000000
>[ 8804.616603] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616605] CR2: 00007fd30acbc000 CR3: 0000000ef58d8000 CR4: 00000000000007e0
>[ 8804.616606] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616608] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616610] Process quad.79 (pid: 10028, threadinfo ffff880ef3866000, task ffff880ee5e6c560)
>[ 8804.616611] Stack:
>[ 8804.616612]  ffff880ef6085c28 ffff880ef6085828 ffff880ef6085428 ffff880ef6085028
>[ 8804.616616]  ffff880f1fd10760 ffff880f1fd03ea0 ffff880f1fd03ea0 ffff880f1fd03ea0
>[ 8804.616619]  ffff880ee5e6c560 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616623] Call Trace:
>[ 8804.616624]  <IRQ> 
>[ 8804.616626] 
>[ 8804.616628]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616630]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616633]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616636]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616639]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616641]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616644]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616645]  <EOI> 
>[ 8804.616647] Code: 
>[ 8804.616648] 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 <48> 89 42 28 48 89 40 08 66 90 4c 8b 65 c0 4c 3b 65 b8 0f 84 96 
>[ 8804.616683] NMI backtrace for cpu 18
>[ 8804.616685] CPU 18 
>[ 8804.616687] Pid: 10013, comm: quad.23 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616689] RIP: 0010:[<ffffffff8106ee87>]  [<ffffffff8106ee87>] run_timer_softirq+0xb7/0x2b0
>[ 8804.616693] RSP: 0000:ffff880781d23e70  EFLAGS: 00000082
>[ 8804.616694] RAX: ffff880776a083f8 RBX: ffff880776a08000 RCX: ffff880776a083f8
>[ 8804.616696] RDX: ffff880776a083d0 RSI: ffff880781d23ea0 RDI: ffff880776a08000
>[ 8804.616698] RBP: ffff880781d23ee0 R08: ffff880776a095c8 R09: 0000000000000000
>[ 8804.616699] R10: 0000000000000000 R11: 0000000000000004 R12: 000000000000003d
>[ 8804.616701] R13: ffffffff81031030 R14: 0000000000000000 R15: 000000000000003f
>[ 8804.616703] FS:  00007fc7b2139740(0000) GS:ffff880781d20000(0000) knlGS:0000000000000000
>[ 8804.616705] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616707] CR2: 00007fc7b20e9000 CR3: 00000007259a1000 CR4: 00000000000007e0
>[ 8804.616708] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616710] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616712] Process quad.23 (pid: 10013, threadinfo ffff880eed482000, task ffff880ee5568000)
>[ 8804.616713] Stack:
>[ 8804.616714]  ffff880776a09c28 ffff880776a09828 ffff880776a09428 ffff880776a09028
>[ 8804.616719]  0000000000000012 ffff880781d23ea0 ffff880781d23ea0 ffff880781d23ea0
>[ 8804.616723]  ffff880ee5568000 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616727] Call Trace:
>[ 8804.616728]  <IRQ> 
>[ 8804.616729] 
>[ 8804.616731]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616734]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616738]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616741]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616744]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616746]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616750]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616751]  <EOI> 
>[ 8804.616752] Code: 
>[ 8804.616753] 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 <48> 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 48 89 42 28 48 89 
>[ 8804.616783] NMI backtrace for cpu 19
>[ 8804.616785] CPU 19 
>[ 8804.616787] Pid: 10007, comm: quad.1 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616789] RIP: 0010:[<ffffffff8106ee96>]  [<ffffffff8106ee96>] run_timer_softirq+0xc6/0x2b0
>[ 8804.616793] RSP: 0000:ffff880f1fd23e70  EFLAGS: 00000086
>[ 8804.616795] RAX: ffff880ef60b0de8 RBX: ffff880ef60b0000 RCX: ffff880f1fd23ea0
>[ 8804.616797] RDX: ffff880ef60b0dc0 RSI: ffff880f1fd23ea0 RDI: ffff880ef60b0000
>[ 8804.616798] RBP: ffff880f1fd23ee0 R08: ffff880ef60b15c8 R09: 0000000000000000
>[ 8804.616800] R10: 0000000000000000 R11: 0000000000000004 R12: 00000000000000dc
>[ 8804.616801] R13: ffffffff81031030 R14: 0000000000000000 R15: 000000000000001d
>[ 8804.616804] FS:  00007f7cdfe9c740(0000) GS:ffff880f1fd20000(0000) knlGS:0000000000000000
>[ 8804.616805] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616807] CR2: 00007f7cdfe4c000 CR3: 0000000eed7e9000 CR4: 00000000000007e0
>[ 8804.616809] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616810] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616812] Process quad.1 (pid: 10007, threadinfo ffff880ee7526000, task ffff880ee7604560)
>[ 8804.616814] Stack:
>[ 8804.616815]  ffff880ef60b1c28 ffff880ef60b1828 ffff880ef60b1428 ffff880ef60b1028
>[ 8804.616819]  0000000000000013 ffff880f1fd23ea0 ffff880f1fd23ea0 ffff880f1fd23ea0
>[ 8804.616823]  ffff880ee7604560 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616827] Call Trace:
>[ 8804.616828]  <IRQ> 
>[ 8804.616830] 
>[ 8804.616832]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616835]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616838]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616842]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616844]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616847]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616850]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616852]  <EOI> 
>[ 8804.616853] 
>[ 8804.616856]  [<ffffffff8163e059>] ? system_call_fastpath+0x16/0x1b
>[ 8804.616857] Code: 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 <48> 89 42 28 48 89 40 08 66 90 4c 8b 65 c0 4c 3b 65 b8 0f 84 96 
>[ 8804.616884] NMI backtrace for cpu 20
>[ 8804.616885] CPU 20 
>[ 8804.616888] Pid: 10026, comm: quad.73 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616890] RIP: 0010:[<ffffffff8106eea4>]  [<ffffffff8106eea4>] run_timer_softirq+0xd4/0x2b0
>[ 8804.616893] RSP: 0000:ffff880781d43e70  EFLAGS: 00000086
>[ 8804.616895] RAX: ffff880776a742b8 RBX: ffff880776a74000 RCX: ffff880781d43ea0
>[ 8804.616897] RDX: ffff880776a74290 RSI: ffff880781d43ea0 RDI: ffff880776a74000
>[ 8804.616898] RBP: ffff880781d43ee0 R08: ffff880776a755c8 R09: 0000000000000000
>[ 8804.616900] R10: 0000000000000000 R11: 00000000042b8fc0 R12: ffff880781d43ea0
>[ 8804.616901] R13: ffffffff81031030 R14: 0000000000000000 R15: 000000000000002f
>[ 8804.616903] FS:  00007f229adcb740(0000) GS:ffff880781d40000(0000) knlGS:0000000000000000
>[ 8804.616905] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.616907] CR2: 00007f229ad7b000 CR3: 000000072872f000 CR4: 00000000000007e0
>[ 8804.616908] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.616910] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.616912] Process quad.73 (pid: 10026, threadinfo ffff880ee55da000, task ffff880ee5e69720)
>[ 8804.616913] Stack:
>[ 8804.616914]  ffff880776a75c28 ffff880776a75828 ffff880776a75428 ffff880776a75028
>[ 8804.616918]  0000000000000014 ffff880781d43ea0 ffff880781d43ea0 ffff880781d43ea0
>[ 8804.616922]  ffff880ee5e69720 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.616926] Call Trace:
>[ 8804.616927]  <IRQ> 
>[ 8804.616929] 
>[ 8804.616931]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.616934]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.616937]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.616939]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.616942]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.616945]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.616948]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.616949]  <EOI> 
>[ 8804.616950] Code: 
>[ 8804.616951] 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 48 89 42 28 48 89 40 08 66 90 4c 8b 65 c0 <4c> 3b 65 b8 0f 84 96 00 00 00 49 8b 54 24 28 4d 8b 4c 24 18 4d 
>[ 8804.616983] NMI backtrace for cpu 21
>[ 8804.616984] CPU 21 
>[ 8804.616987] Pid: 10024, comm: quad.67 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.616989] RIP: 0010:[<ffffffff8106eea4>]  [<ffffffff8106eea4>] run_timer_softirq+0xd4/0x2b0
>[ 8804.616993] RSP: 0000:ffff880f1fd43e70  EFLAGS: 00000086
>[ 8804.616994] RAX: ffff880ef60fc3c8 RBX: ffff880ef60fc000 RCX: ffff880f1fd43ea0
>[ 8804.616996] RDX: ffff880ef60fc3a0 RSI: ffff880f1fd43ea0 RDI: ffff880ef60fc000
>[ 8804.616998] RBP: ffff880f1fd43ee0 R08: ffff880ef60fd5c8 R09: 0000000000000000
>[ 8804.616999] R10: 0000000000000000 R11: 0000000000000004 R12: ffff880f1fd43ea0
>[ 8804.617001] R13: ffffffff81031030 R14: 0000000000000000 R15: 000000000000008c
>[ 8804.617003] FS:  00007f77d7fc0740(0000) GS:ffff880f1fd40000(0000) knlGS:0000000000000000
>[ 8804.617005] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.617006] CR2: 00007f77d7f70000 CR3: 0000000ef36fd000 CR4: 00000000000007e0
>[ 8804.617012] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.617014] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.617016] Process quad.67 (pid: 10024, threadinfo ffff880ee5520000, task ffff880ee50b4560)
>[ 8804.617017] Stack:
>[ 8804.617018]  ffff880ef60fdc28 ffff880ef60fd828 ffff880ef60fd428 ffff880ef60fd028
>[ 8804.617022]  0000000000000015 ffff880f1fd43ea0 ffff880f1fd43ea0 ffff880f1fd43ea0
>[ 8804.617027]  ffff880ee50b4560 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.617031] Call Trace:
>[ 8804.617032]  <IRQ> 
>[ 8804.617033] 
>[ 8804.617036]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.617039]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.617042]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.617045]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.617048]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.617051]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.617055]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.617056]  <EOI> 
>[ 8804.617057] Code: 
>[ 8804.617059] 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 48 89 42 28 48 89 40 08 66 90 4c 8b 65 c0 <4c> 3b 65 b8 0f 84 96 00 00 00 49 8b 54 24 28 4d 8b 4c 24 18 4d 
>[ 8804.617086] NMI backtrace for cpu 22
>[ 8804.617088] CPU 22 
>[ 8804.617090] Pid: 10015, comm: quad.31 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.617092] RIP: 0010:[<ffffffff8106ee8f>]  [<ffffffff8106ee8f>] run_timer_softirq+0xbf/0x2b0
>[ 8804.617096] RSP: 0000:ffff880781d63e70  EFLAGS: 00000082
>[ 8804.617097] RAX: ffff880776ac4038 RBX: ffff880776ac4000 RCX: ffff880781d63ea0
>[ 8804.617099] RDX: ffff880776ac4010 RSI: ffff880781d63ea0 RDI: ffff880776ac4000
>[ 8804.617100] RBP: ffff880781d63ee0 R08: ffff880776ac55c8 R09: 0000000000000000
>[ 8804.617102] R10: 0000000000000000 R11: 0000000000000004 R12: 0000000000000001
>[ 8804.617104] R13: ffffffff81031030 R14: 0000000000000000 R15: 00000014dd3288e5
>[ 8804.617106] FS:  00007f29fe59d740(0000) GS:ffff880781d60000(0000) knlGS:0000000000000000
>[ 8804.617107] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.617109] CR2: 00007f29fe54d000 CR3: 00000007755cc000 CR4: 00000000000007e0
>[ 8804.617110] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.617112] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.617114] Process quad.31 (pid: 10015, threadinfo ffff880ee8cde000, task ffff880ef600c560)
>[ 8804.617115] Stack:
>[ 8804.617116]  ffff880776ac5c28 ffff880776ac5828 ffff880776ac5428 ffff880776ac5028
>[ 8804.617120]  0000000000000016 ffff880781d63ea0 ffff880776ac4038 ffff880781d63ea0
>[ 8804.617124]  ffff880ef600c560 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.617128] Call Trace:
>[ 8804.617129]  <IRQ> 
>[ 8804.617130] 
>[ 8804.617133]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.617135]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.617139]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.617142]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.617144]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.617147]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.617150]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.617151]  <EOI> 
>[ 8804.617153] Code: 
>[ 8804.617154] 73 01 00 00 4c 89 e2 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 48 89 4d c0 48 8b 4a 30 <48> 89 4d c8 48 89 31 48 89 42 28 48 89 40 08 66 90 4c 8b 65 c0 
>[ 8804.617182] NMI backtrace for cpu 23
>[ 8804.617184] CPU 23 
>[ 8804.617187] Pid: 10022, comm: quad.59 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[ 8804.617189] RIP: 0010:[<ffffffff8106ee87>]  [<ffffffff8106ee87>] run_timer_softirq+0xb7/0x2b0
>[ 8804.617193] RSP: 0000:ffff880f1fd63e70  EFLAGS: 00000086
>[ 8804.617195] RAX: ffff880ef61444e8 RBX: ffff880ef6144000 RCX: ffff880ef61444e8
>[ 8804.617196] RDX: ffff880ef61444c0 RSI: ffff880f1fd63ea0 RDI: ffff880ef6144000
>[ 8804.617198] RBP: ffff880f1fd63ee0 R08: ffff880ef61455c8 R09: 0000000000000000
>[ 8804.617200] R10: 0000000000000000 R11: 0000000000000004 R12: 000000000000004c
>[ 8804.617202] R13: ffffffff81031030 R14: 0000000000000000 R15: 0000000000000012
>[ 8804.617204] FS:  00007fe61b3e6740(0000) GS:ffff880f1fd60000(0000) knlGS:0000000000000000
>[ 8804.617206] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[ 8804.617207] CR2: 00007fe61b396000 CR3: 0000000ee5e50000 CR4: 00000000000007e0
>[ 8804.617209] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[ 8804.617211] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[ 8804.617213] Process quad.59 (pid: 10022, threadinfo ffff880ee5d38000, task ffff880ee50b0000)
>[ 8804.617214] Stack:
>[ 8804.617215]  ffff880ef6145c28 ffff880ef6145828 ffff880ef6145428 ffff880ef6145028
>[ 8804.617220]  0000000000000017 ffff880f1fd63ea0 ffff880f1fd63ea0 ffff880f1fd63ea0
>[ 8804.617224]  ffff880ee50b0000 0000000000000041 ffffffff81c04088 0000000000000001
>[ 8804.617228] Call Trace:
>[ 8804.617229]  <IRQ> 
>[ 8804.617231] 
>[ 8804.617233]  [<ffffffff81067000>] __do_softirq+0xd0/0x210
>[ 8804.617236]  [<ffffffff8101b903>] ? native_sched_clock+0x13/0x80
>[ 8804.617239]  [<ffffffff8163f25c>] call_softirq+0x1c/0x30
>[ 8804.617243]  [<ffffffff81016315>] do_softirq+0x75/0xb0
>[ 8804.617245]  [<ffffffff810672d5>] irq_exit+0xb5/0xc0
>[ 8804.617248]  [<ffffffff8163fbce>] smp_apic_timer_interrupt+0x6e/0x99
>[ 8804.617252]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[ 8804.617253]  <EOI> 
>[ 8804.617255] Code: 
>[ 8804.617256] 81 e4 ff 00 00 00 0f 84 73 01 00 00 4c 89 e2 48 83 43 10 01 48 8d 75 c0 48 c1 e2 04 48 01 da 48 8b 4a 28 48 8d 42 28 48 89 71 08 <48> 89 4d c0 48 8b 4a 30 48 89 4d c8 48 89 31 48 89 42 28 48 89 
>[14006.184497] SELinux: initialized (dev fuse, type fuse), uses genfs_contexts
>[14353.978822] type=1400 audit(1359313467.004:7): avc:  denied  { create } for  pid=11689 comm="npviewer.bin" name="C:\nppdf32Log\debuglog.txt" scontext=unconfined_u:unconfined_r:mozilla_plugin_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:user_home_dir_t:s0 tclass=file
>[14353.978871] type=1400 audit(1359313467.004:8): avc:  denied  { create } for  pid=11689 comm="npviewer.bin" name="C:\nppdf32Log\debuglog.txt" scontext=unconfined_u:unconfined_r:mozilla_plugin_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:user_home_dir_t:s0 tclass=file
>[14353.978941] type=1400 audit(1359313467.004:9): avc:  denied  { create } for  pid=11689 comm="npviewer.bin" name="C:\nppdf32Log\debuglog.txt" scontext=unconfined_u:unconfined_r:mozilla_plugin_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:user_home_dir_t:s0 tclass=file
>[16406.233971] usb 1-6: new high-speed USB device number 3 using ehci_hcd
>[16406.348592] usb 1-6: New USB device found, idVendor=1976, idProduct=4082
>[16406.348595] usb 1-6: New USB device strings: Mfr=1, Product=2, SerialNumber=3
>[16406.348598] usb 1-6: Product: USB Reader
>[16406.348600] usb 1-6: Manufacturer: ChipsBnk
>[16406.348601] usb 1-6: SerialNumber: 110074973765
>[16406.378333] Initializing USB Mass Storage driver...
>[16406.379639] scsi7 : usb-storage 1-6:1.0
>[16406.379767] usbcore: registered new interface driver usb-storage
>[16406.379769] USB Mass Storage support registered.
>[16407.380053] scsi 7:0:0:0: Direct-Access     ChipsBnk   Multi-Reader   4082 PQ: 0 ANSI: 2
>[16407.380920] sd 7:0:0:0: Attached scsi generic sg3 type 0
>[16407.382907] sd 7:0:0:0: [sdb] 15523840 512-byte logical blocks: (7.94 GB/7.40 GiB)
>[16407.383410] sd 7:0:0:0: [sdb] Write Protect is on
>[16407.383414] sd 7:0:0:0: [sdb] Mode Sense: 0b 00 80 08
>[16407.383902] sd 7:0:0:0: [sdb] No Caching mode page present
>[16407.383906] sd 7:0:0:0: [sdb] Assuming drive cache: write through
>[16407.387642] sd 7:0:0:0: [sdb] No Caching mode page present
>[16407.387645] sd 7:0:0:0: [sdb] Assuming drive cache: write through
>[16407.391141]  sdb: sdb1
>[16407.393382] sd 7:0:0:0: [sdb] No Caching mode page present
>[16407.393385] sd 7:0:0:0: [sdb] Assuming drive cache: write through
>[16407.393388] sd 7:0:0:0: [sdb] Attached SCSI removable disk
>[16427.161861] SELinux: initialized (dev sdb1, type vfat), uses genfs_contexts
>[16548.929837] sdb: detected capacity change from 7948206080 to 0
>[16557.364224] usb 1-6: USB disconnect, device number 3
>[16900.070926] ------------[ cut here ]------------
>[16900.070939] WARNING: at kernel/watchdog.c:245 watchdog_overflow_callback+0x9c/0xd0()
>[16900.070941] Hardware name: ProLiant DL380 G7
>[16900.070943] Watchdog detected hard LOCKUP on cpu 17
>[16900.070944] Modules linked in:
>[16900.070946]  vfat fat usb_storage fuse nf_conntrack_netbios_ns nf_conntrack_broadcast be2iscsi iscsi_boot_sysfs ipt_MASQUERADE bnx2i cnic uio cxgb4i cxgb4 cxgb3i cxgb3 mdio libcxgbi ib_iser rdma_cm ib_addr iw_cm ib_cm ib_sa ib_mad ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip6table_mangle ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat iptable_mangle nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables binfmt_misc iTCO_wdt i7core_edac iTCO_vendor_support edac_core lpc_ich hpwdt mfd_core coretemp hpilo kvm_intel kvm acpi_power_meter microcode uinput nfsd auth_rpcgss nfs_acl lockd radeon i2c_algo_bit drm_kms_helper ttm drm crc32c_intel ghash_clmulni_intel i2c_core bnx2 hpsa sunrpc
>[16900.070999] Pid: 10010, comm: quad.13 Tainted: G        W    3.7.4-204.fc18.x86_64 #1
>[16900.071001] Call Trace:
>[16900.071003]  <NMI>  [<ffffffff8105e67f>] warn_slowpath_common+0x7f/0xc0
>[16900.071015]  [<ffffffff8105e776>] warn_slowpath_fmt+0x46/0x50
>[16900.071018]  [<ffffffff810eb420>] ? touch_nmi_watchdog+0x80/0x80
>[16900.071021]  [<ffffffff810eb4bc>] watchdog_overflow_callback+0x9c/0xd0
>[16900.071027]  [<ffffffff81126d1d>] __perf_event_overflow+0x9d/0x230
>[16900.071032]  [<ffffffff81024e97>] ? x86_perf_event_set_period+0xd7/0x160
>[16900.071035]  [<ffffffff81127924>] perf_event_overflow+0x14/0x20
>[16900.071040]  [<ffffffff8102a85e>] intel_pmu_handle_irq+0x1ae/0x330
>[16900.071046]  [<ffffffff81016814>] ? show_regs+0x94/0x270
>[16900.071053]  [<ffffffff816375cd>] perf_event_nmi_handler+0x1d/0x20
>[16900.071061]  [<ffffffff81636d91>] nmi_handle.isra.0+0x51/0x80
>[16900.071069]  [<ffffffff81636ea0>] do_nmi+0xe0/0x350
>[16900.071076]  [<ffffffff816363b0>] end_repeat_nmi+0x1e/0x2e
>[16900.071078]  <<EOE>> 
>[16900.071079] ---[ end trace 20e1d02cece8513e ]---
>[16944.128598] INFO: rcu_sched detected stalls on CPUs/tasks: { 17} (detected by 0, t=60002 jiffies)
>[16944.128604] sending NMI to all CPUs:
>[16944.128613] NMI backtrace for cpu 0
>[16944.128614] CPU 0 
>[16944.128618] Pid: 10021, comm: quad.53 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.128620] RIP: 0010:[<ffffffff81039889>]  [<ffffffff81039889>] default_send_IPI_mask_sequence_phys+0x79/0x100
>[16944.128627] RSP: 0000:ffff880781c03d98  EFLAGS: 00000046
>[16944.128629] RAX: ffff880f1fc00000 RBX: 000000000000b03a RCX: 0000000000000001
>[16944.128631] RDX: 0000000000000001 RSI: 0000000000000020 RDI: 0000000000000080
>[16944.128632] RBP: ffff880781c03dd8 R08: ffffffff81cdc590 R09: 0000000000000000
>[16944.128634] R10: 0000000000000000 R11: 0000000000000a51 R12: ffffffff81cdc590
>[16944.128636] R13: 0000000000000400 R14: 0000000000000092 R15: 0000000000000002
>[16944.128638] FS:  00007f3ea5239740(0000) GS:ffff880781c00000(0000) knlGS:0000000000000000
>[16944.128640] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.128641] CR2: 00007f174402f000 CR3: 0000000ee564f000 CR4: 00000000000007f0
>[16944.128643] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.128645] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.128647] Process quad.53 (pid: 10021, threadinfo ffff880ee5d12000, task ffff880ef22b5c80)
>[16944.128648] Stack:
>[16944.128649]  ffffffff00000000 0000000000000000 ffff880781c03df8 0000000000002710
>[16944.128655]  0000000000000000 ffff880ee5d12000 ffffffff81c3c6c0 ffffffff81c3c600
>[16944.128659]  ffff880781c03de8 ffffffff8103d887 ffff880781c03e08 ffffffff81039a8d
>[16944.128663] Call Trace:
>[16944.128665]  <IRQ> 
>[16944.128667] 
>[16944.128671]  [<ffffffff8103d887>] physflat_send_IPI_all+0x17/0x20
>[16944.128674]  [<ffffffff81039a8d>] arch_trigger_all_cpu_backtrace+0x5d/0xa0
>[16944.128679]  [<ffffffff810f5435>] rcu_check_callbacks+0x5b5/0x650
>[16944.128683]  [<ffffffff8106fa48>] update_process_times+0x48/0x90
>[16944.128687]  [<ffffffff810b61ae>] tick_sched_timer+0x6e/0xe0
>[16944.128690]  [<ffffffff81086123>] __run_hrtimer+0x73/0x1d0
>[16944.128694]  [<ffffffff810b6140>] ? tick_nohz_handler+0x110/0x110
>[16944.128698]  [<ffffffff81067066>] ? __do_softirq+0x136/0x210
>[16944.128701]  [<ffffffff81086a47>] hrtimer_interrupt+0xf7/0x230
>[16944.128705]  [<ffffffff8163fbc9>] smp_apic_timer_interrupt+0x69/0x99
>[16944.128710]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[16944.128711]  <EOI> 
>[16944.128713] Code: 
>[16944.128714] 00 00 4c 89 e7 48 63 d2 e8 f5 e8 2b 00 89 c2 48 63 05 30 3e ca 00 48 39 c2 73 55 48 8b 04 d5 a0 ae cd 81 41 83 ff 02 0f b7 34 03 <74> 5c 8b 04 25 00 a3 5f ff f6 c4 10 74 17 66 0f 1f 84 00 00 00 
>[16944.128744] NMI backtrace for cpu 1
>[16944.128747] CPU 1 
>[16944.128751] Pid: 10020, comm: quad.49 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.128753] RIP: 0033:[<0000000000400fb5>]  [<0000000000400fb5>] 0x400fb4
>[16944.128770] RSP: 002b:00007fff9f9d0710  EFLAGS: 00000206
>[16944.128772] RAX: 0000000000029d77 RBX: 1f7f0c53ad7e7978 RCX: 0000000000ff4c30
>[16944.128773] RDX: 0000000000000017 RSI: 00000000000014eb RDI: 000000000000005a
>[16944.128775] RBP: 0000006d20be53bb R08: 00000001fe4bcc7a R09: 0000000000000f00
>[16944.128777] R10: 0000000000001c26 R11: 0000000000000d8e R12: 0000006d20be53bd
>[16944.128779] R13: 2f8c49af6d4e09bb R14: 0000006d20be53ba R15: 0000006d20be53bf
>[16944.128781] FS:  00007f2ccb02b740(0000) GS:ffff880f1fc00000(0000) knlGS:0000000000000000
>[16944.128783] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.128785] CR2: 00000000006e2b98 CR3: 0000000ee5d80000 CR4: 00000000000007e0
>[16944.128786] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.128788] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.128790] Process quad.49 (pid: 10020, threadinfo ffff880ee87e2000, task ffff880ef32f0000)
>[16944.128791] 
>[16944.128843] NMI backtrace for cpu 2
>[16944.128845] CPU 2 
>[16944.128848] Pid: 10025, comm: quad.71 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.128850] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[16944.128867] RSP: 002b:00007fff01f2eac0  EFLAGS: 00000206
>[16944.128869] RAX: 00000000000a34c6 RBX: 00007f7c7479b010 RCX: 0000000000000017
>[16944.128870] RDX: 00000000000024e5 RSI: 0000000001361c30 RDI: 000000000005980f
>[16944.128872] RBP: 0000000000800000 R08: 0000000000000001 R09: 0000000000007a26
>[16944.128874] R10: 00007f7c7481c010 R11: 000000000000d9cd R12: 0000000000000030
>[16944.128876] R13: f4f2d97fdf57e1dd R14: 0000006e9f277f0a R15: 0000006e9f277f31
>[16944.128878] FS:  00007f7c7489e740(0000) GS:ffff880781c20000(0000) knlGS:0000000000000000
>[16944.128880] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.128881] CR2: 00007f7c74888000 CR3: 0000000ee7653000 CR4: 00000000000007e0
>[16944.128883] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.128885] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.128887] Process quad.71 (pid: 10025, threadinfo ffff880ee5dae000, task ffff880ee5e68000)
>[16944.128888] 
>[16944.128943] NMI backtrace for cpu 3
>[16944.128945] CPU 3 
>[16944.128948] Pid: 10026, comm: quad.73 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.128950] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[16944.128956] RSP: 002b:00007fff42211af0  EFLAGS: 00000a03
>[16944.128958] RAX: 23ce03854f5425dd RBX: 23721475df41e3fa RCX: 00000000000031ad
>[16944.128960] RDX: 00000004f39d495b RSI: 00000066a479d39d RDI: 0000002db495ce8d
>[16944.128962] RBP: 23ce03854f5425dd R08: 00000061e2016135 R09: 00000061e2016135
>[16944.128963] R10: 0000000000001298 R11: 00000000000031ad R12: 0000006dc276543f
>[16944.128965] R13: 9f71f6b5da0b9bbf R14: 0000006dc276543e R15: 0000000000001253
>[16944.128967] FS:  00007f229adcb740(0000) GS:ffff880f1fc20000(0000) knlGS:0000000000000000
>[16944.128969] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.128970] CR2: 0000003fea6bb750 CR3: 000000072872f000 CR4: 00000000000007e0
>[16944.128972] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.128974] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.128975] Process quad.73 (pid: 10026, threadinfo ffff880ee55da000, task ffff880ee5e69720)
>[16944.128977] 
>[16944.129042] NMI backtrace for cpu 4
>[16944.129045] CPU 4 
>[16944.129048] Pid: 10012, comm: quad.19 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129050] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[16944.129056] RSP: 002b:00007fff03c73650  EFLAGS: 00000202
>[16944.129058] RAX: 000000000008666a RBX: 00007ffe77c4b010 RCX: 000000000000001b
>[16944.129060] RDX: 000000000000432b RSI: 0000000000777c30 RDI: 00000000000000ef
>[16944.129062] RBP: 0000000008000000 R08: 0000000000000001 R09: 0000000000000032
>[16944.129063] R10: 00007ffe77ccc010 R11: 000000000000d931 R12: 0000006df787ec8f
>[16944.129065] R13: 92f3e0166fe24209 R14: 0000006df787ec8c R15: 0000006df787ec91
>[16944.129067] FS:  00007ffe77d4e740(0000) GS:ffff880781c40000(0000) knlGS:0000000000000000
>[16944.129069] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.129071] CR2: 00007fbfcb578000 CR3: 0000000728486000 CR4: 00000000000007e0
>[16944.129073] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129074] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129076] Process quad.19 (pid: 10012, threadinfo ffff880ee5204000, task ffff880ef2f8dc80)
>[16944.129078] 
>[16944.129143] NMI backtrace for cpu 5
>[16944.129146] CPU 5 
>[16944.129149] Pid: 10016, comm: quad.37 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129151] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[16944.129159] RSP: 002b:00007fff110c3e10  EFLAGS: 00000206
>[16944.129160] RAX: 0000000000090467 RBX: 00007f22a5e04010 RCX: 000000000000001e
>[16944.129162] RDX: 0000000000004821 RSI: 0000000001139c30 RDI: 0000000000000029
>[16944.129164] RBP: 0000000040000000 R08: 0000000000000001 R09: 000000000000000b
>[16944.129165] R10: 00007f22a5e85010 R11: 000000000000d8dc R12: 0000006d998f00e5
>[16944.129167] R13: 5d9fe982d0ef85b5 R14: 0000006d998f00e2 R15: 0000006d998f0101
>[16944.129169] FS:  00007f22a5f07740(0000) GS:ffff880f1fc40000(0000) knlGS:0000000000000000
>[16944.129171] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.129172] CR2: 000000000135b6c8 CR3: 0000000775d73000 CR4: 00000000000007e0
>[16944.129174] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129176] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129178] Process quad.37 (pid: 10016, threadinfo ffff880ee5de4000, task ffff880ef6b2c560)
>[16944.129179] 
>[16944.129242] NMI backtrace for cpu 6
>[16944.129244] CPU 6 
>[16944.129248] Pid: 10011, comm: quad.17 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129249] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[16944.129256] RSP: 002b:00007fffd2a7ced0  EFLAGS: 00000202
>[16944.129258] RAX: 0000000000084ecc RBX: 00007fdaa6ce4010 RCX: 0000000000000009
>[16944.129259] RDX: 0000000000004276 RSI: 0000000001ea0c30 RDI: 0000000000000003
>[16944.129261] RBP: 0000000000000200 R08: 0000000000000001 R09: 0000000000000000
>[16944.129263] R10: 00007fdaa6d65010 R11: 000000000000d9e0 R12: 0000006eb6158d83
>[16944.129265] R13: 63c5a61ef866c983 R14: 0000006eb6158d80 R15: 0000006eb6158d85
>[16944.129267] FS:  00007fdaa6de7740(0000) GS:ffff880781c60000(0000) knlGS:0000000000000000
>[16944.129269] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[16944.129271] CR2: 00007fdaa6dd1000 CR3: 000000072877f000 CR4: 00000000000007e0
>[16944.129272] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129274] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129276] Process quad.17 (pid: 10011, threadinfo ffff880ef1c6a000, task ffff880ef25bdc80)
>[16944.129277] 
>[16944.129343] NMI backtrace for cpu 7
>[16944.129345] CPU 7 
>[16944.129348] Pid: 10008, comm: quad.7 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129350] RIP: 0033:[<0000000000401261>]  [<0000000000401261>] 0x401260
>[16944.129357] RSP: 002b:00007fff4c37a3d0  EFLAGS: 00000297
>[16944.129359] RAX: 0000004882e127a2 RBX: 2efefe80b536575f RCX: 0000006867e30d7c
>[16944.129361] RDX: 00000026169881bf RSI: ffffffd9e9679a7d RDI: 000000639a8aa2f9
>[16944.129363] RBP: 6c5976e4fbc30792 R08: 00000000000022d2 R09: 0000000000001c3c
>[16944.129365] R10: 00000000000022d2 R11: 000000000000314c R12: 0000006e99798d25
>[16944.129367] R13: fd672798fe9dc6ad R14: 0000006e99798d24 R15: 0000000000000555
>[16944.129369] FS:  00007f3f63c59740(0000) GS:ffff880f1fc60000(0000) knlGS:0000000000000000
>[16944.129371] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.129373] CR2: 0000003fea6797d0 CR3: 00000007755a1000 CR4: 00000000000007e0
>[16944.129375] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129377] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129379] Process quad.7 (pid: 10008, threadinfo ffff880ee8f34000, task ffff880ee7605c80)
>[16944.129380] 
>[16944.129442] NMI backtrace for cpu 8
>[16944.129445] CPU 8 
>[16944.129448] Pid: 10015, comm: quad.31 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129450] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[16944.129456] RSP: 002b:00007fffd392bda0  EFLAGS: 00000a03
>[16944.129458] RAX: 3eb4850c13d277ff RBX: 2fca5fd3cf7df96f RCX: 000000000000120d
>[16944.129460] RDX: 00000033598e82ec RSI: 0000002a446aca42 RDI: 0000003327b54a3f
>[16944.129462] RBP: 3eb4850c13d277ff R08: 000000959be0de98 R09: 00000027dbdcede7
>[16944.129463] R10: 0000000000002f86 R11: 000000000000120d R12: 0000006dc003f0b1
>[16944.129465] R13: 5ddb7c3d85445851 R14: 0000006dc003f0b0 R15: 0000000000000872
>[16944.129467] FS:  00007f29fe59d740(0000) GS:ffff880781c80000(0000) knlGS:0000000000000000
>[16944.129469] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.129471] CR2: 00007f29fe587000 CR3: 00000007755cc000 CR4: 00000000000007e0
>[16944.129473] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129474] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129476] Process quad.31 (pid: 10015, threadinfo ffff880ee8cde000, task ffff880ef600c560)
>[16944.129477] 
>[16944.129542] NMI backtrace for cpu 9
>[16944.129545] CPU 9 
>[16944.129548] Pid: 10027, comm: quad.77 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129550] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[16944.129557] RSP: 002b:00007fffe107ea40  EFLAGS: 00000202
>[16944.129558] RAX: 000000000000d732 RBX: 00007f7f2aadf010 RCX: 0000000000000009
>[16944.129560] RDX: 00000000000006b7 RSI: 0000000000fd1c30 RDI: 0000000000000049
>[16944.129562] RBP: 0000000000000200 R08: 0000000000000001 R09: 0000000000000013
>[16944.129565] R10: 00007f7f2ab60010 R11: 000000000000d864 R12: 0000000000000048
>[16944.129567] R13: 06a825153bf83d31 R14: 0000006d1a07fc18 R15: 0000006d1a07fc51
>[16944.129569] FS:  00007f7f2abe2740(0000) GS:ffff880f1fc80000(0000) knlGS:0000000000000000
>[16944.129570] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.129572] CR2: 00007f7f2abcc000 CR3: 0000000ee5a3c000 CR4: 00000000000007e0
>[16944.129573] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129575] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129577] Process quad.77 (pid: 10027, threadinfo ffff880ee7576000, task ffff880ee5e6ae40)
>[16944.129578] 
>[16944.129643] NMI backtrace for cpu 10
>[16944.129652] CPU 10 
>[16944.129661] Pid: 10019, comm: quad.47 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129671] RIP: 0033:[<0000000000401240>]  [<0000000000401240>] 0x40123f
>[16944.129688] RSP: 002b:00007fffb25fb250  EFLAGS: 00000217
>[16944.129698] RAX: 00000018a06f7d91 RBX: 7bd53c465bf4f95c RCX: 000000433a194b15
>[16944.129706] RDX: 000000544ecf549a RSI: 0000003e1edaf213 RDI: ffffffabb130ac56
>[16944.129715] RBP: d87a6bace0f9d8b0 R08: 00000000000000f0 R09: 00000010ad6e8f43
>[16944.129724] R10: 0000000000000c4f R11: 0000000000001b54 R12: 0000006cef3ed13b
>[16944.129734] R13: 60172a04fb87dff3 R14: 0000006cef3ed13a R15: 000000000000037f
>[16944.129743] FS:  00007f98e8d49740(0000) GS:ffff880781ca0000(0000) knlGS:0000000000000000
>[16944.129752] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.129760] CR2: 00007f98e8d33000 CR3: 0000000ef579a000 CR4: 00000000000007e0
>[16944.129769] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129778] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129783] Process quad.47 (pid: 10019, threadinfo ffff880ee5d76000, task ffff880ee8901720)
>[16944.129784] 
>[16944.129787] NMI backtrace for cpu 11
>[16944.129789] CPU 11 
>[16944.129793] Pid: 10030, comm: quad.89 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129795] RIP: 0033:[<000000000040120e>]  [<000000000040120e>] 0x40120d
>[16944.129801] RSP: 002b:00007fffa41223d0  EFLAGS: 00000206
>[16944.129803] RAX: 7ff421f3c2d669c4 RBX: 56555f6692195504 RCX: 0000000000001c3c
>[16944.129805] RDX: 0000000000002d45 RSI: 000000525aca85da RDI: 00000057bf588340
>[16944.129807] RBP: 7ff421f3c2d669c4 R08: 0000006d1a1f1210 R09: 0000000031d35f29
>[16944.129809] R10: 0000000000004980 R11: 0000000000001c3c R12: 0000006ce84bb2e7
>[16944.129811] R13: 7cbef372235540d7 R14: 0000006ce84bb2e6 R15: 0000000000001c3a
>[16944.129813] FS:  00007fe38119d740(0000) GS:ffff880f1fca0000(0000) knlGS:0000000000000000
>[16944.129815] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.129817] CR2: 00007fe381187000 CR3: 0000000ee711d000 CR4: 00000000000007e0
>[16944.129819] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129820] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129822] Process quad.89 (pid: 10030, threadinfo ffff880ee5d5e000, task ffff880ee7538000)
>[16944.129824] 
>[16944.129842] NMI backtrace for cpu 12
>[16944.129843] CPU 12 
>[16944.129846] Pid: 10024, comm: quad.67 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129848] RIP: 0033:[<000000000040fb9c>]  [<000000000040fb9c>] 0x40fb9b
>[16944.129854] RSP: 002b:00007fff4ab1e610  EFLAGS: 00000203
>[16944.129856] RAX: 00000000000a4397 RBX: 00007f77d7ebd010 RCX: 00000000000a4397
>[16944.129857] RDX: 000000000000521c RSI: 0000000001433c30 RDI: 0000000000000005
>[16944.129859] RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000001
>[16944.129860] R10: 00007f77d7f3e010 R11: 000000000000d84f R12: 0000000000000020
>[16944.129862] R13: 631e97070d754a83 R14: 0000006d0288d458 R15: 0000006d0288d491
>[16944.129864] FS:  00007f77d7fc0740(0000) GS:ffff880781cc0000(0000) knlGS:0000000000000000
>[16944.129866] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[16944.129867] CR2: 00007fc14510a000 CR3: 0000000ef36fd000 CR4: 00000000000007e0
>[16944.129869] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129870] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129872] Process quad.67 (pid: 10024, threadinfo ffff880ee5520000, task ffff880ee50b4560)
>[16944.129873] 
>[16944.129942] NMI backtrace for cpu 13
>[16944.129943] CPU 13 
>[16944.129946] Pid: 10018, comm: quad.43 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.129948] RIP: 0033:[<0000000000400fbd>]  [<0000000000400fbd>] 0x400fbc
>[16944.129953] RSP: 002b:00007fffc3c95020  EFLAGS: 00000207
>[16944.129955] RAX: 00000000000a3631 RBX: 3cd201c71ea42f11 RCX: 00000000fffbdfbf
>[16944.129957] RDX: 0000000000000011 RSI: 00000000000051b1 RDI: 000000000000005a
>[16944.129958] RBP: 0000006e7f47785f R08: 0000001b025d3f36 R09: 0000000000000ac5
>[16944.129960] R10: 0000000000000a71 R11: 0000000000000857 R12: 0000006e7f477861
>[16944.129962] R13: 6590d7ca973097c1 R14: 0000006e7f47785e R15: 0000006e7f477867
>[16944.129964] FS:  00007fbdccb72740(0000) GS:ffff880f1fcc0000(0000) knlGS:0000000000000000
>[16944.129966] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.129968] CR2: 00007fbdccb5c000 CR3: 00000007286ba000 CR4: 00000000000007e0
>[16944.129969] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.129971] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.129973] Process quad.43 (pid: 10018, threadinfo ffff880eed742000, task ffff880ef609c560)
>[16944.129974] 
>[16944.130043] NMI backtrace for cpu 14
>[16944.130052] CPU 14 
>[16944.130061] Pid: 10007, comm: quad.1 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130069] RIP: 0033:[<00000000004011ff>]  [<00000000004011ff>] 0x4011fe
>[16944.130088] RSP: 002b:00007fff7c59e3e0  EFLAGS: 00000293
>[16944.130097] RAX: 058c9db1d5ca21bb RBX: afcd053dd483d1b6 RCX: 000000207c5730e3
>[16944.130100] RDX: 0000000000000014 RSI: 00000059346b9575 RDI: 00000023603c3e6a
>[16944.130102] RBP: 058c9db1d5ca21bb R08: 0000002511177ad1 R09: ffffffb76dba55dc
>[16944.130104] R10: 0000000000000c68 R11: 0000000000001073 R12: 0000006da35d24f5
>[16944.130106] R13: f424f1cba13f675d R14: 0000006da35d24f4 R15: 0000000000000c53
>[16944.130108] FS:  00007f7cdfe9c740(0000) GS:ffff880781ce0000(0000) knlGS:0000000000000000
>[16944.130110] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.130112] CR2: 00007f7cdfe86000 CR3: 0000000eed7e9000 CR4: 00000000000007e0
>[16944.130114] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130116] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130118] Process quad.1 (pid: 10007, threadinfo ffff880ee7526000, task ffff880ee7604560)
>[16944.130119] 
>[16944.130142] NMI backtrace for cpu 15
>[16944.130144] CPU 15 
>[16944.130147] Pid: 10009, comm: quad.11 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130149] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[16944.130155] RSP: 002b:00007fffcf504790  EFLAGS: 00000206
>[16944.130157] RAX: 000000000006e2b6 RBX: 00007fcea50f9010 RCX: 0000000000000009
>[16944.130158] RDX: 0000000000003715 RSI: 00000000009f0c30 RDI: 000000000000000d
>[16944.130160] RBP: 0000000000000200 R08: 0000000000000001 R09: 0000000000000004
>[16944.130162] R10: 00007fcea517a010 R11: 000000000000d931 R12: 0000006df859a799
>[16944.130164] R13: dab91abcc12e7231 R14: 0000006df859a796 R15: 0000006df859a7e5
>[16944.130166] FS:  00007fcea51fc740(0000) GS:ffff880f1fce0000(0000) knlGS:0000000000000000
>[16944.130168] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[16944.130169] CR2: 00007fcea51e6000 CR3: 000000072f914000 CR4: 00000000000007e0
>[16944.130171] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130173] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130175] Process quad.11 (pid: 10009, threadinfo ffff880ee5e56000, task ffff880ee7602e40)
>[16944.130176] 
>[16944.130242] NMI backtrace for cpu 16
>[16944.130244] CPU 16 
>[16944.130247] Pid: 10017, comm: quad.41 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130248] RIP: 0033:[<0000000000400fa9>]  [<0000000000400fa9>] 0x400fa8
>[16944.130255] RSP: 002b:00007ffff44fe870  EFLAGS: 00000297
>[16944.130256] RAX: 000000000003c5c6 RBX: 79178f08d08128ee RCX: 0000000001544c30
>[16944.130258] RDX: 00000000000a81fa RSI: 0000000000001e2e RDI: 0000000005edffcd
>[16944.130260] RBP: 0000006e69786fa7 R08: 000000491f3d2524 R09: 00000000000016ad
>[16944.130261] R10: 0000000000001983 R11: 0000000000001d6b R12: 0000006e69786fa9
>[16944.130263] R13: 217173290a54e02d R14: 0000006e69786fa6 R15: 0000006e69786fbd
>[16944.130265] FS:  00007f4ecf4fd740(0000) GS:ffff880781d00000(0000) knlGS:0000000000000000
>[16944.130267] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.130269] CR2: 00007f4ecf4e7000 CR3: 00000007284f6000 CR4: 00000000000007e0
>[16944.130278] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130287] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130296] Process quad.41 (pid: 10017, threadinfo ffff880ee754c000, task ffff880ef2e64560)
>[16944.130304] 
>[16944.130342] NMI backtrace for cpu 17
>[16944.130347] CPU 17 
>[16944.130352] Pid: 10010, comm: quad.13 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130356] RIP: 0033:[<000000000040fb90>]  [<000000000040fb90>] 0x40fb8f
>[16944.130367] RSP: 002b:00007fff18a2cc80  EFLAGS: 00000206
>[16944.130371] RAX: 000000000005ca86 RBX: 00007f0c45615010 RCX: 0000000000000011
>[16944.130376] RDX: 00000000000a757c RSI: 000000000108bc30 RDI: 0000000000002975
>[16944.130379] RBP: 0000000000020000 R08: 0000000000000001 R09: 000000000000050d
>[16944.130383] R10: 00007f0c45696010 R11: 000000000000d8aa R12: 00000000000000b8
>[16944.130386] R13: 1e942c70d03d467b R14: 0000006d6385a90a R15: 0000006d6385a919
>[16944.130390] FS:  00007f0c45718740(0000) GS:ffff880f1fd00000(0000) knlGS:0000000000000000
>[16944.130394] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[16944.130397] CR2: 00007f0c45702000 CR3: 0000000ee55e2000 CR4: 00000000000007e0
>[16944.130400] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130402] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130403] Process quad.13 (pid: 10010, threadinfo ffff880ee71f0000, task ffff880ee7601720)
>[16944.130404] 
>[16944.130441] NMI backtrace for cpu 18
>[16944.130443] CPU 18 
>[16944.130446] Pid: 10013, comm: quad.23 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130448] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[16944.130454] RSP: 002b:00007fff63b17ff0  EFLAGS: 00000206
>[16944.130455] RAX: 000000000009ddba RBX: 00007fc7b2036010 RCX: 0000000000000017
>[16944.130457] RDX: 0000000000004eed RSI: 00000000014a2c30 RDI: 0000000000000003
>[16944.130458] RBP: 0000000000800000 R08: 0000000000000001 R09: 0000000000000000
>[16944.130460] R10: 00007fc7b20b7010 R11: 000000000000d993 R12: 0000006e5fd64c03
>[16944.130461] R13: dc23e68ee500b853 R14: 0000006e5fd64c00 R15: 0000006e5fd64c11
>[16944.130463] FS:  00007fc7b2139740(0000) GS:ffff880781d20000(0000) knlGS:0000000000000000
>[16944.130465] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[16944.130467] CR2: 0000000000cea1f8 CR3: 00000007259a1000 CR4: 00000000000007e0
>[16944.130468] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130470] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130472] Process quad.23 (pid: 10013, threadinfo ffff880eed482000, task ffff880ee5568000)
>[16944.130473] 
>[16944.130541] NMI backtrace for cpu 19
>[16944.130543] CPU 19 
>[16944.130546] Pid: 10023, comm: quad.61 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130548] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[16944.130552] RSP: 002b:00007fff52029e30  EFLAGS: 00000a17
>[16944.130554] RAX: 03de5a2d3a301c3a RBX: f354119d8cd29d12 RCX: 0000000000001f7a
>[16944.130556] RDX: 0000005480205ef8 RSI: 00000007f96c84a7 RDI: 00000047c4d0a9df
>[16944.130558] RBP: 03de5a2d3a301c3a R08: 0000008d2489b926 R09: 00000020106e4275
>[16944.130560] R10: 0000000000000de3 R11: 0000000000001f7a R12: 0000006d141b76b1
>[16944.130561] R13: 9f941a45a0271251 R14: 0000006d141b76b0 R15: 000000000000023c
>[16944.130564] FS:  00007fce4f642740(0000) GS:ffff880f1fd20000(0000) knlGS:0000000000000000
>[16944.130565] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.130567] CR2: 00007fce4f62c000 CR3: 0000000ef3d1e000 CR4: 00000000000007e0
>[16944.130569] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130570] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130572] Process quad.61 (pid: 10023, threadinfo ffff880ef27fc000, task ffff880ee50b1720)
>[16944.130574] 
>[16944.130644] NMI backtrace for cpu 20
>[16944.130653] CPU 20 
>[16944.130662] Pid: 10029, comm: quad.83 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130671] RIP: 0033:[<0000000000401236>]  [<0000000000401236>] 0x401235
>[16944.130687] RSP: 002b:00007fff1f727100  EFLAGS: 00000a17
>[16944.130696] RAX: b54c0c1bdea17fdb RBX: 274cc4caa8bffb68 RCX: 00000058b0f5fdf7
>[16944.130706] RDX: 000000092c60ba5c RSI: 00000029d86e87b4 RDI: 0000000000001105
>[16944.130710] RBP: a551ab0024d5fe7d R08: 0000000000001105 R09: 0000005c1f7636df
>[16944.130712] R10: 00000000000008e5 R11: 0000000000001da0 R12: 0000006dc4c15645
>[16944.130713] R13: 39094553923b4c8d R14: 0000006dc4c15644 R15: 00000000000007bb
>[16944.130716] FS:  00007f3d4a262740(0000) GS:ffff880781d40000(0000) knlGS:0000000000000000
>[16944.130717] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.130719] CR2: 00007f3d4a24c000 CR3: 0000000ef435f000 CR4: 00000000000007e0
>[16944.130721] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130723] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130725] Process quad.83 (pid: 10029, threadinfo ffff880eed508000, task ffff880ee5e6dc80)
>[16944.130726] 
>[16944.130728] NMI backtrace for cpu 21
>[16944.130730] CPU 21 
>[16944.130733] Pid: 10014, comm: quad.29 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130735] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[16944.130742] RSP: 002b:00007fff29bf4f50  EFLAGS: 00000202
>[16944.130743] RAX: 0000000000044c56 RBX: 00007f2814f88010 RCX: 0000000000000019
>[16944.130745] RDX: 000000000000225d RSI: 00000000011cfc30 RDI: 000000000000009d
>[16944.130746] RBP: 0000000002000000 R08: 0000000000000001 R09: 0000000000000023
>[16944.130747] R10: 00007f2815009010 R11: 000000000000d984 R12: 0000000000000080
>[16944.130749] R13: b0eab33b6a83046b R14: 0000006e4f578896 R15: 0000006e4f578899
>[16944.130751] FS:  00007f281508b740(0000) GS:ffff880f1fd40000(0000) knlGS:0000000000000000
>[16944.130753] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.130754] CR2: 00007f2815075000 CR3: 000000072cbb9000 CR4: 00000000000007e0
>[16944.130756] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130757] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130759] Process quad.29 (pid: 10014, threadinfo ffff880ef34a8000, task ffff880ee556ae40)
>[16944.130760] 
>[16944.130762] NMI backtrace for cpu 22
>[16944.130764] CPU 22 
>[16944.130767] Pid: 10022, comm: quad.59 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130769] RIP: 0033:[<000000000040125a>]  [<000000000040125a>] 0x401259
>[16944.130773] RSP: 002b:00007fffa5538da0  EFLAGS: 00000a17
>[16944.130775] RAX: 39d1a85c09edac69 RBX: 9deeda46af77aa9e RCX: 00000062bfecad28
>[16944.130777] RDX: 0000005690397960 RSI: 0000000000000423 RDI: 00000060f21483a3
>[16944.130779] RBP: 2ca6ea5320a1721b R08: 0000000000000c22 R09: 0000000000000423
>[16944.130780] R10: 0000000000000c22 R11: 000000000000063b R12: 0000006d80833459
>[16944.130782] R13: 5ceb93a939f0d3e9 R14: 0000006d80833458 R15: 00000000000005ae
>[16944.130784] FS:  00007fe61b3e6740(0000) GS:ffff880781d60000(0000) knlGS:0000000000000000
>[16944.130786] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.130788] CR2: 00007fe61b3d0000 CR3: 0000000ee5e50000 CR4: 00000000000007e0
>[16944.130789] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130791] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130793] Process quad.59 (pid: 10022, threadinfo ffff880ee5d38000, task ffff880ee50b0000)
>[16944.130794] 
>[16944.130843] NMI backtrace for cpu 23
>[16944.130850] CPU 23 
>[16944.130856] Pid: 10028, comm: quad.79 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[16944.130863] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[16944.130875] RSP: 002b:00007fff0acd2610  EFLAGS: 00000a13
>[16944.130881] RAX: 3b503f7e4f4f0027 RBX: 508232c49c7dc528 RCX: 0000000000001dd1
>[16944.130888] RDX: 000000681338ff14 RSI: 0000005260bb5823 RDI: 0000005877d7bf7d
>[16944.130894] RBP: 3b503f7e4f4f0027 R08: 000000222027dedb R09: 000000222027dedb
>[16944.130900] R10: 0000000000001d69 R11: 0000000000001dd1 R12: 0000006cd2750ef5
>[16944.130906] R13: 899b9c925826ad5d R14: 0000006cd2750ef4 R15: 0000000000001c77
>[16944.130912] FS:  00007fd30ad0c740(0000) GS:ffff880f1fd60000(0000) knlGS:0000000000000000
>[16944.130914] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[16944.130916] CR2: 00007fd30acf6000 CR3: 0000000ef58d8000 CR4: 00000000000007e0
>[16944.130918] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[16944.130919] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[16944.130921] Process quad.79 (pid: 10028, threadinfo ffff880ef3866000, task ffff880ee5e6c560)
>[16944.130922] 
>[17123.728147] INFO: rcu_sched detected stalls on CPUs/tasks: { 17} (detected by 16, t=240007 jiffies)
>[17123.728154] sending NMI to all CPUs:
>[17123.728161] NMI backtrace for cpu 0
>[17123.728163] CPU 0 
>[17123.728167] Pid: 10021, comm: quad.53 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728168] RIP: 0033:[<0000000000401035>]  [<0000000000401035>] 0x401034
>[17123.728187] RSP: 002b:00007fff0a16d9f0  EFLAGS: 00000246
>[17123.728188] RAX: 000000000004332c RBX: bb8c8b16454d9de6 RCX: 00000000dfffafff
>[17123.728190] RDX: 0000006f51f0b412 RSI: 0000000000002199 RDI: 000000000000005a
>[17123.728192] RBP: 0000006f51f0b447 R08: 0000002d1fd72bb3 R09: 0000000000000b9a
>[17123.728193] R10: 000000000000171b R11: 000000000000005c R12: 0000006f51f0b461
>[17123.728195] R13: 39260b14b9c3a1e5 R14: 0000006f51f0b460 R15: 0000006f51f0b461
>[17123.728197] FS:  00007f3ea5239740(0000) GS:ffff880781c00000(0000) knlGS:0000000000000000
>[17123.728199] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.728200] CR2: 00007f174402f000 CR3: 0000000ee564f000 CR4: 00000000000007f0
>[17123.728202] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728204] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728206] Process quad.53 (pid: 10021, threadinfo ffff880ee5d12000, task ffff880ef22b5c80)
>[17123.728207] 
>[17123.728210] NMI backtrace for cpu 1
>[17123.728214] CPU 1 
>[17123.728219] Pid: 10020, comm: quad.49 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728221] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[17123.728236] RSP: 002b:00007fff9f9d06e0  EFLAGS: 00000206
>[17123.728238] RAX: 000000000003f00c RBX: 00007f2ccaf28010 RCX: 000000000000001d
>[17123.728240] RDX: 0000000000001f74 RSI: 0000000000ff4c30 RDI: 000000000000016f
>[17123.728242] RBP: 0000000020000000 R08: 0000000000000001 R09: 0000000000000047
>[17123.728244] R10: 00007f2ccafa9010 R11: 000000000000da25 R12: 0000006f02bfb501
>[17123.728246] R13: dfad5c55fc41132d R14: 0000006f02bfb4fe R15: 0000006f02bfb505
>[17123.728248] FS:  00007f2ccb02b740(0000) GS:ffff880f1fc00000(0000) knlGS:0000000000000000
>[17123.728250] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17123.728252] CR2: 00007f2ccb016000 CR3: 0000000ee5d80000 CR4: 00000000000007e0
>[17123.728254] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728255] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728258] Process quad.49 (pid: 10020, threadinfo ffff880ee87e2000, task ffff880ef32f0000)
>[17123.728259] 
>[17123.728261] NMI backtrace for cpu 2
>[17123.728263] CPU 2 
>[17123.728266] Pid: 10025, comm: quad.71 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728268] RIP: 0033:[<00000000004012d2>]  [<00000000004012d2>] 0x4012d1
>[17123.728274] RSP: 002b:00007fff01f2eaf0  EFLAGS: 00000206
>[17123.728276] RAX: 000000145b76ad55 RBX: 3566bc77f0f1a3f4 RCX: 000000275a094cc1
>[17123.728278] RDX: 0000002ce0cfd35b RSI: 000000427166067f RDI: 0000002357eb5c2a
>[17123.728279] RBP: 4f303e898a385f74 R08: 0000006f2a7151c0 R09: 000000145b76ad55
>[17123.728281] R10: 0000002e15ef592a R11: 0000007087555fa9 R12: 0000007087555fa9
>[17123.728283] R13: 4be6e22e3f5fb499 R14: 0000007087555fa8 R15: 00000000000003f8
>[17123.728285] FS:  00007f7c7489e740(0000) GS:ffff880781c20000(0000) knlGS:0000000000000000
>[17123.728287] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.728288] CR2: 0000000000453b90 CR3: 0000000ee7653000 CR4: 00000000000007e0
>[17123.728290] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728292] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728294] Process quad.71 (pid: 10025, threadinfo ffff880ee5dae000, task ffff880ee5e68000)
>[17123.728295] 
>[17123.728361] NMI backtrace for cpu 3
>[17123.728363] CPU 3 
>[17123.728367] Pid: 10026, comm: quad.73 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728369] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[17123.728375] RSP: 002b:00007fff42211ac0  EFLAGS: 00000206
>[17123.728377] RAX: 00000000000b57fd RBX: 00007f229acc8010 RCX: 0000000000000014
>[17123.728379] RDX: 000000000000291a RSI: 0000000000e48c30 RDI: 00000000000634a9
>[17123.728381] RBP: 0000000000100000 R08: 0000000000000001 R09: 0000000000008631
>[17123.728382] R10: 00007f229ad49010 R11: 000000000000daaf R12: 0000006f9e88e8b3
>[17123.728384] R13: 13d192e5e34d768f R14: 0000006f9e88e8b0 R15: 0000006f9e88e911
>[17123.728386] FS:  00007f229adcb740(0000) GS:ffff880f1fc20000(0000) knlGS:0000000000000000
>[17123.728388] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.728390] CR2: 0000000000e73008 CR3: 000000072872f000 CR4: 00000000000007e0
>[17123.728392] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728393] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728395] Process quad.73 (pid: 10026, threadinfo ffff880ee55da000, task ffff880ee5e69720)
>[17123.728396] 
>[17123.728460] NMI backtrace for cpu 4
>[17123.728462] CPU 4 
>[17123.728464] Pid: 10012, comm: quad.19 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728466] RIP: 0033:[<00000000004011ce>]  [<00000000004011ce>] 0x4011cd
>[17123.728472] RSP: 002b:00007fff03c73680  EFLAGS: 00000a07
>[17123.728473] RAX: dbb3b744cc7847e2 RBX: ff69cb97a888ec97 RCX: 0000003b1b4be8b8
>[17123.728475] RDX: 0000000000002357 RSI: 0000006157c5d7ee RDI: 0000005cf2c6e557
>[17123.728477] RBP: 22b94432c26e9eef R08: 000000055d914303 R09: 00000054a16f2ee3
>[17123.728478] R10: 0000003b1b4be8b8 R11: 0000003a22b9984c R12: 0000006fe0743e01
>[17123.728479] R13: 2f24efd5668fc201 R14: 0000006fe0743e00 R15: 0000000000001895
>[17123.728481] FS:  00007ffe77d4e740(0000) GS:ffff880781c40000(0000) knlGS:0000000000000000
>[17123.728483] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.728484] CR2: 00007fbfcb578000 CR3: 0000000728486000 CR4: 00000000000007e0
>[17123.728486] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728487] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728489] Process quad.19 (pid: 10012, threadinfo ffff880ee5204000, task ffff880ef2f8dc80)
>[17123.728490] 
>[17123.728561] NMI backtrace for cpu 5
>[17123.728563] CPU 5 
>[17123.728566] Pid: 10016, comm: quad.37 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728568] RIP: 0033:[<0000000000400f80>]  [<0000000000400f80>] 0x400f7f
>[17123.728575] RSP: 002b:00007fff110c3e40  EFLAGS: 00000203
>[17123.728577] RAX: 00000000000670d5 RBX: f05f4ed056f43954 RCX: 000000007fffffe5
>[17123.728579] RDX: 0000000000000015 RSI: 0000000000003386 RDI: 000000000000005a
>[17123.728580] RBP: 0000006f8022e5b1 R08: 00000050f8317c2a R09: 00000000000011f6
>[17123.728582] R10: 0000000000001bfa R11: 00000000000017da R12: 0000006f8022e5b3
>[17123.728584] R13: 25beafaffd297a2d R14: 0000006f8022e5ae R15: 0000006f8022e5d3
>[17123.728586] FS:  00007f22a5f07740(0000) GS:ffff880f1fc40000(0000) knlGS:0000000000000000
>[17123.728588] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.728590] CR2: 0000000001164008 CR3: 0000000775d73000 CR4: 00000000000007e0
>[17123.728592] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728593] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728595] Process quad.37 (pid: 10016, threadinfo ffff880ee5de4000, task ffff880ef6b2c560)
>[17123.728596] 
>[17123.728660] NMI backtrace for cpu 6
>[17123.728662] CPU 6 
>[17123.728666] Pid: 10011, comm: quad.17 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728667] RIP: 0033:[<00000000004011e6>]  [<00000000004011e6>] 0x4011e5
>[17123.728673] RSP: 002b:00007fffd2a7cf00  EFLAGS: 00000a07
>[17123.728675] RAX: b437f80b2ed266c4 RBX: e92e6d1a0ce01680 RCX: 0000000e20ec2424
>[17123.728677] RDX: 00000000000000e3 RSI: 0000003814565983 RDI: 00000036282c0caf
>[17123.728679] RBP: 9e0fd6cba77a2510 R08: 0000000f17014a8e R09: 170aa5bfcdbd548d
>[17123.728680] R10: 00000000000004e2 R11: 00000000000000c7 R12: 00000070a3b7463b
>[17123.728682] R13: fed45ce31755a2f3 R14: 00000070a3b7463a R15: 0000000000000bdd
>[17123.728684] FS:  00007fdaa6de7740(0000) GS:ffff880781c60000(0000) knlGS:0000000000000000
>[17123.728686] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.728688] CR2: 0000000001ecb008 CR3: 000000072877f000 CR4: 00000000000007e0
>[17123.728689] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728691] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728693] Process quad.17 (pid: 10011, threadinfo ffff880ef1c6a000, task ffff880ef25bdc80)
>[17123.728694] 
>[17123.728761] NMI backtrace for cpu 7
>[17123.728763] CPU 7 
>[17123.728766] Pid: 10008, comm: quad.7 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728768] RIP: 0033:[<0000000000400f80>]  [<0000000000400f80>] 0x400f7f
>[17123.728774] RSP: 002b:00007fff4c37a3d0  EFLAGS: 00000203
>[17123.728776] RAX: 00000000000165b0 RBX: 886106b6c3c6bbcb RCX: 00000000fff5ffff
>[17123.728778] RDX: 0000000000000010 RSI: 0000000000000b2d RDI: 000000000000005a
>[17123.728780] RBP: 000000707e6a70d3 R08: 000000213e352aba R09: 0000000000000e04
>[17123.728782] R10: 0000000000000a5b R11: 0000000000001e94 R12: 000000707e6a70d5
>[17123.728783] R13: 174a25517e500f27 R14: 000000707e6a70d2 R15: 000000707e6a7131
>[17123.728786] FS:  00007f3f63c59740(0000) GS:ffff880f1fc60000(0000) knlGS:0000000000000000
>[17123.728787] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.728789] CR2: 0000003fea6797d0 CR3: 00000007755a1000 CR4: 00000000000007e0
>[17123.728791] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728793] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728795] Process quad.7 (pid: 10008, threadinfo ffff880ee8f34000, task ffff880ee7605c80)
>[17123.728796] 
>[17123.728860] NMI backtrace for cpu 8
>[17123.728862] CPU 8 
>[17123.728865] Pid: 10015, comm: quad.31 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728866] RIP: 0033:[<000000000040fba5>]  [<000000000040fba5>] 0x40fba4
>[17123.728872] RSP: 002b:00007fffd392bd70  EFLAGS: 00000206
>[17123.728874] RAX: 000000000002f60e RBX: 00007f29fe49a010 RCX: 000000000000001d
>[17123.728876] RDX: 00000000000017af RSI: 000000000146fc30 RDI: 0000000000000011
>[17123.728877] RBP: 0000000020000000 R08: 0000000000000001 R09: 0000000000000005
>[17123.728878] R10: 00007f29fe51b010 R11: 000000000000dab6 R12: 0000006fa2a972e3
>[17123.728880] R13: e5357942c65cb337 R14: 0000006fa2a972e0 R15: 0000006fa2a972e5
>[17123.728882] FS:  00007f29fe59d740(0000) GS:ffff880781c80000(0000) knlGS:0000000000000000
>[17123.728884] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17123.728885] CR2: 000000000149a008 CR3: 00000007755cc000 CR4: 00000000000007e0
>[17123.728886] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728888] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728890] Process quad.31 (pid: 10015, threadinfo ffff880ee8cde000, task ffff880ef600c560)
>[17123.728891] 
>[17123.728960] NMI backtrace for cpu 9
>[17123.728962] CPU 9 
>[17123.728965] Pid: 10027, comm: quad.77 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.728967] RIP: 0033:[<0000000000401261>]  [<0000000000401261>] 0x401260
>[17123.728974] RSP: 002b:00007fffe107ea70  EFLAGS: 00000297
>[17123.728976] RAX: 0000001ab06349f8 RBX: 8e4019b7db9084c4 RCX: 00000036d2d917d9
>[17123.728977] RDX: 000000544c18bfc7 RSI: ffffffabb3e7417d RDI: 000000123a8588c2
>[17123.728979] RBP: cccae65784beda84 R08: 00000000000002ca R09: 0000000000000144
>[17123.728981] R10: 00000000000002ca R11: 00000000000007da R12: 0000006efc7c087b
>[17123.728983] R13: c41eb311c28a96b3 R14: 0000006efc7c087a R15: 00000000000000e4
>[17123.728985] FS:  00007f7f2abe2740(0000) GS:ffff880f1fc80000(0000) knlGS:0000000000000000
>[17123.728987] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.728989] CR2: 00007f7f2abcd000 CR3: 0000000ee5a3c000 CR4: 00000000000007e0
>[17123.728990] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.728992] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.728994] Process quad.77 (pid: 10027, threadinfo ffff880ee7576000, task ffff880ee5e6ae40)
>[17123.728995] 
>[17123.729060] NMI backtrace for cpu 10
>[17123.729062] CPU 10 
>[17123.729065] Pid: 10019, comm: quad.47 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729067] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[17123.729073] RSP: 002b:00007fffb25fb250  EFLAGS: 00000a03
>[17123.729075] RAX: 8b0c7b884058efcd RBX: 2cfec8111ae6e54d RCX: 0000000000000ac3
>[17123.729076] RDX: 0000000909eacddc RSI: 000000362f6719e2 RDI: 0000002c46a260be
>[17123.729078] RBP: 8b0c7b884058efcd R08: 0000002ab6d224c0 R09: 0000002ab6d224c0
>[17123.729080] R10: 0000000000000b97 R11: 0000000000000ac3 R12: 0000006ed8ff620d
>[17123.729081] R13: 48c7274b0f58bcc5 R14: 0000006ed8ff620c R15: 000000000000095f
>[17123.729083] FS:  00007f98e8d49740(0000) GS:ffff880781ca0000(0000) knlGS:0000000000000000
>[17123.729085] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.729087] CR2: 00007f98e8d34000 CR3: 0000000ef579a000 CR4: 00000000000007e0
>[17123.729088] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729090] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729092] Process quad.47 (pid: 10019, threadinfo ffff880ee5d76000, task ffff880ee8901720)
>[17123.729093] 
>[17123.729161] NMI backtrace for cpu 11
>[17123.729170] CPU 11 
>[17123.729178] Pid: 10030, comm: quad.89 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729186] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[17123.729202] RSP: 002b:00007fffa41223d0  EFLAGS: 00000a17
>[17123.729210] RAX: 984745ffdf18fd84 RBX: 811520a301688784 RCX: 0000000000001785
>[17123.729218] RDX: 00000006d981190f RSI: 000000093a38b960 RDI: 000000530bfe8460
>[17123.729226] RBP: 984745ffdf18fd84 R08: 0000006c13b5a544 R09: 0000006c13b5a544
>[17123.729235] R10: 00000000000007f0 R11: 0000000000001785 R12: 0000006ecad154f9
>[17123.729243] R13: 0337a9439c172d49 R14: 0000006ecad154f8 R15: 00000000000002fe
>[17123.729251] FS:  00007fe38119d740(0000) GS:ffff880f1fca0000(0000) knlGS:0000000000000000
>[17123.729259] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.729268] CR2: 00007fe381187000 CR3: 0000000ee711d000 CR4: 00000000000007e0
>[17123.729276] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729284] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729292] Process quad.89 (pid: 10030, threadinfo ffff880ee5d5e000, task ffff880ee7538000)
>[17123.729299] 
>[17123.729307] NMI backtrace for cpu 12
>[17123.729312] CPU 12 
>[17123.729318] Pid: 10024, comm: quad.67 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729324] RIP: 0033:[<0000000000401218>]  [<0000000000401218>] 0x401217
>[17123.729332] RSP: 002b:00007fff4ab1e640  EFLAGS: 00000297
>[17123.729335] RAX: 486389fd01734c8a RBX: ccd2d02c65eb124a RCX: ffffffb1b3402bed
>[17123.729337] RDX: 0000004e4cc02598 RSI: 0000006e6d744ee5 RDI: 0000006a9cc04725
>[17123.729338] RBP: 486389fd01734c8a R08: 000000c0a83b6412 R09: 00000051c0b09435
>[17123.729340] R10: 00000000000052f4 R11: 0000000000005185 R12: 0000006ee78acfdd
>[17123.729341] R13: c45f5579d25b0075 R14: 0000006ee78acfdc R15: 0000000000002dfc
>[17123.729344] FS:  00007f77d7fc0740(0000) GS:ffff880781cc0000(0000) knlGS:0000000000000000
>[17123.729346] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.729349] CR2: 00007f77d7fab000 CR3: 0000000ef36fd000 CR4: 00000000000007e0
>[17123.729351] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729353] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729355] Process quad.67 (pid: 10024, threadinfo ffff880ee5520000, task ffff880ee50b4560)
>[17123.729356] 
>[17123.729360] NMI backtrace for cpu 13
>[17123.729362] CPU 13 
>[17123.729364] Pid: 10018, comm: quad.43 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729366] RIP: 0033:[<000000000040129a>]  [<000000000040129a>] 0x401299
>[17123.729372] RSP: 002b:00007fffc3c95020  EFLAGS: 00000206
>[17123.729375] RAX: 0000002836c35dd2 RBX: 208463df14403cf3 RCX: 000000141b61aee9
>[17123.729376] RDX: 000000293634d732 RSI: 0000002b6d66655f RDI: 00000035ac905e80
>[17123.729378] RBP: 2a9e77e71da84ed3 R08: 000000472dce3aa7 R09: 0000005c48a161b4
>[17123.729379] R10: 000000706403109d R11: 000000706403109d R12: 000000706403109d
>[17123.729380] R13: a8b4591605fbf5b5 R14: 000000706403109c R15: 00000000000000ff
>[17123.729382] FS:  00007fbdccb72740(0000) GS:ffff880f1fcc0000(0000) knlGS:0000000000000000
>[17123.729384] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.729385] CR2: 0000000001c67008 CR3: 00000007286ba000 CR4: 00000000000007e0
>[17123.729387] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729388] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729390] Process quad.43 (pid: 10018, threadinfo ffff880eed742000, task ffff880ef609c560)
>[17123.729391] 
>[17123.729459] NMI backtrace for cpu 14
>[17123.729461] CPU 14 
>[17123.729464] Pid: 10007, comm: quad.1 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729465] RIP: 0033:[<0000000000401295>]  [<0000000000401295>] 0x401294
>[17123.729470] RSP: 002b:00007fff7c59e3e0  EFLAGS: 00000216
>[17123.729472] RAX: 0000006320cb20b6 RBX: f110bd523cda4179 RCX: 000000319065905b
>[17123.729474] RDX: 0000006b3137c5c2 RSI: 0000002730674b7b RDI: 000000121246801e
>[17123.729477] RBP: 8f27764f87b7666c R08: 0000000459e6c4d6 R09: 0000003dfab8d20c
>[17123.729478] R10: 0000006f8b1e6267 R11: 0000006f8b1e6267 R12: 0000006f8b1e6267
>[17123.729480] R13: b24e64b8f91b9957 R14: 0000006f8b1e6266 R15: 000000000000205f
>[17123.729482] FS:  00007f7cdfe9c740(0000) GS:ffff880781ce0000(0000) knlGS:0000000000000000
>[17123.729484] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.729486] CR2: 0000000001535008 CR3: 0000000eed7e9000 CR4: 00000000000007e0
>[17123.729487] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729489] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729491] Process quad.1 (pid: 10007, threadinfo ffff880ee7526000, task ffff880ee7604560)
>[17123.729492] 
>[17123.729560] NMI backtrace for cpu 15
>[17123.729568] CPU 15 
>[17123.729578] Pid: 10009, comm: quad.11 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729586] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[17123.729603] RSP: 002b:00007fffcf5047c0  EFLAGS: 00000a03
>[17123.729611] RAX: 35c0aca97dea8243 RBX: 0a77df29bfd28703 RCX: 0000000000002187
>[17123.729618] RDX: 00000043a65a4038 RSI: 000000606b140ae3 RDI: 00000054f193304e
>[17123.729626] RBP: 35c0aca97dea8243 R08: 000000654e59d616 R09: 000000654e59d616
>[17123.729636] R10: 00000000000039ed R11: 0000000000002187 R12: 0000006fd4e02bab
>[17123.729643] R13: bc29ad43bc397703 R14: 0000006fd4e02baa R15: 0000000000001ffe
>[17123.729649] FS:  00007fcea51fc740(0000) GS:ffff880f1fce0000(0000) knlGS:0000000000000000
>[17123.729652] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.729654] CR2: 0000000000a1b008 CR3: 000000072f914000 CR4: 00000000000007e0
>[17123.729655] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729657] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729659] Process quad.11 (pid: 10009, threadinfo ffff880ee5e56000, task ffff880ee7602e40)
>[17123.729660] 
>[17123.729663] NMI backtrace for cpu 16
>[17123.729665] CPU 16 
>[17123.729667] Pid: 10017, comm: quad.41 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729669] RIP: 0010:[<ffffffff81039889>]  [<ffffffff81039889>] default_send_IPI_mask_sequence_phys+0x79/0x100
>[17123.729677] RSP: 0000:ffff880781d03d98  EFLAGS: 00000046
>[17123.729679] RAX: ffff880f1fd00000 RBX: 000000000000b03a RCX: 0000000000000011
>[17123.729680] RDX: 0000000000000011 RSI: 0000000000000025 RDI: 0000000000000080
>[17123.729682] RBP: ffff880781d03dd8 R08: ffffffff81cdc590 R09: 0000000000000000
>[17123.729683] R10: 0000000000000000 R11: 0000000000000bff R12: ffffffff81cdc590
>[17123.729684] R13: 0000000000000400 R14: 0000000000000092 R15: 0000000000000002
>[17123.729686] FS:  00007f4ecf4fd740(0000) GS:ffff880781d00000(0000) knlGS:0000000000000000
>[17123.729687] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.729689] CR2: 000000000156f008 CR3: 00000007284f6000 CR4: 00000000000007e0
>[17123.729690] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729692] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729694] Process quad.41 (pid: 10017, threadinfo ffff880ee754c000, task ffff880ef2e64560)
>[17123.729695] Stack:
>[17123.729696]  ffffffff00000005 0000000000000010 ffff880781d03df8 0000000000002710
>[17123.729701]  0000000000000010 ffff880ee754c000 ffffffff81c3c780 ffffffff81c3c600
>[17123.729705]  ffff880781d03de8 ffffffff8103d887 ffff880781d03e08 ffffffff81039a8d
>[17123.729708] Call Trace:
>[17123.729709]  <IRQ> 
>[17123.729711] 
>[17123.729715]  [<ffffffff8103d887>] physflat_send_IPI_all+0x17/0x20
>[17123.729718]  [<ffffffff81039a8d>] arch_trigger_all_cpu_backtrace+0x5d/0xa0
>[17123.729723]  [<ffffffff810f5435>] rcu_check_callbacks+0x5b5/0x650
>[17123.729727]  [<ffffffff8106fa48>] update_process_times+0x48/0x90
>[17123.729731]  [<ffffffff810b61ae>] tick_sched_timer+0x6e/0xe0
>[17123.729734]  [<ffffffff81086123>] __run_hrtimer+0x73/0x1d0
>[17123.729737]  [<ffffffff810b6140>] ? tick_nohz_handler+0x110/0x110
>[17123.729741]  [<ffffffff81067066>] ? __do_softirq+0x136/0x210
>[17123.729746]  [<ffffffff81086a47>] hrtimer_interrupt+0xf7/0x230
>[17123.729750]  [<ffffffff8163fbc9>] smp_apic_timer_interrupt+0x69/0x99
>[17123.729755]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[17123.729756]  <EOI> 
>[17123.729757] Code: 
>[17123.729759] 00 00 4c 89 e7 48 63 d2 e8 f5 e8 2b 00 89 c2 48 63 05 30 3e ca 00 48 39 c2 73 55 48 8b 04 d5 a0 ae cd 81 41 83 ff 02 0f b7 34 03 <74> 5c 8b 04 25 00 a3 5f ff f6 c4 10 74 17 66 0f 1f 84 00 00 00 
>[17123.729785] NMI backtrace for cpu 17
>[17123.729788] CPU 17 
>[17123.729791] Pid: 10010, comm: quad.13 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729793] RIP: 0033:[<0000000000401014>]  [<0000000000401014>] 0x401013
>[17123.729799] RSP: 002b:00007fff18a2ccb0  EFLAGS: 00000216
>[17123.729800] RAX: 000000000000004d RBX: 798536d8766f07a2 RCX: 00000000fffdbdff
>[17123.729802] RDX: 0000006f4bdd3fdc RSI: 000000000000398a RDI: 000000000000005a
>[17123.729805] RBP: 0000006f4bdd4011 R08: 0000000a6dfa3533 R09: 0000000000000051
>[17123.729813] R10: 0000000000002d9c R11: 000000000000028c R12: 0000006f4bdd4029
>[17123.729821] R13: 5a38b3bb39798859 R14: 0000006f4bdd4028 R15: 0000006f4bdd4043
>[17123.729829] FS:  00007f0c45718740(0000) GS:ffff880f1fd00000(0000) knlGS:0000000000000000
>[17123.729838] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17123.729846] CR2: 00007f0c45703000 CR3: 0000000ee55e2000 CR4: 00000000000007e0
>[17123.729854] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729862] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729871] Process quad.13 (pid: 10010, threadinfo ffff880ee71f0000, task ffff880ee7601720)
>[17123.729879] 
>[17123.729886] NMI backtrace for cpu 18
>[17123.729892] CPU 18 
>[17123.729898] Pid: 10013, comm: quad.23 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729904] RIP: 0033:[<0000000000401006>]  [<0000000000401006>] 0x401005
>[17123.729915] RSP: 002b:00007fff63b18020  EFLAGS: 00000a93
>[17123.729924] RAX: 44444455bc052e5b RBX: 7a104b6764521659 RCX: 00000000fdf7fffb
>[17123.729929] RDX: 00000013f69354ac RSI: 00000000000010f3 RDI: 000000000000005a
>[17123.729935] RBP: 000000704afcbc29 R08: 00000004dd00231b R09: 0000000000000d61
>[17123.729940] R10: 0000000000001cbe R11: 00000000000019f1 R12: 000000704afcbc49
>[17123.729947] R13: dcb4d7048906be13 R14: 000000704afcbc48 R15: 000000704afcbc4b
>[17123.729952] FS:  00007fc7b2139740(0000) GS:ffff880781d20000(0000) knlGS:0000000000000000
>[17123.729958] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.729963] CR2: 0000000000cea1f8 CR3: 00000007259a1000 CR4: 00000000000007e0
>[17123.729967] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.729969] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.729971] Process quad.23 (pid: 10013, threadinfo ffff880eed482000, task ffff880ee5568000)
>[17123.729972] 
>[17123.729984] NMI backtrace for cpu 19
>[17123.729987] CPU 19 
>[17123.729990] Pid: 10023, comm: quad.61 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.729992] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[17123.729997] RSP: 002b:00007fff52029e30  EFLAGS: 00000a03
>[17123.729998] RAX: f3de890bfce21d47 RBX: e15ad265b70387ec RCX: 0000000000002653
>[17123.730000] RDX: 0000004871e509a1 RSI: 0000001fb296348d RDI: 0000003f4f8dc24f
>[17123.730002] RBP: f3de890bfce21d47 R08: 000000a0e3112fbb R09: 00000031e7342468
>[17123.730004] R10: 0000000000001c64 R11: 0000000000002653 R12: 0000006efbdd0b53
>[17123.730005] R13: 5d151b827be170db R14: 0000006efbdd0b52 R15: 00000000000007d6
>[17123.730007] FS:  00007fce4f642740(0000) GS:ffff880f1fd20000(0000) knlGS:0000000000000000
>[17123.730010] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.730012] CR2: 00007fce4f62d000 CR3: 0000000ef3d1e000 CR4: 00000000000007e0
>[17123.730013] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.730015] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.730017] Process quad.61 (pid: 10023, threadinfo ffff880ef27fc000, task ffff880ee50b1720)
>[17123.730018] 
>[17123.730085] NMI backtrace for cpu 20
>[17123.730087] CPU 20 
>[17123.730090] Pid: 10029, comm: quad.83 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.730091] RIP: 0033:[<000000000040fb9c>]  [<000000000040fb9c>] 0x40fb9b
>[17123.730102] RSP: 002b:00007fff1f7270d0  EFLAGS: 00000216
>[17123.730107] RAX: 0000000000045ea9 RBX: 00007f3d4a15f010 RCX: 0000000000045ea9
>[17123.730113] RDX: 00000000000022f5 RSI: 00000000024e4c30 RDI: 0000000000000035
>[17123.730120] RBP: 0000000000000001 R08: 0000000000000001 R09: 000000000000000e
>[17123.730126] R10: 00007f3d4a1e0010 R11: 000000000000dabb R12: 0000000000000020
>[17123.730130] R13: e1b9204cf43f88db R14: 0000006fa95933c0 R15: 0000006fa95933f1
>[17123.730136] FS:  00007f3d4a262740(0000) GS:ffff880781d40000(0000) knlGS:0000000000000000
>[17123.730137] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17123.730144] CR2: 000000000250f008 CR3: 0000000ef435f000 CR4: 00000000000007e0
>[17123.730149] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.730154] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.730160] Process quad.83 (pid: 10029, threadinfo ffff880eed508000, task ffff880ee5e6dc80)
>[17123.730166] 
>[17123.730184] NMI backtrace for cpu 21
>[17123.730186] CPU 21 
>[17123.730189] Pid: 10014, comm: quad.29 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.730191] RIP: 0033:[<00000000004012d6>]  [<00000000004012d6>] 0x4012d5
>[17123.730196] RSP: 002b:00007fff29bf4f80  EFLAGS: 00000212
>[17123.730198] RAX: 000000cc16c2a9d2 RBX: 531ec54a1a8d2469 RCX: 000000089dfbdef6
>[17123.730200] RDX: 0000002277ef7bd8 RSI: 0000006b1f49b4f7 RDI: 000000428006b487
>[17123.730202] RBP: 87274dacf816e220 R08: 0000001ced9d5f2e R09: 000000660b6154e9
>[17123.730203] R10: 0000000513e8600e R11: 0000007033321505 R12: 0000007033321505
>[17123.730205] R13: e6de91dccd286fcd R14: 0000007033321504 R15: 00000000000003d0
>[17123.730207] FS:  00007f281508b740(0000) GS:ffff880f1fd40000(0000) knlGS:0000000000000000
>[17123.730209] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.730211] CR2: 00000000011fa008 CR3: 000000072cbb9000 CR4: 00000000000007e0
>[17123.730212] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.730214] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.730216] Process quad.29 (pid: 10014, threadinfo ffff880ef34a8000, task ffff880ee556ae40)
>[17123.730217] 
>[17123.730284] NMI backtrace for cpu 22
>[17123.730288] CPU 22 
>[17123.730291] Pid: 10022, comm: quad.59 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.730293] RIP: 0033:[<0000000000401006>]  [<0000000000401006>] 0x401005
>[17123.730301] RSP: 002b:00007fffa5538da0  EFLAGS: 00000a97
>[17123.730304] RAX: aaaaaabbffa538d5 RBX: b51ba23da0e95da3 RCX: 00000000fdfeffdb
>[17123.730306] RDX: 00000013ced534c2 RSI: 0000000000003472 RDI: 000000000000005a
>[17123.730310] RBP: 0000006f6b6f48c5 R08: 00000002b09b71f4 R09: 0000000000000b56
>[17123.730314] R10: 00000000000030b5 R11: 000000000000315b R12: 0000006f6b6f48c7
>[17123.730316] R13: 067ab2cb9cce8ba9 R14: 0000006f6b6f48c6 R15: 0000006f6b6f48cb
>[17123.730318] FS:  00007fe61b3e6740(0000) GS:ffff880781d60000(0000) knlGS:0000000000000000
>[17123.730322] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.730324] CR2: 00007fe61b3d1000 CR3: 0000000ee5e50000 CR4: 00000000000007e0
>[17123.730326] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.730332] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.730335] Process quad.59 (pid: 10022, threadinfo ffff880ee5d38000, task ffff880ee50b0000)
>[17123.730336] 
>[17123.730338] NMI backtrace for cpu 23
>[17123.730344] CPU 23 
>[17123.730348] Pid: 10028, comm: quad.79 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17123.730350] RIP: 0033:[<0000000000401247>]  [<0000000000401247>] 0x401246
>[17123.730360] RSP: 002b:00007fff0acd2610  EFLAGS: 00000217
>[17123.730362] RAX: 0000001b3c5a5167 RBX: ca1de873e90756cc RCX: 0000005a430f00a1
>[17123.730364] RDX: 0000005378aea6cf RSI: 0000005822741ea3 RDI: 0000001b3c5a5167
>[17123.730365] RBP: 0550cc154846b7ad R08: 0000000000001213 R09: 0000001396bc3338
>[17123.730367] R10: 0000000000001213 R11: 0000000000001c78 R12: 0000006eb508f6d1
>[17123.730369] R13: 12706c1de2b12231 R14: 0000006eb508f6d0 R15: 0000000000000649
>[17123.730371] FS:  00007fd30ad0c740(0000) GS:ffff880f1fd60000(0000) knlGS:0000000000000000
>[17123.730373] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17123.730375] CR2: 00007fd30acf6000 CR3: 0000000ef58d8000 CR4: 00000000000007e0
>[17123.730378] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17123.730380] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17123.730382] Process quad.79 (pid: 10028, threadinfo ffff880ef3866000, task ffff880ee5e6c560)
>[17123.730383] 
>[17303.327692] INFO: rcu_sched detected stalls on CPUs/tasks: { 17} (detected by 22, t=420012 jiffies)
>[17303.327700] sending NMI to all CPUs:
>[17303.327707] NMI backtrace for cpu 0
>[17303.327709] CPU 0 
>[17303.327713] Pid: 10021, comm: quad.53 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.327714] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[17303.327734] RSP: 002b:00007fff0a16d9c0  EFLAGS: 00000206
>[17303.327736] RAX: 00000000000a6190 RBX: 00007f3ea5136010 RCX: 0000000000000001
>[17303.327737] RDX: 000000000000529b RSI: 0000000000b83c30 RDI: 0000000000000e2f
>[17303.327738] RBP: 0000000000000002 R08: 0000000000000001 R09: 00000000000001fa
>[17303.327740] R10: 00007f3ea51b7010 R11: 000000000000dc28 R12: 0000000000000010
>[17303.327742] R13: 0f1c8c3164f021e7 R14: 000000713d4d6226 R15: 000000713d4d6229
>[17303.327744] FS:  00007f3ea5239740(0000) GS:ffff880781c00000(0000) knlGS:0000000000000000
>[17303.327745] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.327747] CR2: 00007f3ea5225000 CR3: 0000000ee564f000 CR4: 00000000000007f0
>[17303.327748] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.327750] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.327752] Process quad.53 (pid: 10021, threadinfo ffff880ee5d12000, task ffff880ef22b5c80)
>[17303.327753] 
>[17303.327757] NMI backtrace for cpu 1
>[17303.327760] CPU 1 
>[17303.327765] Pid: 10020, comm: quad.49 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.327767] RIP: 0033:[<0000000000400f92>]  [<0000000000400f92>] 0x400f91
>[17303.327782] RSP: 002b:00007fff9f9d0710  EFLAGS: 00000287
>[17303.327784] RAX: 000000000004a243 RBX: d5eec43107ec32f6 RCX: 00000000ffdfff7d
>[17303.327786] RDX: 00000000000aa040 RSI: 0000000000002512 RDI: 000000000000005a
>[17303.327788] RBP: 00000070e9595483 R08: 0000000c45e35c70 R09: 000000000000153e
>[17303.327789] R10: 00000000000011cf R11: 00000000000009ec R12: 00000070e9595485
>[17303.327791] R13: 63a34ed94b3f3d6d R14: 00000070e9595482 R15: 00000070e9595487
>[17303.327794] FS:  00007f2ccb02b740(0000) GS:ffff880f1fc00000(0000) knlGS:0000000000000000
>[17303.327796] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.327798] CR2: 00000000006e2b98 CR3: 0000000ee5d80000 CR4: 00000000000007e0
>[17303.327799] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.327801] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.327803] Process quad.49 (pid: 10020, threadinfo ffff880ee87e2000, task ffff880ef32f0000)
>[17303.327805] 
>[17303.327807] NMI backtrace for cpu 2
>[17303.327809] CPU 2 
>[17303.327813] Pid: 10015, comm: quad.31 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.327815] RIP: 0033:[<0000000000401272>]  [<0000000000401272>] 0x401271
>[17303.327821] RSP: 002b:00007fffd392bda0  EFLAGS: 00000a17
>[17303.327823] RAX: bb7c4d86f27a186d RBX: bb7c4d86f27a186d RCX: 00000017a59ddcbd
>[17303.327825] RDX: 000000234873ac38 RSI: 000000477f0f6619 RDI: 0000004bd41c39b2
>[17303.327827] RBP: fb096aaf26c97f95 R08: 00000000000015d7 R09: 0000000000000a80
>[17303.327828] R10: 00000000000015d7 R11: 00000000000009ba R12: 00000071871612a3
>[17303.327830] R13: e16a2a2b6954310b R14: 00000071871612a2 R15: 00000000000009a0
>[17303.327832] FS:  00007f29fe59d740(0000) GS:ffff880781c20000(0000) knlGS:0000000000000000
>[17303.327834] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.327836] CR2: 0000003fea6bb420 CR3: 00000007755cc000 CR4: 00000000000007e0
>[17303.327838] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.327839] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.327841] Process quad.31 (pid: 10015, threadinfo ffff880ee8cde000, task ffff880ef600c560)
>[17303.327842] 
>[17303.327905] NMI backtrace for cpu 3
>[17303.327908] CPU 3 
>[17303.327911] Pid: 10026, comm: quad.73 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.327913] RIP: 0033:[<000000000040122c>]  [<000000000040122c>] 0x40122b
>[17303.327920] RSP: 002b:00007fff42211af0  EFLAGS: 00000a13
>[17303.327922] RAX: 66e37f1219c31042 RBX: 3243433248d93a0f RCX: 00000044843ae6e7
>[17303.327924] RDX: 000000000000165d RSI: 00000051e07f9073 RDI: 00000038012da9f5
>[17303.327926] RBP: 04d93ae019b7db73 R08: 000000000000165d R09: 000000663b1d5bfa
>[17303.327928] R10: 00000000000011ea R11: 0000000000003a11 R12: 000000717b37bc59
>[17303.327930] R13: 859a820a2de3cbe9 R14: 000000717b37bc58 R15: 00000000000011e9
>[17303.327932] FS:  00007f229adcb740(0000) GS:ffff880f1fc20000(0000) knlGS:0000000000000000
>[17303.327934] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.327936] CR2: 00007f229adb7000 CR3: 000000072872f000 CR4: 00000000000007e0
>[17303.327938] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.327940] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.327942] Process quad.73 (pid: 10026, threadinfo ffff880ee55da000, task ffff880ee5e69720)
>[17303.327943] 
>[17303.328005] NMI backtrace for cpu 4
>[17303.328007] CPU 4 
>[17303.328010] Pid: 10012, comm: quad.19 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328012] RIP: 0033:[<0000000000401229>]  [<0000000000401229>] 0x401228
>[17303.328019] RSP: 002b:00007fff03c73680  EFLAGS: 00000a17
>[17303.328021] RAX: 5ce9e164e6a45480 RBX: fee4db8aaa3e4b34 RCX: 00000051b0622043
>[17303.328023] RDX: 00000000000002d6 RSI: 0000006a3a50680c RDI: 0000002d890f4e44
>[17303.328024] RBP: 517f73d0639e6579 R08: 00000081c4157e65 R09: 0000000ff39cf320
>[17303.328026] R10: 00000000000014fc R11: 0000000000003f4c R12: 00000071d0788b45
>[17303.328028] R13: 769b6260b9ad4f8d R14: 00000071d0788b44 R15: 00000000000012e5
>[17303.328030] FS:  00007ffe77d4e740(0000) GS:ffff880781c40000(0000) knlGS:0000000000000000
>[17303.328032] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328034] CR2: 00007fbfcb578000 CR3: 0000000728486000 CR4: 00000000000007e0
>[17303.328035] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328037] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328039] Process quad.19 (pid: 10012, threadinfo ffff880ee5204000, task ffff880ef2f8dc80)
>[17303.328040] 
>[17303.328105] NMI backtrace for cpu 5
>[17303.328107] CPU 5 
>[17303.328111] Pid: 10028, comm: quad.79 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328113] RIP: 0033:[<00000000004012a7>]  [<00000000004012a7>] 0x4012a6
>[17303.328120] RSP: 002b:00007fff0acd2610  EFLAGS: 00000287
>[17303.328122] RAX: 0000005696eae436 RBX: 5f677a90c7f3b37d RCX: 0000002b4b75721b
>[17303.328124] RDX: ffffffe5fe62511b RSI: 00000067cd5c49a1 RDI: 0000002173f9fdd1
>[17303.328126] RBP: db4b69d8367ef0fd R08: 0000004e78269803 R09: 000000454d132100
>[17303.328127] R10: 000000709888931b R11: 000000709888931b R12: 000000709888931b
>[17303.328129] R13: f6f77c3a45238f13 R14: 000000709888931a R15: 0000000000000067
>[17303.328132] FS:  00007fd30ad0c740(0000) GS:ffff880f1fc40000(0000) knlGS:0000000000000000
>[17303.328134] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328135] CR2: 000000000135b6c8 CR3: 0000000ef58d8000 CR4: 00000000000007e0
>[17303.328137] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328139] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328141] Process quad.79 (pid: 10028, threadinfo ffff880ef3866000, task ffff880ee5e6c560)
>[17303.328142] 
>[17303.328205] NMI backtrace for cpu 6
>[17303.328207] CPU 6 
>[17303.328210] Pid: 10011, comm: quad.17 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328212] RIP: 0033:[<000000000040130d>]  [<000000000040130d>] 0x40130c
>[17303.328219] RSP: 002b:00007fffd2a7cf00  EFLAGS: 00000287
>[17303.328221] RAX: 0000006564c29f52 RBX: 3154d1aebc62bd85 RCX: 00000061481fb5ea
>[17303.328222] RDX: 000000cac9853ea4 RSI: 00000052a233f9f6 RDI: ffffffe842cf317b
>[17303.328224] RBP: 160cb3eb13c855b0 R08: 0000006e7563badb R09: 0000005ad4d5d5be
>[17303.328226] R10: 00000065b216daf3 R11: 00000045279bb964 R12: 000000729206a443
>[17303.328228] R13: dcf3eb5609b7c86b R14: 000000729206a442 R15: 000000000000168c
>[17303.328230] FS:  00007fdaa6de7740(0000) GS:ffff880781c60000(0000) knlGS:0000000000000000
>[17303.328232] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328234] CR2: 00007fdaa6dd3000 CR3: 000000072877f000 CR4: 00000000000007e0
>[17303.328235] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328237] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328239] Process quad.17 (pid: 10011, threadinfo ffff880ef1c6a000, task ffff880ef25bdc80)
>[17303.328240] 
>[17303.328305] NMI backtrace for cpu 7
>[17303.328307] CPU 7 
>[17303.328311] Pid: 10008, comm: quad.7 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328313] RIP: 0033:[<0000000000401253>]  [<0000000000401253>] 0x401252
>[17303.328319] RSP: 002b:00007fff4c37a3d0  EFLAGS: 00000a03
>[17303.328321] RAX: ac95502f156bad94 RBX: 9e69732648f47f73 RCX: 0000003f18979d0d
>[17303.328323] RDX: 00000000000009e5 RSI: 00000000000009e5 RDI: 0000000316399d11
>[17303.328325] RBP: f900c3c12af5357e R08: 0000000000001d83 R09: 00000000000009e5
>[17303.328327] R10: 0000000000001d83 R11: 00000000000030cc R12: 00000072665a57c7
>[17303.328329] R13: a4889d88986639f7 R14: 00000072665a57c6 R15: 000000000000127e
>[17303.328331] FS:  00007f3f63c59740(0000) GS:ffff880f1fc60000(0000) knlGS:0000000000000000
>[17303.328333] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328335] CR2: 000000000044b913 CR3: 00000007755a1000 CR4: 00000000000007e0
>[17303.328337] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328339] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328341] Process quad.7 (pid: 10008, threadinfo ffff880ee8f34000, task ffff880ee7605c80)
>[17303.328342] 
>[17303.328405] NMI backtrace for cpu 8
>[17303.328407] CPU 8 
>[17303.328410] Pid: 10025, comm: quad.71 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328412] RIP: 0033:[<00000000004011da>]  [<00000000004011da>] 0x4011d9
>[17303.328419] RSP: 002b:00007fff01f2eaf0  EFLAGS: 00000a03
>[17303.328420] RAX: 38b5f3ec4e591b90 RBX: deb4308dfbc8db53 RCX: 0000001c49c6a054
>[17303.328422] RDX: 0000000000000320 RSI: 0000006057625dc0 RDI: 00000041c8ec302b
>[17303.328424] RBP: 738ad266b7ddfb1b R08: 00000064cd1dcb60 R09: cd21563d8c19bf40
>[17303.328426] R10: 0000000000003355 R11: 0000000000001f3a R12: 0000007278382883
>[17303.328428] R13: a7cb2129fa4f662b R14: 0000007278382882 R15: 00000000000018c1
>[17303.328430] FS:  00007f7c7489e740(0000) GS:ffff880781c80000(0000) knlGS:0000000000000000
>[17303.328432] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328433] CR2: 00007f29fe589000 CR3: 0000000ee7653000 CR4: 00000000000007e0
>[17303.328435] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328437] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328439] Process quad.71 (pid: 10025, threadinfo ffff880ee5dae000, task ffff880ee5e68000)
>[17303.328440] 
>[17303.328442] NMI backtrace for cpu 9
>[17303.328445] CPU 9 
>[17303.328448] Pid: 10027, comm: quad.77 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328450] RIP: 0033:[<00000000004011e6>]  [<00000000004011e6>] 0x4011e5
>[17303.328457] RSP: 002b:00007fffe107ea70  EFLAGS: 00000a07
>[17303.328459] RAX: 8576bc6fa7b30790 RBX: bbbfb3d8351f13bb RCX: 000000517a88dc6b
>[17303.328461] RDX: 0000000000000688 RSI: 0000005ecd419c55 RDI: 0000003f17562dcc
>[17303.328463] RBP: c54236f6eb7814b9 R08: 00000028e57f202c R09: 278047a1405184bc
>[17303.328465] R10: 0000000000001799 R11: 00000000000019ee R12: 00000070dffee707
>[17303.328467] R13: 67e662e7dbcfd6b7 R14: 00000070dffee706 R15: 000000000000175d
>[17303.328469] FS:  00007f7f2abe2740(0000) GS:ffff880f1fc80000(0000) knlGS:0000000000000000
>[17303.328471] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328473] CR2: 0000000000ffc008 CR3: 0000000ee5a3c000 CR4: 00000000000007e0
>[17303.328474] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328476] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328478] Process quad.77 (pid: 10027, threadinfo ffff880ee7576000, task ffff880ee5e6ae40)
>[17303.328480] 
>[17303.328505] NMI backtrace for cpu 10
>[17303.328506] CPU 10 
>[17303.328509] Pid: 10019, comm: quad.47 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328511] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[17303.328517] RSP: 002b:00007fffb25fb220  EFLAGS: 00000202
>[17303.328519] RAX: 00000000000165a3 RBX: 00007f98e8c46010 RCX: 000000000000000e
>[17303.328520] RDX: 0000000000000b24 RSI: 0000000001810c30 RDI: 0000000000000115
>[17303.328522] RBP: 0000000000004000 R08: 0000000000000001 R09: 0000000000000039
>[17303.328523] R10: 00007f98e8cc7010 R11: 000000000000dbbf R12: 0000000000000030
>[17303.328525] R13: 1b1cb2a95cf0c607 R14: 00000070c5b5c83c R15: 00000070c5b5c869
>[17303.328527] FS:  00007f98e8d49740(0000) GS:ffff880781ca0000(0000) knlGS:0000000000000000
>[17303.328528] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328530] CR2: 00007f0957b02000 CR3: 0000000ef579a000 CR4: 00000000000007e0
>[17303.328531] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328533] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328535] Process quad.47 (pid: 10019, threadinfo ffff880ee5d76000, task ffff880ee8901720)
>[17303.328536] 
>[17303.328605] NMI backtrace for cpu 11
>[17303.328607] CPU 11 
>[17303.328611] Pid: 10016, comm: quad.37 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328613] RIP: 0033:[<000000000040124d>]  [<000000000040124d>] 0x40124c
>[17303.328619] RSP: 002b:00007fff110c3e40  EFLAGS: 00000a03
>[17303.328621] RAX: ad74dce460b72d69 RBX: 568f2f1b434bfd90 RCX: 0000001e0ff261ee
>[17303.328623] RDX: 00000000000005f5 RSI: 0000002178cfcf97 RDI: 0000006fc46d427e
>[17303.328625] RBP: 5e770ceee5a26a3b R08: 0000000000000a58 R09: 0000002d94b08aff
>[17303.328627] R10: 0000000000000a58 R11: 0000000000000dfd R12: 000000716af98407
>[17303.328629] R13: 55463652da36a9b7 R14: 000000716af98406 R15: 00000000000009ba
>[17303.328631] FS:  00007f22a5f07740(0000) GS:ffff880f1fca0000(0000) knlGS:0000000000000000
>[17303.328633] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328635] CR2: 00007f22a5ef3000 CR3: 0000000775d73000 CR4: 00000000000007e0
>[17303.328637] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328638] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328641] Process quad.37 (pid: 10016, threadinfo ffff880ee5de4000, task ffff880ef6b2c560)
>[17303.328642] 
>[17303.328704] NMI backtrace for cpu 13
>[17303.328715] CPU 13 
>[17303.328723] Pid: 12124, comm: kworker/u:2 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328731] RIP: 0010:[<ffffffff81633f29>]  [<ffffffff81633f29>] __schedule+0x189/0x7a0
>[17303.328748] RSP: 0000:ffff8806f9151dc8  EFLAGS: 00000012
>[17303.328756] RAX: ffff8806f9150000 RBX: ffff8806fbd36038 RCX: 0000000000000000
>[17303.328764] RDX: ffff880f1fcd3cc0 RSI: ffff880ef609c560 RDI: ffff8806fbd35c80
>[17303.328772] RBP: ffff8806f9151e28 R08: 0000000000000000 R09: 000000000000042a
>[17303.328782] R10: 0000000000000000 R11: 0000000000000000 R12: ffff880f1fcd3cc0
>[17303.328789] R13: 000000000000000d R14: 0000000000013c80 R15: ffff8806fbd35c80
>[17303.328797] FS:  0000000000000000(0000) GS:ffff880f1fcc0000(0000) knlGS:0000000000000000
>[17303.328805] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.328815] CR2: 00007fbdccb5e000 CR3: 00000007286ba000 CR4: 00000000000007e0
>[17303.328823] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.328831] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.328840] Process kworker/u:2 (pid: 12124, threadinfo ffff8806f9150000, task ffff8806fbd35c80)
>[17303.328847] Stack:
>[17303.328854]  ffff8806fbd35c80 ffff8806f9151fd8 ffff8806f9151fd8 ffff8806f9151fd8
>[17303.328885]  ffff880ef609c560 ffff8806fbd35c80 ffffffffa0133ea0 ffff880ee5cd2380
>[17303.328895]  ffffffff81e83b90 ffffffff81e83b90 0000000000013c80 ffff8806fbd35c80
>[17303.328900] Call Trace:
>[17303.328910]  [<ffffffffa0133ea0>] ? edac_mc_del_mc+0xf0/0xf0 [edac_core]
>[17303.328914]  [<ffffffff81634869>] schedule+0x29/0x70
>[17303.328919]  [<ffffffff8107cdda>] worker_thread+0x21a/0x450
>[17303.328924]  [<ffffffff8107cbc0>] ? busy_worker_rebind_fn+0x110/0x110
>[17303.328929]  [<ffffffff81081c80>] kthread+0xc0/0xd0
>[17303.328935]  [<ffffffff81010000>] ? ftrace_raw_event_xen_mmu_flush_tlb_others+0x50/0xe0
>[17303.328938]  [<ffffffff81081bc0>] ? kthread_create_on_node+0x120/0x120
>[17303.328945]  [<ffffffff8163dfac>] ret_from_fork+0x7c/0xb0
>[17303.328948]  [<ffffffff81081bc0>] ? kthread_create_on_node+0x120/0x120
>[17303.328949] Code: 60 10 f7 48 8b 75 c0 41 c7 44 24 48 00 00 00 00 48 39 f7 0f 84 ef 05 00 00 49 83 44 24 68 01 49 89 b4 24 68 08 00 00 48 83 03 01 <66> 66 66 66 90 48 8b 7d c8 48 c7 c0 c0 3c 01 00 48 8b 57 08 8b 
>[17303.328979] NMI backtrace for cpu 12
>[17303.328981] CPU 12 
>[17303.328986] Pid: 10024, comm: quad.67 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.328988] RIP: 0033:[<000000000040fbb0>]  [<000000000040fbb0>] 0x40fbaf
>[17303.328994] RSP: 002b:00007fff4ab1e610  EFLAGS: 00000202
>[17303.328996] RAX: 00000000000b6063 RBX: 00007f77d7ebd010 RCX: 0000000000000008
>[17303.328998] RDX: 00000000000a9f02 RSI: 0000000001433c30 RDI: 000000000001a07b
>[17303.328999] RBP: 0000000000000100 R08: 0000000000000001 R09: 00000000000027ac
>[17303.329001] R10: 00007f77d7f3e010 R11: 000000000000dbc3 R12: 0000000000000038
>[17303.329002] R13: 1c1c70e3b18f3b31 R14: 00000070ced63dfe R15: 00000070ced63e01
>[17303.329005] FS:  00007f77d7fc0740(0000) GS:ffff880781cc0000(0000) knlGS:0000000000000000
>[17303.329009] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.329010] CR2: 00007fc133a2a000 CR3: 0000000ef36fd000 CR4: 00000000000007e0
>[17303.329012] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329014] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329016] Process quad.67 (pid: 10024, threadinfo ffff880ee5520000, task ffff880ee50b4560)
>[17303.329017] 
>[17303.329018] NMI backtrace for cpu 14
>[17303.329020] CPU 14 
>[17303.329023] Pid: 10007, comm: quad.1 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329025] RIP: 0033:[<0000000000400fae>]  [<0000000000400fae>] 0x400fad
>[17303.329031] RSP: 002b:00007fff7c59e3e0  EFLAGS: 00000293
>[17303.329033] RAX: 00000000000a5952 RBX: 6790dfeb2c58da5c RCX: 000000000150ac30
>[17303.329035] RDX: 00000000000a5952 RSI: 00000000000a5952 RDI: 000000000000005a
>[17303.329037] RBP: 000000717c2f4c3d R08: 0000001dec0cbb51 R09: 00000000000019d5
>[17303.329038] R10: 00000000000039d8 R11: 000000000000296f R12: 000000717c2f4c3f
>[17303.329040] R13: 0dad55ca04559e7d R14: 000000717c2f4c3c R15: 000000717c2f4c49
>[17303.329042] FS:  00007f7cdfe9c740(0000) GS:ffff880781ce0000(0000) knlGS:0000000000000000
>[17303.329044] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.329045] CR2: 00007f7cdfe88000 CR3: 0000000eed7e9000 CR4: 00000000000007e0
>[17303.329047] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329049] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329051] Process quad.1 (pid: 10007, threadinfo ffff880ee7526000, task ffff880ee7604560)
>[17303.329054] 
>[17303.329056] NMI backtrace for cpu 15
>[17303.329058] CPU 15 
>[17303.329061] Pid: 10009, comm: quad.11 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329063] RIP: 0033:[<0000000000401337>]  [<0000000000401337>] 0x401336
>[17303.329068] RSP: 002b:00007fffcf5047c0  EFLAGS: 00000206
>[17303.329070] RAX: 00000028bffbd9f0 RBX: 50b7747674617e0c RCX: 0000005d98270959
>[17303.329072] RDX: 000000517ff7b3e0 RSI: 0000000a2ffef67c RDI: 0000002e6cb9eb84
>[17303.329074] RBP: bc63cc4ae047a00c R08: 0000005d98270959 R09: 00000048f41bc74b
>[17303.329077] R10: 0000000b40344ad4 R11: 000000506fc25f88 R12: 00000071b417a13b
>[17303.329078] R13: 0cc7c29207668ff3 R14: 00000071b417a13a R15: 0000000000000069
>[17303.329081] FS:  00007fcea51fc740(0000) GS:ffff880f1fce0000(0000) knlGS:0000000000000000
>[17303.329083] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.329084] CR2: 00007fcea51e8000 CR3: 000000072f914000 CR4: 00000000000007e0
>[17303.329086] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329088] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329090] Process quad.11 (pid: 10009, threadinfo ffff880ee5e56000, task ffff880ee7602e40)
>[17303.329091] 
>[17303.329093] NMI backtrace for cpu 16
>[17303.329096] CPU 16 
>[17303.329100] Pid: 962, comm: in:imklog Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329102] RIP: 0033:[<00007f7998507105>]  [<00007f7998507105>] 0x7f7998507104
>[17303.329108] RSP: 002b:00007f79975fe320  EFLAGS: 00000246
>[17303.329109] RAX: 0000000000000000 RBX: 00007f798c000020 RCX: 0000000000000000
>[17303.329111] RDX: 00007f79975fe3a0 RSI: 0000000000000238 RDI: 00007f798c000020
>[17303.329112] RBP: 0000000000000240 R08: 0000000000000004 R09: 0000000000000024
>[17303.329113] R10: 0000000000000238 R11: 00007f7998605f30 R12: 00007f798c0002a8
>[17303.329115] R13: 00007f79975ffdd0 R14: 00007f79975ffe0c R15: 00007f79975ffe0b
>[17303.329117] FS:  00007f799761f700(0000) GS:ffff880781d00000(0000) knlGS:0000000000000000
>[17303.329118] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17303.329122] CR2: 00007f4ecf4e9000 CR3: 0000000ef1d15000 CR4: 00000000000007e0
>[17303.329123] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329125] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329127] Process in:imklog (pid: 962, threadinfo ffff880ef1ecc000, task ffff880ef2022e40)
>[17303.329128] 
>[17303.329130] NMI backtrace for cpu 17
>[17303.329132] CPU 17 
>[17303.329135] Pid: 10010, comm: quad.13 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329137] RIP: 0033:[<0000000000401268>]  [<0000000000401268>] 0x401267
>[17303.329144] RSP: 002b:00007fff18a2ccb0  EFLAGS: 00000207
>[17303.329147] RAX: 0000006e7f07c86e RBX: ccf8abcfa9fbf5cb RCX: 00000007679f0a90
>[17303.329148] RDX: 00000002bb2329bb RSI: 0000006e7f07c86e RDI: 00000058a5ee8c06
>[17303.329150] RBP: 892b261dbf79fc1e R08: 0000000000000ac6 R09: 000000000000022e
>[17303.329152] R10: 0000000000000ac6 R11: 00000000000024cf R12: 000000713a2aeffb
>[17303.329154] R13: 594a02306f12c333 R14: 000000713a2aeffa R15: 0000000000000569
>[17303.329156] FS:  00007f0c45718740(0000) GS:ffff880f1fd00000(0000) knlGS:0000000000000000
>[17303.329158] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17303.329160] CR2: 00007f0c45704000 CR3: 0000000ee55e2000 CR4: 00000000000007e0
>[17303.329162] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329163] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329165] Process quad.13 (pid: 10010, threadinfo ffff880ee71f0000, task ffff880ee7601720)
>[17303.329167] 
>[17303.329204] NMI backtrace for cpu 18
>[17303.329210] CPU 18 
>[17303.329216] Pid: 10013, comm: quad.23 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329222] RIP: 0033:[<0000000000401011>]  [<0000000000401011>] 0x401010
>[17303.329233] RSP: 002b:00007fff63b18020  EFLAGS: 00000216
>[17303.329241] RAX: 0000007238b48811 RBX: dbccccde3eb1bad8 RCX: 00000000bfffffff
>[17303.329246] RDX: 0000007238b487be RSI: 0000000000002820 RDI: 000000000000005a
>[17303.329251] RBP: 0000007238b4880d R08: 0000004f9070969b R09: 00000000000017c8
>[17303.329257] R10: 0000000000002117 R11: 00000000000020e1 R12: 0000007238b48811
>[17303.329263] R13: b27621d762ea3fb3 R14: 0000007238b48810 R15: 0000007238b4884d
>[17303.329271] FS:  00007fc7b2139740(0000) GS:ffff880781d20000(0000) knlGS:0000000000000000
>[17303.329277] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.329283] CR2: 0000000000cea1f8 CR3: 00000007259a1000 CR4: 00000000000007e0
>[17303.329288] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329295] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329301] Process quad.23 (pid: 10013, threadinfo ffff880eed482000, task ffff880ee5568000)
>[17303.329307] 
>[17303.329313] NMI backtrace for cpu 19
>[17303.329322] CPU 19 
>[17303.329331] Pid: 10023, comm: quad.61 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329338] RIP: 0033:[<000000000040101a>]  [<000000000040101a>] 0x401019
>[17303.329355] RSP: 002b:00007fff52029e30  EFLAGS: 00000297
>[17303.329359] RAX: 0000000000000007 RBX: fd62aa443d6b27f0 RCX: 00000041b52fa85e
>[17303.329361] RDX: 00000070e3b6ac48 RSI: 00000004fdd45ee0 RDI: 000000000000005a
>[17303.329363] RBP: 02e6246133401119 R08: 0000002dbdde2cde R09: 000000000000053f
>[17303.329364] R10: 0000000000002d84 R11: 0000000000001d6f R12: 00000070e3b6ac4f
>[17303.329366] R13: 2943e3d8e970b283 R14: 00000070e3b6ac4e R15: 00000070e3b6ac77
>[17303.329369] FS:  00007fce4f642740(0000) GS:ffff880f1fd20000(0000) knlGS:0000000000000000
>[17303.329371] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.329372] CR2: 0000000002567008 CR3: 0000000ef3d1e000 CR4: 00000000000007e0
>[17303.329374] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329376] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329377] Process quad.61 (pid: 10023, threadinfo ffff880ef27fc000, task ffff880ee50b1720)
>[17303.329378] 
>[17303.329404] NMI backtrace for cpu 20
>[17303.329405] CPU 20 
>[17303.329409] Pid: 10029, comm: quad.83 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329413] RIP: 0033:[<0000000000401272>]  [<0000000000401272>] 0x401271
>[17303.329417] RSP: 002b:00007fff1f727100  EFLAGS: 00000a07
>[17303.329419] RAX: f69f01857ef02129 RBX: f69f01857ef02129 RCX: 0000006052b92039
>[17303.329421] RDX: 00000009455c21cf RSI: 0000006f9131f04c RDI: 0000005fa38fa284
>[17303.329422] RBP: 8c8d9b31afc33c71 R08: 0000000000002ee7 R09: 0000000000002b6f
>[17303.329424] R10: 0000000000002ee7 R11: 00000000000028b0 R12: 000000718ee63a05
>[17303.329426] R13: b393e335860982cd R14: 000000718ee63a04 R15: 0000000000002183
>[17303.329428] FS:  00007f3d4a262740(0000) GS:ffff880781d40000(0000) knlGS:0000000000000000
>[17303.329429] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.329431] CR2: 00007f3d4a24e000 CR3: 0000000ef435f000 CR4: 00000000000007e0
>[17303.329435] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329437] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329439] Process quad.83 (pid: 10029, threadinfo ffff880eed508000, task ffff880ee5e6dc80)
>[17303.329440] 
>[17303.329504] NMI backtrace for cpu 21
>[17303.329506] CPU 21 
>[17303.329509] Pid: 10014, comm: quad.29 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329519] RIP: 0033:[<000000000040fba5>]  [<000000000040fba5>] 0x40fba4
>[17303.329537] RSP: 002b:00007fff29bf4f50  EFLAGS: 00000202
>[17303.329544] RAX: 000000000000ccc5 RBX: 00007f2814f88010 RCX: 0000000000000002
>[17303.329555] RDX: 0000000000000666 RSI: 00000000011cfc30 RDI: 0000000000000003
>[17303.329563] RBP: 0000000000000004 R08: 0000000000000001 R09: 0000000000000000
>[17303.329571] R10: 00007f2815009010 R11: 000000000000dce4 R12: 000000721d492e59
>[17303.329580] R13: 0e8a1de819493dad R14: 000000721d492e56 R15: 000000721d492e91
>[17303.329589] FS:  00007f281508b740(0000) GS:ffff880f1fd40000(0000) knlGS:0000000000000000
>[17303.329596] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17303.329606] CR2: 00007f2815077000 CR3: 000000072cbb9000 CR4: 00000000000007e0
>[17303.329614] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329622] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329632] Process quad.29 (pid: 10014, threadinfo ffff880ef34a8000, task ffff880ee556ae40)
>[17303.329639] 
>[17303.329647] NMI backtrace for cpu 22
>[17303.329652] CPU 22 
>[17303.329658] Pid: 10022, comm: quad.59 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329664] RIP: 0010:[<ffffffff81039889>]  [<ffffffff81039889>] default_send_IPI_mask_sequence_phys+0x79/0x100
>[17303.329681] RSP: 0000:ffff880781d63d98  EFLAGS: 00000046
>[17303.329685] RAX: ffff880f1fd60000 RBX: 000000000000b03a RCX: 0000000000000017
>[17303.329686] RDX: 0000000000000017 RSI: 0000000000000033 RDI: 0000000000000080
>[17303.329688] RBP: ffff880781d63dd8 R08: ffffffff81cdc590 R09: 0000000000000000
>[17303.329690] R10: 0000000000000000 R11: 0000000000000dad R12: ffffffff81cdc590
>[17303.329691] R13: 0000000000000400 R14: 0000000000000092 R15: 0000000000000002
>[17303.329693] FS:  00007fe61b3e6740(0000) GS:ffff880781d60000(0000) knlGS:0000000000000000
>[17303.329695] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.329697] CR2: 00007fe61b3d2000 CR3: 0000000ee5e50000 CR4: 00000000000007e0
>[17303.329698] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329700] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329702] Process quad.59 (pid: 10022, threadinfo ffff880ee5d38000, task ffff880ee50b0000)
>[17303.329710] Stack:
>[17303.329715]  ffffffff00000013 0000000000000016 ffff880781d63df8 0000000000002710
>[17303.329722]  0000000000000016 ffff880ee5d38000 ffffffff81c3c780 ffffffff81c3c600
>[17303.329726]  ffff880781d63de8 ffffffff8103d887 ffff880781d63e08 ffffffff81039a8d
>[17303.329733] Call Trace:
>[17303.329734]  <IRQ> 
>[17303.329736] 
>[17303.329740]  [<ffffffff8103d887>] physflat_send_IPI_all+0x17/0x20
>[17303.329743]  [<ffffffff81039a8d>] arch_trigger_all_cpu_backtrace+0x5d/0xa0
>[17303.329748]  [<ffffffff810f5435>] rcu_check_callbacks+0x5b5/0x650
>[17303.329752]  [<ffffffff8106fa48>] update_process_times+0x48/0x90
>[17303.329759]  [<ffffffff810b61ae>] tick_sched_timer+0x6e/0xe0
>[17303.329762]  [<ffffffff81086123>] __run_hrtimer+0x73/0x1d0
>[17303.329765]  [<ffffffff810b6140>] ? tick_nohz_handler+0x110/0x110
>[17303.329769]  [<ffffffff81067066>] ? __do_softirq+0x136/0x210
>[17303.329773]  [<ffffffff81086a47>] hrtimer_interrupt+0xf7/0x230
>[17303.329777]  [<ffffffff8163fbc9>] smp_apic_timer_interrupt+0x69/0x99
>[17303.329784]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[17303.329785]  <EOI> 
>[17303.329787] Code: 
>[17303.329788] 00 00 4c 89 e7 48 63 d2 e8 f5 e8 2b 00 89 c2 48 63 05 30 3e ca 00 48 39 c2 73 55 48 8b 04 d5 a0 ae cd 81 41 83 ff 02 0f b7 34 03 <74> 5c 8b 04 25 00 a3 5f ff f6 c4 10 74 17 66 0f 1f 84 00 00 00 
>[17303.329818] NMI backtrace for cpu 23
>[17303.329820] CPU 23 
>[17303.329825] Pid: 10030, comm: quad.89 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17303.329826] RIP: 0033:[<0000000000400f99>]  [<0000000000400f99>] 0x400f98
>[17303.329832] RSP: 002b:00007fffa41223d0  EFLAGS: 00000283
>[17303.329834] RAX: 000000000002a08a RBX: b2a2d69ef83b1fe3 RCX: 00000000fbffffdf
>[17303.329835] RDX: 00000000000a9d7a RSI: 0000000000001504 RDI: 000000000000005a
>[17303.329837] RBP: 00000070ae56e43b R08: 0000004e696e1008 R09: 000000000000012b
>[17303.329839] R10: 0000000000000b6f R11: 00000000000034ae R12: 00000070ae56e43d
>[17303.329841] R13: bffcc5942ca57237 R14: 00000070ae56e43a R15: 00000070ae56e445
>[17303.329843] FS:  00007fe38119d740(0000) GS:ffff880f1fd60000(0000) knlGS:0000000000000000
>[17303.329846] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17303.329848] CR2: 0000000001100008 CR3: 0000000ee711d000 CR4: 00000000000007e0
>[17303.329849] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17303.329851] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17303.329853] Process quad.89 (pid: 10030, threadinfo ffff880ee5d5e000, task ffff880ee7538000)
>[17303.329854] 
>[17482.927240] INFO: rcu_sched detected stalls on CPUs/tasks: { 17} (detected by 22, t=600017 jiffies)
>[17482.927247] sending NMI to all CPUs:
>[17482.927253] NMI backtrace for cpu 1
>[17482.927256] CPU 1 
>[17482.927261] Pid: 10020, comm: quad.49 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927263] RIP: 0033:[<000000000040102e>]  [<000000000040102e>] 0x40102d
>[17482.927281] RSP: 002b:00007fff9f9d0710  EFLAGS: 00000246
>[17482.927283] RAX: 000000000000002f RBX: c8e5fad36fa88ead RCX: 00000000dfffefff
>[17482.927285] RDX: 00000072ce4a3698 RSI: 0000000000003ce2 RDI: 000000000000005a
>[17482.927286] RBP: 00000072ce4a36a5 R08: 0000006b681d999e R09: 0000000000001bb7
>[17482.927288] R10: 00000000000020ec R11: 0000000000002c29 R12: 00000072ce4a36c9
>[17482.927290] R13: 5da6d63723b9e88f R14: 00000072ce4a36c8 R15: 00000072ce4a36c9
>[17482.927293] FS:  00007f2ccb02b740(0000) GS:ffff880f1fc00000(0000) knlGS:0000000000000000
>[17482.927295] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.927296] CR2: 00000000006e2b98 CR3: 0000000ee5d80000 CR4: 00000000000007e0
>[17482.927299] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927300] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927303] Process quad.49 (pid: 10020, threadinfo ffff880ee87e2000, task ffff880ef32f0000)
>[17482.927304] 
>[17482.927306] NMI backtrace for cpu 0
>[17482.927309] CPU 0 
>[17482.927313] Pid: 10021, comm: quad.53 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927315] RIP: 0033:[<00000000004011da>]  [<00000000004011da>] 0x4011d9
>[17482.927330] RSP: 002b:00007fff0a16d9f0  EFLAGS: 00000a07
>[17482.927332] RAX: 450e6228d9769921 RBX: 693fa3e421e811ca RCX: 0000005cb1ca8c11
>[17482.927334] RDX: 0000000000002190 RSI: 00000014fde10372 RDI: 00000049c5cabde7
>[17482.927335] RBP: f6e0a3e2565a2452 R08: 00000008ba467e49 R09: 9d280915a78945de
>[17482.927337] R10: 00000000000013cf R11: 0000000000002973 R12: 00000073271e611b
>[17482.927339] R13: 59a87c4b8da41113 R14: 00000073271e611a R15: 000000000000060c
>[17482.927341] FS:  00007f3ea5239740(0000) GS:ffff880781c00000(0000) knlGS:0000000000000000
>[17482.927343] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.927345] CR2: 00007fc133a2a000 CR3: 0000000ee564f000 CR4: 00000000000007f0
>[17482.927346] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927348] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927350] Process quad.53 (pid: 10021, threadinfo ffff880ee5d12000, task ffff880ef22b5c80)
>[17482.927351] 
>[17482.927353] NMI backtrace for cpu 2
>[17482.927356] CPU 2 
>[17482.927359] Pid: 10012, comm: quad.19 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927361] RIP: 0033:[<0000000000401272>]  [<0000000000401272>] 0x401271
>[17482.927367] RSP: 002b:00007fff03c73680  EFLAGS: 00000a03
>[17482.927369] RAX: 6ea42108c8f8856b RBX: 6ea42108c8f8856b RCX: 00000063600f951c
>[17482.927371] RDX: 000000635586a1ae RSI: 00000014be6b6dbf RDI: 00000046f5de792e
>[17482.927373] RBP: 496a54aff64250ba R08: 0000000000001d45 R09: 0000000000001549
>[17482.927374] R10: 0000000000001d45 R11: 0000000000002afa R12: 00000073bbe86289
>[17482.927376] R13: e222ba6d2813b3b9 R14: 00000073bbe86288 R15: 00000000000005cb
>[17482.927378] FS:  00007ffe77d4e740(0000) GS:ffff880781c20000(0000) knlGS:0000000000000000
>[17482.927380] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.927382] CR2: 00007ffe77d3b000 CR3: 0000000728486000 CR4: 00000000000007e0
>[17482.927384] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927385] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927387] Process quad.19 (pid: 10012, threadinfo ffff880ee5204000, task ffff880ef2f8dc80)
>[17482.927388] 
>[17482.927452] NMI backtrace for cpu 3
>[17482.927454] CPU 3 
>[17482.927457] Pid: 10026, comm: quad.73 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927459] RIP: 0033:[<000000000040fb90>]  [<000000000040fb90>] 0x40fb8f
>[17482.927466] RSP: 002b:00007fff42211ac0  EFLAGS: 00000202
>[17482.927468] RAX: 000000000004df65 RBX: 00007f229acc8010 RCX: 0000000000000008
>[17482.927469] RDX: 00000000000abd56 RSI: 0000000000e48c30 RDI: 000000000000001d
>[17482.927471] RBP: 0000000000000100 R08: 0000000000000001 R09: 0000000000000008
>[17482.927473] R10: 00007f229ad49010 R11: 000000000000ddfb R12: 0000007356c018d3
>[17482.927474] R13: bc958465c042d1c9 R14: 0000007356c018d0 R15: 0000007356c018e5
>[17482.927476] FS:  00007f229adcb740(0000) GS:ffff880f1fc20000(0000) knlGS:0000000000000000
>[17482.927478] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17482.927480] CR2: 00007f229adb7000 CR3: 000000072872f000 CR4: 00000000000007e0
>[17482.927482] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927483] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927485] Process quad.73 (pid: 10026, threadinfo ffff880ee55da000, task ffff880ee5e69720)
>[17482.927486] 
>[17482.927551] NMI backtrace for cpu 4
>[17482.927553] CPU 4 
>[17482.927557] Pid: 10017, comm: quad.41 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927559] RIP: 0033:[<0000000000400ff0>]  [<0000000000400ff0>] 0x400fef
>[17482.927565] RSP: 002b:00007ffff44fe870  EFLAGS: 00000297
>[17482.927567] RAX: 0000000000050266 RBX: 19dc73488d0ef950 RCX: 00000000fb5fffbf
>[17482.927569] RDX: 0000000000000006 RSI: 0000000000002813 RDI: 000000000000005a
>[17482.927571] RBP: 000000742a6f7401 R08: 0000000d6de5ab18 R09: 0000000000000ec4
>[17482.927572] R10: 0000000000001c0b R11: 00000000000005e6 R12: 000000742a6f7403
>[17482.927574] R13: e145b345ea39930d R14: 000000742a6f7400 R15: 000000742a6f745d
>[17482.927576] FS:  00007f4ecf4fd740(0000) GS:ffff880781c40000(0000) knlGS:0000000000000000
>[17482.927578] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.927580] CR2: 00007fbfcb578000 CR3: 00000007284f6000 CR4: 00000000000007e0
>[17482.927582] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927583] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927585] Process quad.41 (pid: 10017, threadinfo ffff880ee754c000, task ffff880ef2e64560)
>[17482.927587] 
>[17482.927651] NMI backtrace for cpu 5
>[17482.927653] CPU 5 
>[17482.927657] Pid: 10028, comm: quad.79 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927659] RIP: 0033:[<000000000040fb95>]  [<000000000040fb95>] 0x40fb94
>[17482.927666] RSP: 002b:00007fff0acd25e0  EFLAGS: 00000212
>[17482.927668] RAX: 0000000000099526 RBX: 00007fd30ac09010 RCX: 0000000000099526
>[17482.927670] RDX: 0000000000099526 RSI: 00000000010d5c30 RDI: 0000000000001345
>[17482.927671] RBP: 0000000000000002 R08: 0000000000000001 R09: 0000000000000291
>[17482.927673] R10: 00007fd30ac8a010 R11: 000000000000dd39 R12: 0000000000000050
>[17482.927675] R13: 1d33b6a641b3ca6b R14: 000000727fc39258 R15: 000000727fc39261
>[17482.927678] FS:  00007fd30ad0c740(0000) GS:ffff880f1fc40000(0000) knlGS:0000000000000000
>[17482.927680] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17482.927681] CR2: 000000000135b6c8 CR3: 0000000ef58d8000 CR4: 00000000000007e0
>[17482.927683] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927685] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927687] Process quad.79 (pid: 10028, threadinfo ffff880ef3866000, task ffff880ee5e6c560)
>[17482.927688] 
>[17482.927751] NMI backtrace for cpu 6
>[17482.927753] CPU 6 
>[17482.927756] Pid: 10024, comm: quad.67 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927758] RIP: 0033:[<0000000000401356>]  [<0000000000401356>] 0x401355
>[17482.927764] RSP: 002b:00007fff4ab1e640  EFLAGS: 00000207
>[17482.927766] RAX: ffffffdf3bcb6010 RBX: 96edb680e53f5d60 RCX: 00000067e083253a
>[17482.927768] RDX: 000000229c1542a5 RSI: 0000002f58fd6214 RDI: 000000111a6229c2
>[17482.927769] RBP: f4c8b74f60a20df4 R08: 00000051f512a4b9 R09: 000000280e990102
>[17482.927771] R10: 00000026920226fd R11: 0000002b63107dbc R12: 00000072b94744a9
>[17482.927772] R13: 1d252256918b9f99 R14: 00000072b94744a8 R15: 00000000000015f4
>[17482.927774] FS:  00007f77d7fc0740(0000) GS:ffff880781c60000(0000) knlGS:0000000000000000
>[17482.927776] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.927779] CR2: 00007fdaa6dd4000 CR3: 0000000ef36fd000 CR4: 00000000000007e0
>[17482.927781] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927782] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927784] Process quad.67 (pid: 10024, threadinfo ffff880ee5520000, task ffff880ee50b4560)
>[17482.927785] 
>[17482.927787] NMI backtrace for cpu 7
>[17482.927789] CPU 7 
>[17482.927793] Pid: 10008, comm: quad.7 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927795] RIP: 0033:[<0000000000401215>]  [<0000000000401215>] 0x401214
>[17482.927801] RSP: 002b:00007fff4c37a3d0  EFLAGS: 00000a07
>[17482.927803] RAX: 0b18c13d66fa9547 RBX: 0e880e1af7048b74 RCX: 000000000000347f
>[17482.927805] RDX: 0000000a31d1791f RSI: 0000002694139207 RDI: 000000729d26cd45
>[17482.927807] RBP: 0b18c13d66fa9547 R08: 00000097e708bf4d R09: 000000239b4414d0
>[17482.927808] R10: 0000000000001df0 R11: 000000000000347f R12: 000000744bc4aa7d
>[17482.927810] R13: 0b9eefa418c99ed5 R14: 000000744bc4aa7c R15: 0000000000001145
>[17482.927812] FS:  00007f3f63c59740(0000) GS:ffff880f1fc60000(0000) knlGS:0000000000000000
>[17482.927814] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.927816] CR2: 0000003fea6bb750 CR3: 00000007755a1000 CR4: 00000000000007e0
>[17482.927818] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927819] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927821] Process quad.7 (pid: 10008, threadinfo ffff880ee8f34000, task ffff880ee7605c80)
>[17482.927822] 
>[17482.927851] NMI backtrace for cpu 8
>[17482.927853] CPU 8 
>[17482.927856] Pid: 10025, comm: quad.71 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927858] RIP: 0033:[<00000000004011fb>]  [<00000000004011fb>] 0x4011fa
>[17482.927864] RSP: 002b:00007fff01f2eaf0  EFLAGS: 00000202
>[17482.927866] RAX: bcdd9f69a239ab84 RBX: cede93662ce3be94 RCX: 000000496c7588ee
>[17482.927868] RDX: 00000000000002b2 RSI: 0000000bc912e4b4 RDI: 0000006a11aa0a54
>[17482.927870] RBP: 1afc6d37cd73d054 R08: 00000063b49f7f0c R09: 1200f3fc8aaa1310
>[17482.927871] R10: 0000000000000794 R11: 00000000000019f1 R12: 0000007462b86fcf
>[17482.927873] R13: 62c61de23782372f R14: 0000007462b86fce R15: 00000000000004e2
>[17482.927875] FS:  00007f7c7489e740(0000) GS:ffff880781c80000(0000) knlGS:0000000000000000
>[17482.927877] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.927879] CR2: 00007fc10a0d1000 CR3: 0000000ee7653000 CR4: 00000000000007e0
>[17482.927880] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927882] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927884] Process quad.71 (pid: 10025, threadinfo ffff880ee5dae000, task ffff880ee5e68000)
>[17482.927885] 
>[17482.927951] NMI backtrace for cpu 9
>[17482.927953] CPU 9 
>[17482.927957] Pid: 10027, comm: quad.77 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.927959] RIP: 0033:[<0000000000401236>]  [<0000000000401236>] 0x401235
>[17482.927965] RSP: 002b:00007fffe107ea70  EFLAGS: 00000a13
>[17482.927967] RAX: ad20d9e57687489c RBX: 2660a8831f221631 RCX: 000000132dd10f40
>[17482.927969] RDX: 0000000f2a9aa506 RSI: 0000006fa3cc4c5c RDI: 00000000000004de
>[17482.927971] RBP: 5b81074fb1e3d7f9 R08: 00000000000004de R09: 0000000e5ee0be4f
>[17482.927973] R10: 0000000000003967 R11: 0000000000003320 R12: 00000072c0376d93
>[17482.927975] R13: 805a6cc8aef5b89b R14: 00000072c0376d92 R15: 00000000000025d4
>[17482.927977] FS:  00007f7f2abe2740(0000) GS:ffff880f1fc80000(0000) knlGS:0000000000000000
>[17482.927979] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.927981] CR2: 00007f7f2abce000 CR3: 0000000ee5a3c000 CR4: 00000000000007e0
>[17482.927982] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.927984] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.927986] Process quad.77 (pid: 10027, threadinfo ffff880ee7576000, task ffff880ee5e6ae40)
>[17482.927987] 
>[17482.928051] NMI backtrace for cpu 10
>[17482.928052] CPU 10 
>[17482.928055] Pid: 10019, comm: quad.47 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928057] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[17482.928062] RSP: 002b:00007fffb25fb220  EFLAGS: 00000202
>[17482.928064] RAX: 00000000000243dd RBX: 00007f98e8c46010 RCX: 0000000000000006
>[17482.928065] RDX: 000000000000121e RSI: 0000000001810c30 RDI: 0000000000000017
>[17482.928067] RBP: 0000000000000040 R08: 0000000000000001 R09: 0000000000000007
>[17482.928068] R10: 00007f98e8cc7010 R11: 000000000000dd6a R12: 00000072b206fe3f
>[17482.928070] R13: c7943551ab92c5d7 R14: 00000072b206fe3a R15: 00000072b206fe41
>[17482.928072] FS:  00007f98e8d49740(0000) GS:ffff880781ca0000(0000) knlGS:0000000000000000
>[17482.928073] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17482.928075] CR2: 0000003fea6797d0 CR3: 0000000ef579a000 CR4: 00000000000007e0
>[17482.928076] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928078] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928079] Process quad.47 (pid: 10019, threadinfo ffff880ee5d76000, task ffff880ee8901720)
>[17482.928080] 
>[17482.928151] NMI backtrace for cpu 11
>[17482.928154] CPU 11 
>[17482.928157] Pid: 10016, comm: quad.37 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928159] RIP: 0033:[<00000000004011ce>]  [<00000000004011ce>] 0x4011cd
>[17482.928165] RSP: 002b:00007fff110c3e40  EFLAGS: 00000a07
>[17482.928167] RAX: 54af0bf4e6cc5e60 RBX: 6454083f5a5117d4 RCX: 00000026722c9043
>[17482.928169] RDX: 0000000000000329 RSI: 0000004e05158910 RDI: 0000000a5f96ca86
>[17482.928171] RBP: fcf0cc7ce031fd14 R08: 0000004844ebef88 R09: 0000002cbf63081a
>[17482.928173] R10: 00000026722c9043 R11: 00000021d2bf5f45 R12: 000000734d072bd7
>[17482.928174] R13: 1324c0b6c73df7e7 R14: 000000734d072bd6 R15: 00000000000003c8
>[17482.928177] FS:  00007f22a5f07740(0000) GS:ffff880f1fca0000(0000) knlGS:0000000000000000
>[17482.928179] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.928180] CR2: 00007f22a5ef3000 CR3: 0000000775d73000 CR4: 00000000000007e0
>[17482.928182] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928184] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928186] Process quad.37 (pid: 10016, threadinfo ffff880ee5de4000, task ffff880ef6b2c560)
>[17482.928187] 
>[17482.928252] NMI backtrace for cpu 12
>[17482.928261] CPU 12 
>[17482.928270] Pid: 10015, comm: quad.31 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928279] RIP: 0033:[<00000000004011da>]  [<00000000004011da>] 0x4011d9
>[17482.928295] RSP: 002b:00007fffd392bda0  EFLAGS: 00000a17
>[17482.928305] RAX: 410cbf25810ba190 RBX: e8ec1d52453574c5 RCX: 0000000a03401bec
>[17482.928314] RDX: 0000000000000064 RSI: 000000229254a025 RDI: 00000050451a453f
>[17482.928323] RBP: 3447ba76db23d22d R08: 0000006699ccf766 R09: 0f6f11450ebf621b
>[17482.928333] R10: 0000000a03401bec R11: 0000005c968cdb7a R12: 000000736fefae07
>[17482.928342] R13: c57897085fba5fb7 R14: 000000736fefae06 R15: 0000000000000ad7
>[17482.928351] FS:  00007f29fe59d740(0000) GS:ffff880781cc0000(0000) knlGS:0000000000000000
>[17482.928360] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.928369] CR2: 00007f29fe58a000 CR3: 00000007755cc000 CR4: 00000000000007e0
>[17482.928378] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928387] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928397] Process quad.31 (pid: 10015, threadinfo ffff880ee8cde000, task ffff880ef600c560)
>[17482.928405] 
>[17482.928414] NMI backtrace for cpu 13
>[17482.928420] CPU 13 
>[17482.928427] Pid: 10018, comm: quad.43 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928434] RIP: 0033:[<00000000004011e0>]  [<00000000004011e0>] 0x4011df
>[17482.928442] RSP: 002b:00007fffc3c95020  EFLAGS: 00000a07
>[17482.928444] RAX: bf137ce2cda58fe1 RBX: e794b99542e10abd RCX: 0000000f49ec9f71
>[17482.928445] RDX: 00000000000000e9 RSI: 0000006098bf8f11 RDI: 00000037ecfc08ae
>[17482.928447] RBP: bf137ce2cda58fe1 R08: 0000005dba378721 R09: 3d11f7894f67c58e
>[17482.928449] R10: 0000000f49ec9f71 R11: 00000000000000e9 R12: 0000007434d248fd
>[17482.928451] R13: 5eaf883258821455 R14: 0000007434d248fc R15: 000000000000151a
>[17482.928453] FS:  00007fbdccb72740(0000) GS:ffff880f1fcc0000(0000) knlGS:0000000000000000
>[17482.928455] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.928457] CR2: 00007fbdccb5f000 CR3: 00000007286ba000 CR4: 00000000000007e0
>[17482.928458] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928460] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928462] Process quad.43 (pid: 10018, threadinfo ffff880eed742000, task ffff880ef609c560)
>[17482.928463] 
>[17482.928465] NMI backtrace for cpu 14
>[17482.928467] CPU 14 
>[17482.928470] Pid: 10007, comm: quad.1 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928472] RIP: 0033:[<0000000000401009>]  [<0000000000401009>] 0x401008
>[17482.928476] RSP: 002b:00007fff7c59e3e0  EFLAGS: 00000a87
>[17482.928478] RAX: 999999ab8d8899f1 RBX: b4b931601b3b331d RCX: 0000004e38708875
>[17482.928480] RDX: 00000014847edbd1 RSI: 000000736949947b RDI: 000000000000005a
>[17482.928481] RBP: 1475ce0908f7f4c5 R08: 000000577ffce9e9 R09: 00000000000005a1
>[17482.928483] R10: 00000000000043f0 R11: 000000000000211e R12: 000000736949947b
>[17482.928484] R13: 44ccfeba272930bb R14: 000000736949947a R15: 0000007369499485
>[17482.928486] FS:  00007f7cdfe9c740(0000) GS:ffff880781ce0000(0000) knlGS:0000000000000000
>[17482.928488] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.928490] CR2: 00007f7cdfe89000 CR3: 0000000eed7e9000 CR4: 00000000000007e0
>[17482.928491] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928493] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928495] Process quad.1 (pid: 10007, threadinfo ffff880ee7526000, task ffff880ee7604560)
>[17482.928496] 
>[17482.928552] NMI backtrace for cpu 15
>[17482.928554] CPU 15 
>[17482.928557] Pid: 10009, comm: quad.11 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928559] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[17482.928565] RSP: 002b:00007fffcf504790  EFLAGS: 00000206
>[17482.928567] RAX: 00000000000746e3 RBX: 00007fcea50f9010 RCX: 0000000000000012
>[17482.928569] RDX: 0000000000003a2f RSI: 00000000009f0c30 RDI: 00000000000000f1
>[17482.928570] RBP: 0000000000040000 R08: 0000000000000001 R09: 0000000000000033
>[17482.928572] R10: 00007fcea517a010 R11: 000000000000de33 R12: 0000000000000048
>[17482.928573] R13: f325045738226453 R14: 0000007390157ffa R15: 0000007390158001
>[17482.928575] FS:  00007fcea51fc740(0000) GS:ffff880f1fce0000(0000) knlGS:0000000000000000
>[17482.928577] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17482.928578] CR2: 00007fcea51e9000 CR3: 000000072f914000 CR4: 00000000000007e0
>[17482.928580] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928582] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928583] Process quad.11 (pid: 10009, threadinfo ffff880ee5e56000, task ffff880ee7602e40)
>[17482.928585] 
>[17482.928651] NMI backtrace for cpu 16
>[17482.928659] CPU 16 
>[17482.928668] Pid: 10011, comm: quad.17 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928677] RIP: 0033:[<0000000000401272>]  [<0000000000401272>] 0x401271
>[17482.928692] RSP: 002b:00007fffd2a7cf00  EFLAGS: 00000a17
>[17482.928701] RAX: 904a4d9e482d4ee6 RBX: 904a4d9e482d4ee6 RCX: 0000006cd8c24bb0
>[17482.928710] RDX: 0000003ce20cbaa6 RSI: 00000064ade23683 RDI: 0000005aa8696ec2
>[17482.928719] RBP: 60558afa37830d46 R08: 0000000000000688 R09: 0000000000000103
>[17482.928727] R10: 0000000000000688 R11: 000000000000249e R12: 000000747e5ced1f
>[17482.928736] R13: 4c972c665b724edf R14: 000000747e5ced1e R15: 00000000000000af
>[17482.928745] FS:  00007fdaa6de7740(0000) GS:ffff880781d00000(0000) knlGS:0000000000000000
>[17482.928758] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.928766] CR2: 00007f4ecf4ea000 CR3: 000000072877f000 CR4: 00000000000007e0
>[17482.928775] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928779] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928781] Process quad.17 (pid: 10011, threadinfo ffff880ef1c6a000, task ffff880ef25bdc80)
>[17482.928783] 
>[17482.928785] NMI backtrace for cpu 17
>[17482.928788] CPU 17 
>[17482.928791] Pid: 10010, comm: quad.13 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928793] RIP: 0033:[<000000000040123d>]  [<000000000040123d>] 0x40123c
>[17482.928799] RSP: 002b:00007fff18a2ccb0  EFLAGS: 00000283
>[17482.928801] RAX: 00000036ce472361 RBX: dfef675cf454260a RCX: 0000003ba408f383
>[17482.928803] RDX: 0000003c59923f35 RSI: 0000003183d47d4f RDI: ffffffc3a66dc716
>[17482.928804] RBP: 2e68bbd67c925433 R08: 000000000000064b R09: 000000101578cc6e
>[17482.928805] R10: 00000000000015a7 R11: 0000000000004028 R12: 0000007327d95c4b
>[17482.928807] R13: 7a982b74b3d48d63 R14: 0000007327d95c4a R15: 000000000000135f
>[17482.928809] FS:  00007f0c45718740(0000) GS:ffff880f1fd00000(0000) knlGS:0000000000000000
>[17482.928811] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17482.928812] CR2: 00007f0c45704000 CR3: 0000000ee55e2000 CR4: 00000000000007e0
>[17482.928815] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928820] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928822] Process quad.13 (pid: 10010, threadinfo ffff880ee71f0000, task ffff880ee7601720)
>[17482.928822] 
>[17482.928824] NMI backtrace for cpu 21
>[17482.928826] CPU 21 
>[17482.928829] Pid: 10014, comm: quad.29 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928830] RIP: 0033:[<0000000000400fa0>]  [<0000000000400fa0>] 0x400f9f
>[17482.928835] RSP: 002b:00007fff29bf4f80  EFLAGS: 00000293
>[17482.928836] RAX: 000000000004d7e3 RBX: 22af27b324498b3d RCX: 00000000fffffff7
>[17482.928838] RDX: 00000000000ac516 RSI: 00000000000026bf RDI: 000000000000005a
>[17482.928840] RBP: 00000073fd670373 R08: 0000003f78099965 R09: 00000000000002e3
>[17482.928841] R10: 0000000000004b23 R11: 0000000000001d77 R12: 00000073fd670375
>[17482.928843] R13: 491822a5dbcc189f R14: 00000073fd670372 R15: 00000073fd67037f
>[17482.928845] FS:  00007f281508b740(0000) GS:ffff880f1fd40000(0000) knlGS:0000000000000000
>[17482.928847] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.928848] CR2: 00007f2815078000 CR3: 000000072cbb9000 CR4: 00000000000007e0
>[17482.928850] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928852] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928854] Process quad.29 (pid: 10014, threadinfo ffff880ef34a8000, task ffff880ee556ae40)
>[17482.928855] 
>[17482.928857] NMI backtrace for cpu 18
>[17482.928859] CPU 18 
>[17482.928862] Pid: 10013, comm: quad.23 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928864] RIP: 0033:[<000000000040fba9>]  [<000000000040fba9>] 0x40fba8
>[17482.928870] RSP: 002b:00007fff63b17ff0  EFLAGS: 00000206
>[17482.928872] RAX: 00000000000d9c92 RBX: 00007fc7b2036010 RCX: 0000000000000019
>[17482.928874] RDX: 0000000000002e1f RSI: 00000000014a2c30 RDI: 000000000007d899
>[17482.928876] RBP: 0000000002000000 R08: 0000000000000001 R09: 000000000000a671
>[17482.928878] R10: 00007fc7b20b7010 R11: 000000000000debe R12: 0000000000000050
>[17482.928879] R13: 38fcb09ef5f359a5 R14: 0000007425c3e670 R15: 0000007425c3e679
>[17482.928882] FS:  00007fc7b2139740(0000) GS:ffff880781d20000(0000) knlGS:0000000000000000
>[17482.928883] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17482.928885] CR2: 0000000000cea1f8 CR3: 00000007259a1000 CR4: 00000000000007e0
>[17482.928887] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928889] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928891] Process quad.23 (pid: 10013, threadinfo ffff880eed482000, task ffff880ee5568000)
>[17482.928892] 
>[17482.928894] NMI backtrace for cpu 19
>[17482.928896] CPU 19 
>[17482.928899] Pid: 10023, comm: quad.61 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928900] RIP: 0033:[<0000000000400f99>]  [<0000000000400f99>] 0x400f98
>[17482.928905] RSP: 002b:00007fff52029e30  EFLAGS: 00000283
>[17482.928907] RAX: 000000000002aacf RBX: e669aaaf93832618 RCX: 00000000df7ffefd
>[17482.928908] RDX: 00000000000ab6ea RSI: 0000000000001556 RDI: 000000000000005a
>[17482.928910] RBP: 00000072ccfee375 R08: 00000023a5b8c79c R09: 0000000000000897
>[17482.928911] R10: 00000000000031a5 R11: 0000000000003315 R12: 00000072ccfee377
>[17482.928913] R13: 97d59bf10f2cbf13 R14: 00000072ccfee374 R15: 00000072ccfee383
>[17482.928915] FS:  00007fce4f642740(0000) GS:ffff880f1fd20000(0000) knlGS:0000000000000000
>[17482.928917] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.928919] CR2: 00007fce4f62e000 CR3: 0000000ef3d1e000 CR4: 00000000000007e0
>[17482.928920] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.928922] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.928924] Process quad.61 (pid: 10023, threadinfo ffff880ef27fc000, task ffff880ee50b1720)
>[17482.928925] 
>[17482.928951] NMI backtrace for cpu 20
>[17482.928960] CPU 20 
>[17482.928969] Pid: 10029, comm: quad.83 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.928978] RIP: 0033:[<000000000040129d>]  [<000000000040129d>] 0x40129c
>[17482.928995] RSP: 002b:00007fff1f727100  EFLAGS: 00000202
>[17482.929004] RAX: 0000006173e4c484 RBX: 6c7005a4a156ec3a RCX: 00000030b9f26242
>[17482.929013] RDX: 0000006173e4c484 RSI: 00000000ddee5362 RDI: 00000007cd60ee72
>[17482.929022] RBP: 71eb4a73248c3191 R08: 0000002d423914ba R09: 00000042bfadc6b5
>[17482.929031] R10: 0000007379a028f7 R11: 0000007379a028f7 R12: 0000007379a028f7
>[17482.929040] R13: 06b858316b5f18c7 R14: 0000007379a028f6 R15: 000000000000066f
>[17482.929049] FS:  00007f3d4a262740(0000) GS:ffff880781d40000(0000) knlGS:0000000000000000
>[17482.929059] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.929068] CR2: 00007f3d4a24f000 CR3: 0000000ef435f000 CR4: 00000000000007e0
>[17482.929076] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.929086] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.929096] Process quad.83 (pid: 10029, threadinfo ffff880eed508000, task ffff880ee5e6dc80)
>[17482.929101] 
>[17482.929103] NMI backtrace for cpu 22
>[17482.929104] CPU 22 
>[17482.929107] Pid: 10022, comm: quad.59 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.929109] RIP: 0010:[<ffffffff81039889>]  [<ffffffff81039889>] default_send_IPI_mask_sequence_phys+0x79/0x100
>[17482.929115] RSP: 0000:ffff880781d63d98  EFLAGS: 00000046
>[17482.929116] RAX: ffff880f1fd60000 RBX: 000000000000b03a RCX: 0000000000000017
>[17482.929118] RDX: 0000000000000017 RSI: 0000000000000033 RDI: 0000000000000080
>[17482.929119] RBP: ffff880781d63dd8 R08: ffffffff81cdc590 R09: 0000000000000000
>[17482.929121] R10: 0000000000000000 R11: 0000000000000f69 R12: ffffffff81cdc590
>[17482.929122] R13: 0000000000000400 R14: 0000000000000092 R15: 0000000000000002
>[17482.929124] FS:  00007fe61b3e6740(0000) GS:ffff880781d60000(0000) knlGS:0000000000000000
>[17482.929126] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>[17482.929127] CR2: 00007fe61b3d2000 CR3: 0000000ee5e50000 CR4: 00000000000007e0
>[17482.929129] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.929130] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.929132] Process quad.59 (pid: 10022, threadinfo ffff880ee5d38000, task ffff880ee50b0000)
>[17482.929133] Stack:
>[17482.929134]  ffffffff00000013 0000000000000016 ffff880781d63df8 0000000000002710
>[17482.929140]  0000000000000016 ffff880ee5d38000 ffffffff81c3c780 ffffffff81c3c600
>[17482.929144]  ffff880781d63de8 ffffffff8103d887 ffff880781d63e08 ffffffff81039a8d
>[17482.929148] Call Trace:
>[17482.929150]  <IRQ> 
>[17482.929152] 
>[17482.929155]  [<ffffffff8103d887>] physflat_send_IPI_all+0x17/0x20
>[17482.929159]  [<ffffffff81039a8d>] arch_trigger_all_cpu_backtrace+0x5d/0xa0
>[17482.929163]  [<ffffffff810f5435>] rcu_check_callbacks+0x5b5/0x650
>[17482.929167]  [<ffffffff8106fa48>] update_process_times+0x48/0x90
>[17482.929172]  [<ffffffff810b61ae>] tick_sched_timer+0x6e/0xe0
>[17482.929175]  [<ffffffff81086123>] __run_hrtimer+0x73/0x1d0
>[17482.929178]  [<ffffffff810b6140>] ? tick_nohz_handler+0x110/0x110
>[17482.929182]  [<ffffffff81067066>] ? __do_softirq+0x136/0x210
>[17482.929186]  [<ffffffff81086a47>] hrtimer_interrupt+0xf7/0x230
>[17482.929190]  [<ffffffff8163fbc9>] smp_apic_timer_interrupt+0x69/0x99
>[17482.929195]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[17482.929196]  <EOI> 
>[17482.929197] Code: 
>[17482.929198] 00 00 4c 89 e7 48 63 d2 e8 f5 e8 2b 00 89 c2 48 63 05 30 3e ca 00 48 39 c2 73 55 48 8b 04 d5 a0 ae cd 81 41 83 ff 02 0f b7 34 03 <74> 5c 8b 04 25 00 a3 5f ff f6 c4 10 74 17 66 0f 1f 84 00 00 00 
>[17482.932388] NMI backtrace for cpu 23
>[17482.932894] CPU 23 
>[17482.933022] Pid: 10030, comm: quad.89 Tainted: G        W    3.7.4-204.fc18.x86_64 #1 HP ProLiant DL380 G7
>[17482.933023] RIP: 0010:[<ffffffff81041df6>]  [<ffffffff81041df6>] read_hpet+0x16/0x20
>[17482.933086] RSP: 0000:ffff880f1fd63e68  EFLAGS: 00000017
>[17482.933087] RAX: 0000000069ed2308 RBX: ffffffff81c20e00 RCX: 0000000000000000
>[17482.933337] RDX: ffffffff810b6140 RSI: ffff880f1fd6e750 RDI: ffffffff81c20e00
>[17482.933339] RBP: ffff880f1fd63e68 R08: 0000000000000000 R09: 0000000000000000
>[17482.933779] R10: 0000000000000005 R11: 0000000000000004 R12: 0000000000004472
>[17482.934158] R13: 0000000001429154 R14: ffff880f1fd6e740 R15: 00000fefb5f66527
>[17482.934160] FS:  00007fe38119d740(0000) GS:ffff880f1fd60000(0000) knlGS:0000000000000000
>[17482.934161] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>[17482.934163] CR2: 00007fe381189000 CR3: 0000000ee711d000 CR4: 00000000000007e0
>[17482.934164] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>[17482.934166] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>[17482.934167] Process quad.89 (pid: 10030, threadinfo ffff880ee5d5e000, task ffff880ee7538000)
>[17482.934168] Stack:
>[17482.934169]  ffff880f1fd63e98 ffffffff810ae772 ffff880f1fd6e960 ffff880f1fd6e960
>[17482.934174]  ffff880ee5d5ff58 ffff880f1fd6e700 ffff880f1fd63ec8 ffffffff810b616a
>[17482.934178]  ffff880f1fd63f50 ffff880f1fd6e960 ffff880f1fd63f50 ffff880f1fd6e700
>[17482.934181] Call Trace:
>[17482.934182]  <IRQ> 
>[17482.934184] 
>[17482.934189]  [<ffffffff810ae772>] ktime_get+0x52/0xe0
>[17482.934193]  [<ffffffff810b616a>] tick_sched_timer+0x2a/0xe0
>[17482.934196]  [<ffffffff81086123>] __run_hrtimer+0x73/0x1d0
>[17482.934199]  [<ffffffff810b6140>] ? tick_nohz_handler+0x110/0x110
>[17482.934203]  [<ffffffff81067066>] ? __do_softirq+0x136/0x210
>[17482.934205]  [<ffffffff81086a47>] hrtimer_interrupt+0xf7/0x230
>[17482.934209]  [<ffffffff8163fbc9>] smp_apic_timer_interrupt+0x69/0x99
>[17482.934213]  [<ffffffff8163eb1d>] apic_timer_interrupt+0x6d/0x80
>[17482.934214]  <EOI> 
>[17482.934216] Code: 
>[17482.935362] hrtimer: interrupt took 5221836 ns
>[17482.934217] 00 29 c7 ba 00 00 00 00 b8 c2 ff ff ff 83 ff 7f 0f 4f c2 5d c3 66 66 66 66 90 55 48 8b 05 a3 ad df 00 48 89 e5 8b 80 f0 00 00 00 <89> c0 5d c3 66 0f 1f 44 00 00 66 66 66 66 90 44 8b 05 8c ad df 
>[17483.143806] Kernel panic - not syncing: An NMI occurred, please see the Integrated Management Log for details..
>[17483.143985] Pid: 10014, comm: quad.29 Tainted: G        W    3.7.4-204.fc18.x86_64 #1
>[17483.144097] Call Trace:
>[17483.144133]  <NMI>  [<ffffffff8162b813>] panic+0xc1/0x1d0
>[17483.144226]  [<ffffffffa03a34b5>] hpwdt_pretimeout+0xc5/0xc8 [hpwdt]
>[17483.144320]  [<ffffffff81636d91>] nmi_handle.isra.0+0x51/0x80
>[17483.144404]  [<ffffffff81636f0a>] do_nmi+0x14a/0x350
>[17483.144476]  [<ffffffff816363b0>] end_repeat_nmi+0x1e/0x2e

Actions: View

Attachments on bug 885351: 660438 | 676529 | 676593 | 688611 | 688612 | 688729 | 688730 | 689121 | 689122 | 689123