Attachment 312338 Details for Bug 456228 – sanboot freeze sysrq

sanboot freeze sysrq

sanboot.TXT (text/plain), 103.00 KB, created by Ritesh Raj Sarraf on 2008-07-22 12:21:45 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Ritesh Raj Sarraf

Created: 2008-07-22 12:21:45 UTC

Size: 103.00 KB

patch

obsolete

>Memory for crash kernel (0x0 to 0x0) notwithin permissible range
>PCI: BIOS Bug: MCFG area at e0000000 is not E820-reserved
>PCI: Not using MMCONFIG.
>ACPI: Resource is not an IRQ entry
>ACPI: Resource is not an IRQ entry
>ACPI: Resource is not an IRQ entry
>ACPI: Resource is not an IRQ entry
>PCI: Cannot allocate resource region 1 of device 0000:00:00.0
>ÿide1: I/O resource 0x170-0x177 not free.
>ide1: ports already in use, skipping probe
>Red Hat nash version 5.1.19.6 starting
>iscsistart: transport class version 2.0-724. iscsid version 2.0-868
>iscsistart: version 2.0-868
>iscsistart: Logging into iqn.1992-08.com.netapp:sn.101180506 10.72.199.143:3260,1000
>iscsistart: received iferror -38
>iscsistart: received iferror -38
>iscsistart: received iferror -38
>iscsistart: connection1:0 is operational now
>iscsistart: transport class version 2.0-724. iscsid version 2.0-868
>iscsistart: version 2.0-868
>iscsistart: Logging into iqn.1992-08.com.netapp:sn.101180506 10.72.199.143:3260,1000
>iscsistart: session [iqn.1992-08.com.netapp:sn.101180506,10.72.199.143,3260] already running.
>iscsistart: initiator reported error (15 - already exists)
>		Welcome to Red Hat Enterprise Linux Server
>		Press 'I' to enter interactive startup.
>Setting clock  (utc): Wed Jul 16 17:34:21 IST 2008 [  OK  ]

>Starting udev: [  OK  ]

>Loading default keymap (us): [  OK  ]

>Setting hostname lnx199-112.lab.eng.btc.netapp.in:  [  OK  ]

>Setting up Logical Volume Management:   No volume groups found
>[  OK  ]

>Checking filesystems
>Checking all file systems.
>[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/mapper/mpath0p1 
>/: clean, 86240/2050272 files, 629926/2048279 blocks
>[/sbin/fsck.ext3 (1) -- /boot] fsck.ext3 -a /dev/sdb1 
>/boot1: clean, 34/17924096 files, 611140/17920499 blocks
>[  OK  ]

>Remounting root filesystem in read-write mode:  [  OK  ]

>Mounting local filesystems:  [  OK  ]

>Enabling local filesystem quotas:  [  OK  ]

>Enabling /etc/fstab swaps:  [  O
INIT: Entering runlevel: 5

>Entering non-interactive startup
>Applying Intel CPU microcode update: [  OK  ]

>Starting background readahead: [  OK  ]

>Checking for hardware changes [  OK  ]

>Enabling ondemand cpu frequency scaling: [  OK  ]

>Turning off network shutdown. Starting iSCSI daemon: [  OK  ]

>[  OK  ]

>SysRq : HELP : loglevel0-8 reBoot Crashdump tErm Full kIll saK showMem Nice powerOff showPc unRaw Sync showTasks Unmount shoWcpus 
>SysRq : Show State
>SysRq : Show Memory
>SysRq : Show Regs
>SysRq : Show State
>SysRq : Changing Loglevel
>Loglevel set to 6
>SysRq : Show State
>
>                                                       sibling
>  task                 PC          pid father child younger older
>init          S ffffffff80142f55     0     1      0     2               (NOTLB)
> ffff81007ffbfa18 0000000000000086 ffff81007ea0b63c 0000000000000000
> 0000000000000000 000000000000000a ffff81007ffaf7a0 ffff8100026d4100
> 00000085818d3915 0000000000003e77 ffff81007ffaf988 000000018000b083
>Call Trace:
> [<ffffffff80063803>] schedule_timeout+0x8a/0xad
> [<ffffffff8009543e>] process_timeout+0x0/0x5
> [<ffffffff8001155f>] do_select+0x3fe/0x462
> [<ffffffff8001e476>] __pollwait+0x0/0xe2
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff80009523>] __d_lookup+0xb0/0xff
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff8011f7e2>] inode_has_perm+0x56/0x63
> [<ffffffff800df607>] core_sys_select+0x1bc/0x265
> [<ffffffff8002cb15>] mntput_no_expire+0x19/0x89
> [<ffffffff8001a7b3>] cp_new_stat+0xe5/0xfd
> [<ffffffff80016302>] sys_select+0x153/0x17c
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>migration/0   S ffff81007ffaf040     0     2      1             3       (L-TLB)
> ffff8100026c1ea0 0000000000000046 0000000000000000 0000000000000000
> ffff810037f82860 0000000000000001 ffff81007ffaf040 ffff810037f6d080
> 0000001bc4014ad5 0000000000001188 ffff81007ffaf228 0000000000000000
>Call Trace:
> [<ffffffff80089241>] __wake_up_common+0x3e/0x68
> [<ffffffff80044784>] migration_thread+0x1a4/0x23c
> [<ffffffff800445e0>] migration_thread+0x0/0x23c
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ksoftirqd/0   S ffffffff80142f55     0     3      1             4     2 (L-TLB)
> ffff8100026c5ed0 0000000000000046 ffff8100026c5ee0 0000000000000046
> ffff81007ffb27e0 000000000000000a ffff81007ffb27e0 ffffffff802e3ae0
> 0000001bb42e0d31 0000000000011ac6 ffff81007ffb29c8 000000008008a335
>Call Trace:
> [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
> [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>watchdog/0    S ffffffff80142f55     0     4      1             5     3 (L-TLB)
> ffff8100026c7ec0 0000000000000046 0000000000000000 ffff8100026ba4d0
> ffff810002376478 0000000000000001 ffff81007ffb2080 ffffffff802e3ae0
> 00000085b7a2f0b0 00000000000002e6 ffff81007ffb2268 00000000800a1eb9
>Call Trace:
> [<ffffffff800b6eb1>] watchdog+0x0/0x5f
> [<ffffffff800b6f00>] watchdog+0x4f/0x5f
> [<ffffffff800b6eb1>] watchdog+0x0/0x5f
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>migration/1   S ffff81007ffb3820     0     5      1             6     4 (L-TLB)
> ffff8100026c9ea0 0000000000000046 0000000000000000 0000000000000000
> ffffffff803a6080 0000000000000001 ffff81007ffb3820 ffff81007d6a5820
> 0000001ba7b0b850 0000000000000c4d ffff81007ffb3a08 0000000100000000
>Call Trace:
> [<ffffffff80089241>] __wake_up_common+0x3e/0x68
> [<ffffffff80044784>] migration_thread+0x1a4/0x23c
> [<ffffffff800445e0>] migration_thread+0x0/0x23c
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ksoftirqd/1   S ffffffff80142f55     0     6      1             7     5 (L-TLB)
> ffff8100026efed0 0000000000000046 ffff8100026efee0 0000000000000046
> ffff81007ffb30c0 000000000000000a ffff81007ffb30c0 ffff8100026d4100
> 0000001bb41053d7 00000000000005c1 ffff81007ffb32a8 000000018008a335
>Call Trace:
> [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
> [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>watchdog/1    S ffffffff80142f55     0     7      1             8     6 (L-TLB)
> ffff8100026f1ec0 0000000000000046 0000000000000000 ffff8100026ba4d0
> ffff81000237e9f8 0000000000000009 ffff8100026d4860 ffff8100026d4100
> 00000085be00a89a 00000000000002be ffff8100026d4a48 00000001800a1eb9
>Call Trace:
> [<ffffffff800b6eb1>] watchdog+0x0/0x5f
> [<ffffffff800b6f00>] watchdog+0x4f/0x5f
> [<ffffffff800b6eb1>] watchdog+0x0/0x5f
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>events/0      R  running task       0     8      1             9     7 (L-TLB)
>events/1      S ffffffff80142f55     0     9      1            10     8 (L-TLB)
> ffff810037f49e70 0000000000000046 0000000000000000 ffff810037a1fd40
> 0000000300000000 000000000000000a ffff8100026db7e0 ffff8100026d4100
> 00000085a386a7df 00000000000038c4 ffff8100026db9c8 000000018002e254
>Call Trace:
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>khelper       S ffff810037fef040     0    10      1            27     9 (L-TLB)
> ffff810037a35e70 0000000000000046 000000000007e1cb ffff810037a34000
> 0000000300000000 000000000000000a ffff810037fef040 ffff810037fa0080
> 0000001b03e5ae37 0000000000002bae ffff810037fef228 000000018002e254
>Call Trace:
> [<ffffffff8009a827>] __call_usermodehelper+0x0/0x4f
> [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kthread       S ffffffff80142f55     0    27      1    32     499    10 (L-TLB)
> ffff810037f11e70 0000000000000046 00000000000010c5 ffff81007d417d68
> 0000000300000000 0000000000000001 ffff8100026db080 ffff81007d6a50c0
> 0000001bc400d9e2 00000000000018a2 ffff8100026db268 000000008002e254
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kblockd/0     S ffff810037f8d7a0     0    32     27            33       (L-TLB)
> ffff810037f1be70 0000000000000046 0000000000000287 ffffffff88075c83
> 0000000300000000 000000000000000a ffff81007fb6f7a0 ffff810037f8d7a0
> 0000001bc4a16c5e 00000000000026d9 ffff81007fb6f988 000000008002e254
>Call Trace:
> [<ffffffff88075c83>] :scsi_mod:scsi_dispatch_cmd+0x27d/0x2ff
> [<ffffffff80141701>] cfq_kick_queue+0x0/0x89
> [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kblockd/1     S ffffffff80142f55     0    33     27            34    32 (L-TLB)
> ffff810037f1de70 0000000000000046 ffffffff80141701 ffffffff801377a1
> 0000000300000000 000000000000000a ffff810037fa07e0 ffff8100026d4100
> 0000001bae1605d6 00000000000046d7 ffff810037fa09c8 000000018002e254
>Call Trace:
> [<ffffffff80141701>] cfq_kick_queue+0x0/0x89
> [<ffffffff801377a1>] elv_next_request+0x196/0x1a6
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kacpid        S ffffffff80142f55     0    34     27           119    33 (L-TLB)
> ffff810037f1fe70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000005 ffff81007fb6f040 ffffffff802e3ae0
> 00000014dd1c14f6 000000000000062a ffff81007fb6f228 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>cqueue/0      S ffffffff80142f55     0   119     27           120    34 (L-TLB)
> ffff810037a3be70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000006 ffff810037fe4860 ffffffff802e3ae0
> 00000014e814e921 00000000000007e8 ffff810037fe4a48 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>cqueue/1      S ffffffff80142f55     0   120     27           123   119 (L-TLB)
> ffff810037a3de70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000005 ffff81007fb70100 ffff8100026d4100
> 00000014e815a3f2 000000000000078b ffff81007fb702e8 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>khubd         S ffffffff80142f55     0   123     27           125   120 (L-TLB)
> ffff810037f2be10 0000000000000046 ffffffff8008ac03 8000018000000000
> ffff810037ca1000 000000000000000a ffff810037fe7080 ffff810037f83820
> 0000001565ca64c4 0000000000003a2b ffff810037fe7268 0000000037c97fa0
>Call Trace:
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff801da9a9>] hub_port_status+0x59/0xcf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff801dd69f>] hub_thread+0xa92/0xb10
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff801dcc0d>] hub_thread+0x0/0xb10
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kseriod       S ffffffff80142f55     0   125     27           198   123 (L-TLB)
> ffff810037f2fe90 0000000000000046 ffffffff80314740 0000000000008080
> ffffffff80314740 000000000000000a ffff81007fb750c0 ffff81007f1080c0
> 000000199e5ee6ee 0000000000020f9e ffff81007fb752a8 00000000ffffffea
>Call Trace:
> [<ffffffff801af6b4>] driver_create_file+0x31/0x39
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff801f0fca>] serio_thread+0x29c/0x2e7
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff801f0d2e>] serio_thread+0x0/0x2e7
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>pdflush       S ffffffff80142f55     0   198     27           199   125 (L-TLB)
> ffff81007f0e3e70 0000000000000046 ffff810037f6b820 ffff81007ffbfd60
> 0000000000000282 0000000000000005 ffff810037f6b820 ffffffff802e3ae0
> 00000014ed34e564 00000000000009b3 ffff810037f6ba08 000000008008a335
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff80056236>] pdflush+0x0/0x1fb
> [<ffffffff80056323>] pdflush+0xed/0x1fb
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>pdflush       S ffffffff80142f55     0   199     27           200   198 (L-TLB)
> ffff81007f0e5e70 0000000000000046 ffffffff802f2020 ffff8100026cc000
> 0000000000000286 000000000000000a ffff810037f867a0 ffff8100026d4100
> 0000008567d9115f 0000000000004be9 ffff810037f86988 0000000100000282
>Call Trace:
> [<ffffffff800c30ca>] wb_kupdate+0x106/0x10d
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff80056236>] pdflush+0x0/0x1fb
> [<ffffffff80056323>] pdflush+0xed/0x1fb
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kswapd0       S ffffffff80142f55     0   200     27           201   199 (L-TLB)
> ffff81007f0e7dd0 0000000000000046 ffff810037f6b0c0 ffff81007ffbfd50
> ffff81000000c000 0000000000000004 ffff810037f6b0c0 ffffffff802e3ae0
> 00000014ed364300 0000000000000860 ffff810037f6b2a8 0000000000000000
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800575fb>] kswapd+0x127/0x459
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff800574d4>] kswapd+0x0/0x459
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>aio/0         S ffff8100026db080     0   201     27           202   200 (L-TLB)
> ffff81007f0e9e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000004 ffff810037f87860 ffff8100026db080
> 00000014ed3687a9 000000000000077d ffff810037f87a48 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>aio/1         S ffffffff80142f55     0   202     27           345   201 (L-TLB)
> ffff81007f0ebe70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000003 ffff810037f61860 ffff8100026d4100
> 00000014ed36d8e0 000000000000052b ffff810037f61a48 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kpsmoused     S ffff81007fb75820     0   345     27           385   202 (L-TLB)
> ffff810037a51e70 0000000000000046 ffff810037a51dd0 ffffffff8008a60e
> 00000015438e3fc2 0000000000000009 ffff81007fb75820 ffff81007fb750c0
> 0000001543901d1a 000000000000090e ffff81007fb75a08 000000010237e980
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_eh_0     S ffffffff80142f55     0   385     27           386   345 (L-TLB)
> ffff81007e883e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000009 ffff810037feb100 ffffffff802e3ae0
> 000000165b2c20f8 00000000000005ff ffff810037feb2e8 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f72>] :scsi_mod:scsi_error_handler+0x6a/0x4ac
> [<ffffffff88078f08>] :scsi_mod:scsi_error_handler+0x0/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_wq_0     S ffffffff80142f55     0   386     27           402   385 (L-TLB)
> ffff81007e885e70 0000000000000046 ffff81007f393d80 ffff81007f217680
> 0000000300000000 000000000000000a ffff810037f8d7a0 ffffffff802e3ae0
> 000000857872bebf 0000000000002235 ffff810037f8d988 000000008002e254
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8004fd6d>] datagram_poll+0x0/0xc8
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_eh_1     S ffffffff80142f55     0   402     27           406   386 (L-TLB)
> ffff81007f309e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000009 ffff810037fe6820 ffffffff802e3ae0
> 0000001730ba52e7 000000000000069a ffff810037fe6a08 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f72>] :scsi_mod:scsi_error_handler+0x6a/0x4ac
> [<ffffffff88078f08>] :scsi_mod:scsi_error_handler+0x0/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ata/0         S ffffffff80142f55     0   406     27           407   402 (L-TLB)
> ffff81007e845e70 0000000000000046 ffff81007e845dd0 ffffffff8008a60e
> 000000184d50001b 0000000000000009 ffff81007f161040 ffff810037f61100
> 000000184d504e7e 0000000000000955 ffff81007f161228 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ata/1         S ffffffff80142f55     0   407     27           408   406 (L-TLB)
> ffff81007e855e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000008 ffff810037fee0c0 ffff810037f61100
> 000000184d509963 0000000000000514 ffff810037fee2a8 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ata_aux       S ffffffff80142f55     0   408     27           412   407 (L-TLB)
> ffff81007eab3e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000008 ffff810037f710c0 ffff8100026d4100
> 000000184d50f448 0000000000000552 ffff810037f712a8 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_eh_2     S ffff810037f8f860     0   412     27           413   408 (L-TLB)
> ffff81007f3c1e70 0000000000000046 ffff81007e8ffaa8 ffffffff8009aec1
> 0000000300000000 0000000000000009 ffff810037f84080 ffff810037f8f860
> 0000001857130e4b 0000000000000d49 ffff810037f84268 000000018002e254
>Call Trace:
> [<ffffffff8009aec1>] flush_cpu_workqueue+0x9f/0xad
> [<ffffffff88075260>] :scsi_mod:__scsi_iterate_devices+0x56/0x6f
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f72>] :scsi_mod:scsi_error_handler+0x6a/0x4ac
> [<ffffffff88078f08>] :scsi_mod:scsi_error_handler+0x0/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_eh_3     S ffffffff80142f55     0   413     27           426   412 (L-TLB)
> ffff81007f2ade70 0000000000000046 0000000000000000 0000000000000000
> 0000000300000000 0000000000000009 ffff810037f8f860 ffff8100026d4100
> 0000001857132b3f 0000000000001cf4 ffff810037f8fa48 000000018002e254
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f72>] :scsi_mod:scsi_error_handler+0x6a/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f08>] :scsi_mod:scsi_error_handler+0x0/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ksnapd        S ffffffff80142f55     0   426     27           430   413 (L-TLB)
> ffff81007ea21e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000005 ffff810037f90820 ffffffff802e3ae0
> 0000001857af9b6d 0000000000000850 ffff810037f90a08 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kmpathd/0     S ffffffff80142f55     0   430     27           431   426 (L-TLB)
> ffff81007ea13e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000004 ffff810037f70100 ffff810037f970c0
> 0000001857d228d6 000000000000079d ffff810037f702e8 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kmpathd/1     S ffff81007f15c080     0   431     27           442   430 (L-TLB)
> ffff81007ea17e70 0000000000000046 ffff81007ea17df0 ffffffff8002e254
> 0000000300000000 000000000000000a ffff81007f15c080 ffff810037f867a0
> 00000023ccd967b8 00000000000005e1 ffff81007f15c268 000000018002e254
>Call Trace:
> [<ffffffff8002e254>] __wake_up+0x38/0x4f
> [<ffffffff881dc2c7>] :dm_multipath:process_queued_ios+0x0/0x159
> [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kjournald     D ffff81007f15c080     0   442     27           470   431 (L-TLB)
> ffff81007ebe7ca0 0000000000000046 ffff81007eb009f0 0000000000000400
> 0000000000f9d905 000000000000000a ffff81007f1617a0 ffff81007f15c080
> 0000001c6e322fda 00000000000061c9 ffff81007f161988 0000000100f08002
>Call Trace:
> [<ffffffff8006d7bf>] do_gettimeofday+0x50/0x92
> [<ffffffff8005a511>] getnstimeofday+0x10/0x28
> [<ffffffff80014eec>] sync_buffer+0x0/0x3f
> [<ffffffff80063742>] io_schedule+0x3f/0x67
> [<ffffffff80014f27>] sync_buffer+0x3b/0x3f
> [<ffffffff8006396e>] __wait_on_bit+0x40/0x6e
> [<ffffffff80014eec>] sync_buffer+0x0/0x3f
> [<ffffffff80063a08>] out_of_line_wait_on_bit+0x6c/0x78
> [<ffffffff8009de10>] wake_bit_function+0x0/0x23
> [<ffffffff8003a59c>] sync_dirty_buffer+0x96/0xca
> [<ffffffff8803898a>] :jbd:journal_update_superblock+0x77/0xb5
> [<ffffffff88035381>] :jbd:journal_commit_transaction+0x2b/0x10ca
> [<ffffffff8003d671>] lock_timer_base+0x1b/0x3c
> [<ffffffff8004a946>] try_to_del_timer_sync+0x51/0x5a
> [<ffffffff88039419>] :jbd:kjournald+0xc1/0x213
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff88039358>] :jbd:kjournald+0x0/0x213
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff880f10b7>] :tg3:tg3_start_xmit_dma_bug+0x0/0x78b
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kauditd       S ffffffff80142f55     0   470     27           876   442 (L-TLB)
> ffff81007dcf3e90 0000000000000046 ffff810037f97820 ffff810037f83820
> ffff810037f97820 0000000000000009 ffff810037f97820 ffff810037f83820
> 000000194dd073d4 00000000000007e3 ffff810037f97a08 0000000000000046
>Call Trace:
> [<ffffffff8002e254>] __wake_up+0x38/0x4f
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800afe99>] kauditd_thread+0x144/0x17b
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff800afd55>] kauditd_thread+0x0/0x17b
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>udevd         S ffffffff80142f55     0   499      1          4142    27 (NOTLB)
> ffff81007e0cda18 0000000000000082 00002b953d810380 ffff81007f213440
> 0000000000000080 0000000000000007 ffff810037f83820 ffff8100026d4100
> 0000001bd05d9021 0000000000018461 ffff810037f83a08 0000000100100000
>Call Trace:
> [<ffffffff80063797>] schedule_timeout+0x1e/0xad
> [<ffffffff80063a5d>] mutex_lock+0xd/0x1d
> [<ffffffff800eda2c>] inotify_poll+0x49/0x50
> [<ffffffff8001155f>] do_select+0x3fe/0x462
> [<ffffffff8001e476>] __pollwait+0x0/0xe2
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff800093b2>] __handle_mm_fault+0xd62/0xe23
> [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff8011f7e2>] inode_has_perm+0x56/0x63
> [<ffffffff800df607>] core_sys_select+0x1bc/0x265
> [<ffffffff8011f707>] may_link+0xc7/0xda
> [<ffffffff8004cd1f>] shrink_dcache_parent+0x2e/0xe1
> [<ffffffff80016270>] sys_select+0xc1/0x17c
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff80011715>] sys_read+0x45/0x6e
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>kedac         S ffffffff80142f55     0   876     27          4089   470 (L-TLB)
> ffff81007d301e70 0000000000000046 ffff81007d301dd0 ffffffff8008a60e
> 00000019991ea385 000000000000000a ffff81007f441100 ffff8100026d4100
> 00000085a96a6af4 00000000000005f8 ffff81007f4412e8 0000000102376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88248a0f>] :edac_mc:edac_kernel_thread+0x0/0xeb
> [<ffffffff80063803>] schedule_timeout+0x8a/0xad
> [<ffffffff8009543e>] process_timeout+0x0/0x5
> [<ffffffff88248ad2>] :edac_mc:edac_kernel_thread+0xc3/0xeb
> [<ffffffff88248a0f>] :edac_mc:edac_kernel_thread+0x0/0xeb
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kjournald     S ffffffff80142f55     0  4089     27          4245   876 (L-TLB)
> ffff81007e1d7e70 0000000000000046 0000000000000000 0000000000000005
> 0000000000000000 0000000000000008 ffff810037fe60c0 ffffffff802e3ae0
> 0000001b4dd37d1d 0000000000002079 ffff810037fe62a8 0000000080089241
>Call Trace:
> [<ffffffff880394ea>] :jbd:kjournald+0x192/0x213
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff88039358>] :jbd:kjournald+0x0/0x213
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff880f10b7>] :tg3:tg3_start_xmit_dma_bug+0x0/0x78b
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>rc            S ffffffff80142f55     0  4142      1  4320    4204   499 (NOTLB)
> ffff81007eb6bee8 0000000000000082 0000003a0000003a ffff81007e3667a0
> ffff81007eb6beb8 0000000000000003 ffff81007e3667a0 ffff8100026d4100
> 0000001bc7915ff8 000000000001414b ffff81007e366988 0000000100000004
>Call Trace:
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff80028046>] do_wait+0x936/0xa0a
> [<ffffffff8002ff32>] vfs_ioctl+0x248/0x261
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff80030193>] sys_rt_sigprocmask+0xc0/0xd9
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>readahead     D ffffffff80142f55     0  4204      1          4300  4142 (NOTLB)
> ffff81007da8b8f8 0000000000000082 ffff81007f3cb1d8 ffff81007e85d380
> 0000000000000000 0000000000000003 ffff81007e010080 ffff8100026d4100
> 0000001bc6219e32 000000000000ffbd ffff81007e010268 00000001023679b8
>Call Trace:
> [<ffffffff8006d7bf>] do_gettimeofday+0x50/0x92
> [<ffffffff80014eec>] sync_buffer+0x0/0x3f
> [<ffffffff80063742>] io_schedule+0x3f/0x67
> [<ffffffff80014f27>] sync_buffer+0x3b/0x3f
> [<ffffffff8006396e>] __wait_on_bit+0x40/0x6e
> [<ffffffff80014eec>] sync_buffer+0x0/0x3f
> [<ffffffff80063a08>] out_of_line_wait_on_bit+0x6c/0x78
> [<ffffffff8009de10>] wake_bit_function+0x0/0x23
> [<ffffffff800254d7>] __bread+0x6c/0x81
> [<ffffffff8804eec3>] :ext3:ext3_get_branch+0x67/0xd2
> [<ffffffff8804f0f3>] :ext3:ext3_get_blocks_handle+0xc6/0x9f1
> [<ffffffff8819a940>] :dm_mod:dm_request+0x109/0x110
> [<ffffffff8001bbc8>] generic_make_request+0x1e8/0x1ff
> [<ffffffff88199465>] :dm_mod:__map_bio+0xbb/0x119
> [<ffffffff8819a15a>] :dm_mod:__split_bio+0x3a6/0x3be
> [<ffffffff8804fd3e>] :ext3:ext3_get_block+0xbe/0xe3
> [<ffffffff80028287>] do_mpage_readpage+0x16d/0x4a9
> [<ffffffff8804fc80>] :ext3:ext3_get_block+0x0/0xe3
> [<ffffffff8804fc80>] :ext3:ext3_get_block+0x0/0xe3
> [<ffffffff80038b75>] mpage_readpages+0xb2/0x132
> [<ffffffff8804fc80>] :ext3:ext3_get_block+0x0/0xe3
> [<ffffffff8804fc80>] :ext3:ext3_get_block+0x0/0xe3
> [<ffffffff80038ad6>] mpage_readpages+0x13/0x132
> [<ffffffff800129b2>] __do_page_cache_readahead+0x101/0x1d9
> [<ffffffff8807b08f>] :scsi_mod:scsi_request_fn+0x2b4/0x390
> [<ffffffff800c32e5>] force_page_cache_readahead+0x5f/0x81
> [<ffffffff800543f2>] sys_readahead+0x77/0x94
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>kondemand/0   S ffffffff80142f55     0  4245     27          4246  4089 (L-TLB)
> ffff81007d2fbe70 0000000000000046 ffff810002379568 ffffffff80095b71
> 0000000300000000 000000000000000a ffff81007df62860 ffffffff802e3ae0
> 00000085dd4cd6a9 0000000000000936 ffff81007df62a48 000000008002e254
>Call Trace:
> [<ffffffff80095b71>] add_timer_on+0x53/0x62
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kondemand/1   S ffffffff80142f55     0  4246     27          4266  4245 (L-TLB)
> ffff81007dbafe70 0000000000000046 ffff810002381ae8 ffffffff80095b71
> 0000000300000000 000000000000000a ffff81007d0af7a0 ffff8100026d4100
> 00000085dd4cb63d 000000000000090c ffff81007d0af988 000000018002e254
>Call Trace:
> [<ffffffff80095b71>] add_timer_on+0x53/0x62
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_addr       S ffffffff80142f55     0  4266     27          4277  4246 (L-TLB)
> ffff81007d3d5e70 0000000000000046 ffff81007d3d5dd0 ffffffff8008a60e
> 0000000300000000 000000000000000a ffff81007d770820 ffffffff802e3ae0
> 0000003d62ae889c 00000000000005fe ffff81007d770a08 000000008002e254
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_mcast      S ffffffff80142f55     0  4277     27          4278  4266 (L-TLB)
> ffff81007c4d5e70 0000000000000046 ffff81007c4d5dd0 ffffffff8008a60e
> 0000001bc24bb72c 0000000000000004 ffff81007f15c7e0 ffff81007d6a50c0
> 0000001bc24be936 0000000000000922 ffff81007f15c9c8 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_inform     S ffffffff80142f55     0  4278     27          4279  4277 (L-TLB)
> ffff81007c4d7e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000004 ffff81007f109100 ffffffff802e3ae0
> 0000001bc24c7e2b 00000000000007d9 ffff81007f1092e8 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>local_sa      S ffffffff80142f55     0  4279     27          4283  4278 (L-TLB)
> ffff81007c4d9e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000004 ffff810037f6e040 ffff8100026d4100
> 0000001bc24d242d 00000000000007f5 ffff810037f6e228 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>iw_cm_wq      S ffffffff80142f55     0  4283     27          4286  4279 (L-TLB)
> ffff81007cb25e70 0000000000000046 ffff81007cb25dd0 ffffffff8008a60e
> 0000001bc2a58cf3 0000000000000003 ffff81007d6a5820 ffff81007d6a50c0
> 0000001bc2a5be4e 0000000000000952 ffff81007d6a5a08 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_cm/0       S ffff81007cc977e0     0  4286     27          4287  4283 (L-TLB)
> ffff81007c4f3e70 0000000000000046 ffff81007c4f3dd0 ffffffff8008a60e
> 0000001bc3082969 0000000000000002 ffff81007cc977e0 ffff81007ff117e0
> 0000001bc308a1ab 0000000000000b22 ffff81007cc979c8 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_cm/1       S ffffffff80142f55     0  4287     27          4291  4286 (L-TLB)
> ffff81007c4f5e70 0000000000000046 00000000000000e0 000000000003b2fc
> 00002b81a1a10300 0000000000000002 ffff81007ff117e0 ffff8100026d4100
> 0000001bc31ed578 0000000000001847 ffff81007ff119c8 0000000180066e26
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>rdma_cm       S ffffffff80142f55     0  4291     27                4287 (L-TLB)
> ffff81007c525e70 0000000000000046 ffff81007c525dd0 ffffffff8008a60e
> 0000001bc380c2b1 0000000000000001 ffff81007f1080c0 ffff81007d6a50c0
> 0000001bc380f690 0000000000000920 ffff81007f1082a8 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>iscsid        S ffffffff80142f55     0  4300      1          4301  4204 (NOTLB)
> ffff81007c5cfeb8 0000000000000082 ffff8100023784e0 000000003b9aca00
> 0000000000000000 0000000000000007 ffff81007d6a50c0 ffffffff802e3ae0
> 00000085dcf177a3 000000000000157f ffff81007d6a52a8 00000000a267cedf
>Call Trace:
> [<ffffffff8009fbe6>] enqueue_hrtimer+0x55/0x70
> [<ffffffff80063c55>] do_nanosleep+0x3f/0x70
> [<ffffffff8005a10a>] hrtimer_nanosleep+0x58/0x118
> [<ffffffff8000d052>] dput+0x2c/0x114
> [<ffffffff8009fd51>] hrtimer_wakeup+0x0/0x22
> [<ffffffff8001d6df>] sigprocmask+0xb7/0xdb
> [<ffffffff8005445b>] sys_nanosleep+0x4c/0x62
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>iscsid        S ffffffff80142f55     0  4301      1                4300 (NOTLB)
> ffff81007c561b38 0000000000000082 ffffffff00100053 ffffffff00000000
> 0000000000000001 000000000000000a ffff810037f6d080 ffffffff802e3ae0
> 00000085d6383c87 0000000000001370 ffff810037f6d268 000000007c561e3c
>Call Trace:
> [<ffffffff80063803>] schedule_timeout+0x8a/0xad
> [<ffffffff8009543e>] process_timeout+0x0/0x5
> [<ffffffff8002f61c>] do_sys_poll+0x277/0x35e
> [<ffffffff8001e476>] __pollwait+0x0/0xe2
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8011f36d>] ipc_has_perm+0x59/0x67
> [<ffffffff8001a090>] vsnprintf+0x559/0x59e
> [<ffffffff801458b9>] snprintf+0x44/0x4c
> [<ffffffff8000a82b>] get_page_from_freelist+0x377/0x3fa
> [<ffffffff80017bb3>] do_sync_write+0xc7/0x104
> [<ffffffff8003abf0>] d_lookup+0x1e/0x42
> [<ffffffff800fc996>] proc_flush_task+0x4e/0x1f6
> [<ffffffff80017ac7>] release_task+0x342/0x367
> [<ffffffff8003b87c>] remove_wait_queue+0x1c/0x2c
> [<ffffffff8002807e>] do_wait+0x96e/0xa0a
> [<ffffffff8004bbc9>] sys_poll+0x2d/0x34
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>S10network    S ffffffff80142f55     0  4320   4142  4326               (NOTLB)
> ffff81007bd35df8 0000000000000086 000000000000003a 000000000000003a
> 0000000000000000 0000000000000001 ffff81007f10a040 ffff810037f7a820
> 0000001bc8ab2408 000000000000955b ffff81007f10a228 0000000100000000
>Call Trace:
> [<ffffffff800477cf>] pipe_wait+0x69/0x93
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff80063a5d>] mutex_lock+0xd/0x1d
> [<ffffffff8002ec10>] pipe_readv+0x31d/0x3a2
> [<ffffffff800de208>] pipe_read+0x1a/0x1f
> [<ffffffff8000b337>] vfs_read+0xcb/0x171
> [<ffffffff80011715>] sys_read+0x45/0x6e
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>S10network    S ffffffff80142f55     0  4326   4320  4329               (NOTLB)
> ffff81007bdbdee8 0000000000000082 0000003a0000003a ffff810037f7a820
> 0000000000000000 0000000000000001 ffff810037f7a820 ffffffff802e3ae0
> 0000001bc8eaa60b 0000000000010d8b ffff810037f7aa08 0000000000000004
>Call Trace:
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff80028046>] do_wait+0x936/0xa0a
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>S10network    D ffffffff80142f55     0  4329   4326          4330       (NOTLB)
> ffff81007bd73b48 0000000000000086 ffff81007d7ff518 0000000000000004
> 000000000000000e 0000000000000001 ffff810037f82860 ffff8100026d4100
> 0000001bc8da4ef1 0000000000001d06 ffff810037f82a48 0000000100000001
>Call Trace:
> [<ffffffff8006d7bf>] do_gettimeofday+0x50/0x92
> [<ffffffff8002881b>] sync_page+0x0/0x42
> [<ffffffff80063742>] io_schedule+0x3f/0x67
> [<ffffffff80028859>] sync_page+0x3e/0x42
> [<ffffffff80063886>] __wait_on_bit_lock+0x36/0x66
> [<ffffffff8003f750>] __lock_page+0x5e/0x64
> [<ffffffff8009de10>] wake_bit_function+0x0/0x23
> [<ffffffff80063015>] cond_resched+0x3b/0x42
> [<ffffffff8000bf44>] do_generic_mapping_read+0x1eb/0x3f8
> [<ffffffff8000cd69>] file_read_actor+0x0/0x154
> [<ffffffff8000c29d>] __generic_file_aio_read+0x14c/0x190
> [<ffffffff800167be>] generic_file_aio_read+0x34/0x39
> [<ffffffff8000caa4>] do_sync_read+0xc7/0x104
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff8000b337>] vfs_read+0xcb/0x171
> [<ffffffff80044bf8>] kernel_read+0x41/0x55
> [<ffffffff8003e8e0>] do_execve+0x11c/0x243
> [<ffffffff80054760>] sys_execve+0x36/0x4c
> [<ffffffff8005d4d3>] stub_execve+0x67/0xb0
>
>sed           S ffffffff80142f55     0  4330   4326                4329 (NOTLB)
> ffff81007bde3df8 0000000000000082 000000000000003a 000000000000003a
> 0000000000000000 0000000000000001 ffff81007df62100 ffff810037f7a820
> 0000001bc8e99880 00000000000e8918 ffff81007df622e8 0000000000000000
>Call Trace:
> [<ffffffff800477cf>] pipe_wait+0x69/0x93
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff80063a5d>] mutex_lock+0xd/0x1d
> [<ffffffff8002ec10>] pipe_readv+0x31d/0x3a2
> [<ffffffff8000dde2>] do_mmap_pgoff+0x66c/0x7d7
> [<ffffffff800de208>] pipe_read+0x1a/0x1f
> [<ffffffff8000b337>] vfs_read+0xcb/0x171
> [<ffffffff80011715>] sys_read+0x45/0x6e
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>BUG: soft lockup - CPU#0 stuck for 51s! [swapper:0]
>CPU 0:
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr cpufreq_ondemand acpi_cpufreq video sbs backlight i2c_ec button battery asus_acpi acpi_memhotplug ac parport_pc lp parport serio_raw i2c_i801 i2c_core e752x_edac edac_mc sg pcspkr ide_cd shpchp cdrom dm_round_robin dm_multipath dm_snapshot dm_zero dm_mirror dm_mod ata_piix libata mptspi mptscsih scsi_transport_spi mptbase tg3 iscsi_tcp libiscsi scsi_transport_iscsi sd_mod scsi_mod ext3 jbd uhci_hcd ohci_hcd ehci_hcd
>Pid: 0, comm: swapper Not tainted 2.6.18-92.el5 #1
>RIP: 0010:[<ffffffff80064aa8>]  [<ffffffff80064aa8>] _spin_unlock_irqrestore+0x8/0x9
>RSP: 0018:ffffffff80416ea0  EFLAGS: 00000292
>RAX: 0000000000000001 RBX: 0000000000000014 RCX: 0000000000000000
>RDX: ffff81007f0befd8 RSI: 0000000000000292 RDI: ffff81007f162c50
>RBP: ffffffff80416e20 R08: 0000000000000002 R09: 000000000000003e
>R10: ffffffff803c6260 R11: ffffffff80416d98 R12: ffffffff8005dc8e
>R13: 0000000000000001 R14: ffffffff80076f1d R15: ffffffff80416e20
>FS:  0000000000000000(0000) GS:ffffffff8039e000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
>CR2: 000000383b2cdcf0 CR3: 000000007e053000 CR4: 00000000000006e0
>
>Call Trace:
> <IRQ>  [<ffffffff801f0c29>] serio_interrupt+0x73/0x81
> [<ffffffff801f1765>] i8042_interrupt+0x1d7/0x1ec
> [<ffffffff8001097e>] handle_IRQ_event+0x29/0x58
> [<ffffffff800b71de>] __do_IRQ+0xa4/0x103
> [<ffffffff80011ed2>] __do_softirq+0x5e/0xd6
> [<ffffffff8006c3f4>] do_IRQ+0xe7/0xf5
> [<ffffffff80056c64>] mwait_idle+0x0/0x4a
> [<ffffffff8005d615>] ret_from_intr+0x0/0xa
> <EOI>  [<ffffffff80056c9a>] mwait_idle+0x36/0x4a
> [<ffffffff80048b1d>] cpu_idle+0x95/0xb8
> [<ffffffff803d9801>] start_kernel+0x220/0x225
> [<ffffffff803d922f>] _sinittext+0x22f/0x236
>
>ping timeout of 5 secs expired, last rx 4295152736, last ping 4295152736, now 4295208168
>SysRq : HELP : loglevel0-8 reBoot Crashdump tErm Full kIll saK showMem Nice powerOff showPc unRaw Sync showTasks Unmount shoWcpus 
>SysRq : HELP : loglevel0-8 reBoot Crashdump tErm Full kIll saK showMem Nice powerOff showPc unRaw Sync showTasks Unmount shoWcpus 
>SysRq : Keyboard mode set to XLATE
>SysRq : Changing Loglevel
>Loglevel set to 7
>SysRq : Show State
>
>                                                       sibling
>  task                 PC          pid father child younger older
>init          S ffffffff80142f55     0     1      0     2               (NOTLB)
> ffff81007ffbfa18 0000000000000086 ffff81007ea0b63c 0000000000000000
> 0000000000000000 000000000000000a ffff81007ffaf7a0 ffffffff802e3ae0
> 000000b83febdd22 0000000000005739 ffff81007ffaf988 000000008000b083
>Call Trace:
> [<ffffffff80063803>] schedule_timeout+0x8a/0xad
> [<ffffffff8009543e>] process_timeout+0x0/0x5
> [<ffffffff8001155f>] do_select+0x3fe/0x462
> [<ffffffff8001e476>] __pollwait+0x0/0xe2
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff80009523>] __d_lookup+0xb0/0xff
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff8011f7e2>] inode_has_perm+0x56/0x63
> [<ffffffff800df607>] core_sys_select+0x1bc/0x265
> [<ffffffff8002cb15>] mntput_no_expire+0x19/0x89
> [<ffffffff8001a7b3>] cp_new_stat+0xe5/0xfd
> [<ffffffff80016302>] sys_select+0x153/0x17c
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>migration/0   S ffff81007ffaf040     0     2      1             3       (L-TLB)
> ffff8100026c1ea0 0000000000000046 0000000000000000 0000000000000000
> ffff810037f82860 0000000000000001 ffff81007ffaf040 ffff810037f6d080
> 0000001bc4014ad5 0000000000001188 ffff81007ffaf228 0000000000000000
>Call Trace:
> [<ffffffff80089241>] __wake_up_common+0x3e/0x68
> [<ffffffff80044784>] migration_thread+0x1a4/0x23c
> [<ffffffff800445e0>] migration_thread+0x0/0x23c
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ksoftirqd/0   S ffffffff80142f55     0     3      1             4     2 (L-TLB)
> ffff8100026c5ed0 0000000000000046 ffff8100026c5ee0 0000000000000046
> ffff81007ffb27e0 000000000000000a ffff81007ffb27e0 ffffffff802e3ae0
> 0000001bb42e0d31 0000000000011ac6 ffff81007ffb29c8 000000008008a335
>Call Trace:
> [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
> [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>watchdog/0    S ffffffff80142f55     0     4      1             5     3 (L-TLB)
> ffff8100026c7ec0 0000000000000046 0000000000000000 ffff8100026ba4d0
> ffff810002376478 0000000000000001 ffff81007ffb2080 ffffffff802e3ae0
> 000000b87b7ab3bb 000000000000027e ffff81007ffb2268 00000000800a1eb9
>Call Trace:
> [<ffffffff800b6eb1>] watchdog+0x0/0x5f
> [<ffffffff800b6f00>] watchdog+0x4f/0x5f
> [<ffffffff800b6eb1>] watchdog+0x0/0x5f
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>migration/1   S ffff81007ffb3820     0     5      1             6     4 (L-TLB)
> ffff8100026c9ea0 0000000000000046 0000000000000000 0000000000000000
> ffffffff803a6080 0000000000000001 ffff81007ffb3820 ffff81007d6a5820
> 0000001ba7b0b850 0000000000000c4d ffff81007ffb3a08 0000000100000000
>Call Trace:
> [<ffffffff80089241>] __wake_up_common+0x3e/0x68
> [<ffffffff80044784>] migration_thread+0x1a4/0x23c
> [<ffffffff800445e0>] migration_thread+0x0/0x23c
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ksoftirqd/1   S ffffffff80142f55     0     6      1             7     5 (L-TLB)
> ffff8100026efed0 0000000000000046 ffff8100026efee0 0000000000000046
> ffff81007ffb30c0 000000000000000a ffff81007ffb30c0 ffff8100026d4100
> 0000001bb41053d7 00000000000005c1 ffff81007ffb32a8 000000018008a335
>Call Trace:
> [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
> [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>watchdog/1    S ffffffff80142f55     0     7      1             8     6 (L-TLB)
> ffff8100026f1ec0 0000000000000046 0000000000000000 ffff8100026ba4d0
> ffff81000237e9f8 0000000000000009 ffff8100026d4860 ffff8100026d4100
> 000000b877e8ad8a 000000000000027e ffff8100026d4a48 00000001800a1eb9
>Call Trace:
> [<ffffffff800b6eb1>] watchdog+0x0/0x5f
> [<ffffffff800b6f00>] watchdog+0x4f/0x5f
> [<ffffffff800b6eb1>] watchdog+0x0/0x5f
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>events/0      R  running task       0     8      1             9     7 (L-TLB)
>events/1      S ffffffff80142f55     0     9      1            10     8 (L-TLB)
> ffff810037f49e70 0000000000000046 0000000000000000 ffff81007ffc8140
> 0000000300000000 000000000000000a ffff8100026db7e0 ffff8100026d4100
> 000000b87eee291e 0000000000001d02 ffff8100026db9c8 000000018002e254
>Call Trace:
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>khelper       S ffff810037fef040     0    10      1            27     9 (L-TLB)
> ffff810037a35e70 0000000000000046 000000000007e1cb ffff810037a34000
> 0000000300000000 000000000000000a ffff810037fef040 ffff810037fa0080
> 0000001b03e5ae37 0000000000002bae ffff810037fef228 000000018002e254
>Call Trace:
> [<ffffffff8009a827>] __call_usermodehelper+0x0/0x4f
> [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kthread       S ffffffff80142f55     0    27      1    32     499    10 (L-TLB)
> ffff810037f11e70 0000000000000046 00000000000010c5 ffff81007d417d68
> 0000000300000000 0000000000000001 ffff8100026db080 ffff81007d6a50c0
> 0000001bc400d9e2 00000000000018a2 ffff8100026db268 000000008002e254
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kblockd/0     S ffff810037f8d7a0     0    32     27            33       (L-TLB)
> ffff810037f1be70 0000000000000046 0000000000000287 ffffffff88075c83
> 0000000300000000 000000000000000a ffff81007fb6f7a0 ffff810037f8d7a0
> 0000001bc4a16c5e 00000000000026d9 ffff81007fb6f988 000000008002e254
>Call Trace:
> [<ffffffff88075c83>] :scsi_mod:scsi_dispatch_cmd+0x27d/0x2ff
> [<ffffffff80141701>] cfq_kick_queue+0x0/0x89
> [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kblockd/1     S ffffffff80142f55     0    33     27            34    32 (L-TLB)
> ffff810037f1de70 0000000000000046 ffffffff80141701 ffffffff801377a1
> 0000000300000000 000000000000000a ffff810037fa07e0 ffff8100026d4100
> 0000001bae1605d6 00000000000046d7 ffff810037fa09c8 000000018002e254
>Call Trace:
> [<ffffffff80141701>] cfq_kick_queue+0x0/0x89
> [<ffffffff801377a1>] elv_next_request+0x196/0x1a6
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kacpid        S ffffffff80142f55     0    34     27           119    33 (L-TLB)
> ffff810037f1fe70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000005 ffff81007fb6f040 ffffffff802e3ae0
> 00000014dd1c14f6 000000000000062a ffff81007fb6f228 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>cqueue/0      S ffffffff80142f55     0   119     27           120    34 (L-TLB)
> ffff810037a3be70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000006 ffff810037fe4860 ffffffff802e3ae0
> 00000014e814e921 00000000000007e8 ffff810037fe4a48 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>cqueue/1      S ffffffff80142f55     0   120     27           123   119 (L-TLB)
> ffff810037a3de70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000005 ffff81007fb70100 ffff8100026d4100
> 00000014e815a3f2 000000000000078b ffff81007fb702e8 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>khubd         S ffffffff80142f55     0   123     27           125   120 (L-TLB)
> ffff810037f2be10 0000000000000046 ffffffff8008ac03 8000018000000000
> ffff810037ca1000 000000000000000a ffff810037fe7080 ffff810037f83820
> 0000001565ca64c4 0000000000003a2b ffff810037fe7268 0000000037c97fa0
>Call Trace:
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff801da9a9>] hub_port_status+0x59/0xcf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff801dd69f>] hub_thread+0xa92/0xb10
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff801dcc0d>] hub_thread+0x0/0xb10
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kseriod       S ffffffff80142f55     0   125     27           198   123 (L-TLB)
> ffff810037f2fe90 0000000000000046 ffffffff80314740 0000000000008080
> ffffffff80314740 000000000000000a ffff81007fb750c0 ffff81007f1080c0
> 000000199e5ee6ee 0000000000020f9e ffff81007fb752a8 00000000ffffffea
>Call Trace:
> [<ffffffff801af6b4>] driver_create_file+0x31/0x39
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff801f0fca>] serio_thread+0x29c/0x2e7
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff801f0d2e>] serio_thread+0x0/0x2e7
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>pdflush       S ffffffff80142f55     0   198     27           199   125 (L-TLB)
> ffff81007f0e3e70 0000000000000046 ffff810037f6b820 ffff81007ffbfd60
> 0000000000000282 0000000000000005 ffff810037f6b820 ffffffff802e3ae0
> 00000014ed34e564 00000000000009b3 ffff810037f6ba08 000000008008a335
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff80056236>] pdflush+0x0/0x1fb
> [<ffffffff80056323>] pdflush+0xed/0x1fb
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>pdflush       S ffffffff80142f55     0   199     27           200   198 (L-TLB)
> ffff81007f0e5e70 0000000000000046 ffffffff802f2020 ffff8100026cc000
> 0000000000000286 000000000000000a ffff810037f867a0 ffff8100026d4100
> 000000b83febc411 0000000000005b19 ffff810037f86988 0000000100000282
>Call Trace:
> [<ffffffff800c30ca>] wb_kupdate+0x106/0x10d
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff80056236>] pdflush+0x0/0x1fb
> [<ffffffff80056323>] pdflush+0xed/0x1fb
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kswapd0       S ffffffff80142f55     0   200     27           201   199 (L-TLB)
> ffff81007f0e7dd0 0000000000000046 ffff810037f6b0c0 ffff81007ffbfd50
> ffff81000000c000 0000000000000004 ffff810037f6b0c0 ffffffff802e3ae0
> 00000014ed364300 0000000000000860 ffff810037f6b2a8 0000000000000000
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800575fb>] kswapd+0x127/0x459
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff800574d4>] kswapd+0x0/0x459
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>aio/0         S ffff8100026db080     0   201     27           202   200 (L-TLB)
> ffff81007f0e9e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000004 ffff810037f87860 ffff8100026db080
> 00000014ed3687a9 000000000000077d ffff810037f87a48 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>aio/1         S ffffffff80142f55     0   202     27           345   201 (L-TLB)
> ffff81007f0ebe70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000003 ffff810037f61860 ffff8100026d4100
> 00000014ed36d8e0 000000000000052b ffff810037f61a48 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kpsmoused     S ffff81007fb75820     0   345     27           385   202 (L-TLB)
> ffff810037a51e70 0000000000000046 ffff810037a51dd0 ffffffff8008a60e
> 00000015438e3fc2 0000000000000009 ffff81007fb75820 ffff81007fb750c0
> 0000001543901d1a 000000000000090e ffff81007fb75a08 000000010237e980
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_eh_0     S ffffffff80142f55     0   385     27           386   345 (L-TLB)
> ffff81007e883e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000009 ffff810037feb100 ffffffff802e3ae0
> 000000165b2c20f8 00000000000005ff ffff810037feb2e8 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f72>] :scsi_mod:scsi_error_handler+0x6a/0x4ac
> [<ffffffff88078f08>] :scsi_mod:scsi_error_handler+0x0/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_wq_0     S ffffffff80142f55     0   386     27           402   385 (L-TLB)
> ffff81007e885e70 0000000000000046 ffff81007f2173c0 ffff81007f217680
> 0000000300000000 000000000000000a ffff810037f8d7a0 ffffffff802e3ae0
> 000000b887ad680a 00000000000021f1 ffff810037f8d988 000000008002e254
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8004fd6d>] datagram_poll+0x0/0xc8
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_eh_1     S ffffffff80142f55     0   402     27           406   386 (L-TLB)
> ffff81007f309e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000009 ffff810037fe6820 ffffffff802e3ae0
> 0000001730ba52e7 000000000000069a ffff810037fe6a08 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f72>] :scsi_mod:scsi_error_handler+0x6a/0x4ac
> [<ffffffff88078f08>] :scsi_mod:scsi_error_handler+0x0/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ata/0         S ffffffff80142f55     0   406     27           407   402 (L-TLB)
> ffff81007e845e70 0000000000000046 ffff81007e845dd0 ffffffff8008a60e
> 000000184d50001b 0000000000000009 ffff81007f161040 ffff810037f61100
> 000000184d504e7e 0000000000000955 ffff81007f161228 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ata/1         S ffffffff80142f55     0   407     27           408   406 (L-TLB)
> ffff81007e855e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000008 ffff810037fee0c0 ffff810037f61100
> 000000184d509963 0000000000000514 ffff810037fee2a8 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ata_aux       S ffffffff80142f55     0   408     27           412   407 (L-TLB)
> ffff81007eab3e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000008 ffff810037f710c0 ffff8100026d4100
> 000000184d50f448 0000000000000552 ffff810037f712a8 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_eh_2     S ffff810037f8f860     0   412     27           413   408 (L-TLB)
> ffff81007f3c1e70 0000000000000046 ffff81007e8ffaa8 ffffffff8009aec1
> 0000000300000000 0000000000000009 ffff810037f84080 ffff810037f8f860
> 0000001857130e4b 0000000000000d49 ffff810037f84268 000000018002e254
>Call Trace:
> [<ffffffff8009aec1>] flush_cpu_workqueue+0x9f/0xad
> [<ffffffff88075260>] :scsi_mod:__scsi_iterate_devices+0x56/0x6f
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f72>] :scsi_mod:scsi_error_handler+0x6a/0x4ac
> [<ffffffff88078f08>] :scsi_mod:scsi_error_handler+0x0/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>scsi_eh_3     S ffffffff80142f55     0   413     27           426   412 (L-TLB)
> ffff81007f2ade70 0000000000000046 0000000000000000 0000000000000000
> 0000000300000000 0000000000000009 ffff810037f8f860 ffff8100026d4100
> 0000001857132b3f 0000000000001cf4 ffff810037f8fa48 000000018002e254
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f72>] :scsi_mod:scsi_error_handler+0x6a/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88078f08>] :scsi_mod:scsi_error_handler+0x0/0x4ac
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ksnapd        S ffffffff80142f55     0   426     27           430   413 (L-TLB)
> ffff81007ea21e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000005 ffff810037f90820 ffffffff802e3ae0
> 0000001857af9b6d 0000000000000850 ffff810037f90a08 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kmpathd/0     S ffffffff80142f55     0   430     27           431   426 (L-TLB)
> ffff81007ea13e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000004 ffff810037f70100 ffff810037f970c0
> 0000001857d228d6 000000000000079d ffff810037f702e8 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kmpathd/1     S ffff81007f15c080     0   431     27           442   430 (L-TLB)
> ffff81007ea17e70 0000000000000046 ffff81007ea17df0 ffffffff8002e254
> 0000000300000000 000000000000000a ffff81007f15c080 ffff810037f867a0
> 00000023ccd967b8 00000000000005e1 ffff81007f15c268 000000018002e254
>Call Trace:
> [<ffffffff8002e254>] __wake_up+0x38/0x4f
> [<ffffffff881dc2c7>] :dm_multipath:process_queued_ios+0x0/0x159
> [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kjournald     D ffff81007f15c080     0   442     27           470   431 (L-TLB)
> ffff81007ebe7ca0 0000000000000046 ffff81007eb009f0 0000000000000400
> 0000000000f9d905 000000000000000a ffff81007f1617a0 ffff81007f15c080
> 0000001c6e322fda 00000000000061c9 ffff81007f161988 0000000100f08002
>Call Trace:
> [<ffffffff8006d7bf>] do_gettimeofday+0x50/0x92
> [<ffffffff8005a511>] getnstimeofday+0x10/0x28
> [<ffffffff80014eec>] sync_buffer+0x0/0x3f
> [<ffffffff80063742>] io_schedule+0x3f/0x67
> [<ffffffff80014f27>] sync_buffer+0x3b/0x3f
> [<ffffffff8006396e>] __wait_on_bit+0x40/0x6e
> [<ffffffff80014eec>] sync_buffer+0x0/0x3f
> [<ffffffff80063a08>] out_of_line_wait_on_bit+0x6c/0x78
> [<ffffffff8009de10>] wake_bit_function+0x0/0x23
> [<ffffffff8003a59c>] sync_dirty_buffer+0x96/0xca
> [<ffffffff8803898a>] :jbd:journal_update_superblock+0x77/0xb5
> [<ffffffff88035381>] :jbd:journal_commit_transaction+0x2b/0x10ca
> [<ffffffff8003d671>] lock_timer_base+0x1b/0x3c
> [<ffffffff8004a946>] try_to_del_timer_sync+0x51/0x5a
> [<ffffffff88039419>] :jbd:kjournald+0xc1/0x213
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff88039358>] :jbd:kjournald+0x0/0x213
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff880f10b7>] :tg3:tg3_start_xmit_dma_bug+0x0/0x78b
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kauditd       S ffffffff80142f55     0   470     27           876   442 (L-TLB)
> ffff81007dcf3e90 0000000000000046 ffff810037f97820 ffff810037f83820
> ffff810037f97820 0000000000000009 ffff810037f97820 ffff810037f83820
> 000000194dd073d4 00000000000007e3 ffff810037f97a08 0000000000000046
>Call Trace:
> [<ffffffff8002e254>] __wake_up+0x38/0x4f
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800afe99>] kauditd_thread+0x144/0x17b
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff800afd55>] kauditd_thread+0x0/0x17b
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>udevd         S ffffffff80142f55     0   499      1          4142    27 (NOTLB)
> ffff81007e0cda18 0000000000000082 00002b953d810380 ffff81007f213440
> 0000000000000080 0000000000000007 ffff810037f83820 ffff8100026d4100
> 0000001bd05d9021 0000000000018461 ffff810037f83a08 0000000100100000
>Call Trace:
> [<ffffffff80063797>] schedule_timeout+0x1e/0xad
> [<ffffffff80063a5d>] mutex_lock+0xd/0x1d
> [<ffffffff800eda2c>] inotify_poll+0x49/0x50
> [<ffffffff8001155f>] do_select+0x3fe/0x462
> [<ffffffff8001e476>] __pollwait+0x0/0xe2
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff800093b2>] __handle_mm_fault+0xd62/0xe23
> [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff8011f7e2>] inode_has_perm+0x56/0x63
> [<ffffffff800df607>] core_sys_select+0x1bc/0x265
> [<ffffffff8011f707>] may_link+0xc7/0xda
> [<ffffffff8004cd1f>] shrink_dcache_parent+0x2e/0xe1
> [<ffffffff80016270>] sys_select+0xc1/0x17c
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff80011715>] sys_read+0x45/0x6e
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>kedac         S ffffffff80142f55     0   876     27          4089   470 (L-TLB)
> ffff81007d301e70 0000000000000046 ffff81007d301dd0 ffffffff8008a60e
> 00000019991ea385 000000000000000a ffff81007f441100 ffff8100026d4100
> 000000b8779c8b32 0000000000000675 ffff81007f4412e8 0000000102376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff88248a0f>] :edac_mc:edac_kernel_thread+0x0/0xeb
> [<ffffffff80063803>] schedule_timeout+0x8a/0xad
> [<ffffffff8009543e>] process_timeout+0x0/0x5
> [<ffffffff88248ad2>] :edac_mc:edac_kernel_thread+0xc3/0xeb
> [<ffffffff88248a0f>] :edac_mc:edac_kernel_thread+0x0/0xeb
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kjournald     S ffffffff80142f55     0  4089     27          4245   876 (L-TLB)
> ffff81007e1d7e70 0000000000000046 0000000000000000 0000000000000005
> 0000000000000000 0000000000000008 ffff810037fe60c0 ffffffff802e3ae0
> 0000001b4dd37d1d 0000000000002079 ffff810037fe62a8 0000000080089241
>Call Trace:
> [<ffffffff880394ea>] :jbd:kjournald+0x192/0x213
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff88039358>] :jbd:kjournald+0x0/0x213
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff880f10b7>] :tg3:tg3_start_xmit_dma_bug+0x0/0x78b
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>rc            S ffffffff80142f55     0  4142      1  4320    4204   499 (NOTLB)
> ffff81007eb6bee8 0000000000000082 0000003a0000003a ffff81007e3667a0
> ffff81007eb6beb8 0000000000000003 ffff81007e3667a0 ffff8100026d4100
> 0000001bc7915ff8 000000000001414b ffff81007e366988 0000000100000004
>Call Trace:
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff80028046>] do_wait+0x936/0xa0a
> [<ffffffff8002ff32>] vfs_ioctl+0x248/0x261
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff80030193>] sys_rt_sigprocmask+0xc0/0xd9
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>readahead     D ffffffff80142f55     0  4204      1          4300  4142 (NOTLB)
> ffff81007da8b8f8 0000000000000082 ffff81007f3cb1d8 ffff81007e85d380
> 0000000000000000 0000000000000003 ffff81007e010080 ffff8100026d4100
> 0000001bc6219e32 000000000000ffbd ffff81007e010268 00000001023679b8
>Call Trace:
> [<ffffffff8006d7bf>] do_gettimeofday+0x50/0x92
> [<ffffffff80014eec>] sync_buffer+0x0/0x3f
> [<ffffffff80063742>] io_schedule+0x3f/0x67
> [<ffffffff80014f27>] sync_buffer+0x3b/0x3f
> [<ffffffff8006396e>] __wait_on_bit+0x40/0x6e
> [<ffffffff80014eec>] sync_buffer+0x0/0x3f
> [<ffffffff80063a08>] out_of_line_wait_on_bit+0x6c/0x78
> [<ffffffff8009de10>] wake_bit_function+0x0/0x23
> [<ffffffff800254d7>] __bread+0x6c/0x81
> [<ffffffff8804eec3>] :ext3:ext3_get_branch+0x67/0xd2
> [<ffffffff8804f0f3>] :ext3:ext3_get_blocks_handle+0xc6/0x9f1
> [<ffffffff8819a940>] :dm_mod:dm_request+0x109/0x110
> [<ffffffff8001bbc8>] generic_make_request+0x1e8/0x1ff
> [<ffffffff88199465>] :dm_mod:__map_bio+0xbb/0x119
> [<ffffffff8819a15a>] :dm_mod:__split_bio+0x3a6/0x3be
> [<ffffffff8804fd3e>] :ext3:ext3_get_block+0xbe/0xe3
> [<ffffffff80028287>] do_mpage_readpage+0x16d/0x4a9
> [<ffffffff8804fc80>] :ext3:ext3_get_block+0x0/0xe3
> [<ffffffff8804fc80>] :ext3:ext3_get_block+0x0/0xe3
> [<ffffffff80038b75>] mpage_readpages+0xb2/0x132
> [<ffffffff8804fc80>] :ext3:ext3_get_block+0x0/0xe3
> [<ffffffff8804fc80>] :ext3:ext3_get_block+0x0/0xe3
> [<ffffffff80038ad6>] mpage_readpages+0x13/0x132
> [<ffffffff800129b2>] __do_page_cache_readahead+0x101/0x1d9
> [<ffffffff8807b08f>] :scsi_mod:scsi_request_fn+0x2b4/0x390
> [<ffffffff800c32e5>] force_page_cache_readahead+0x5f/0x81
> [<ffffffff800543f2>] sys_readahead+0x77/0x94
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>kondemand/0   S ffffffff80142f55     0  4245     27          4246  4089 (L-TLB)
> ffff81007d2fbe70 0000000000000046 ffff810002379568 ffffffff80095b71
> 0000000300000000 000000000000000a ffff81007df62860 ffffffff802e3ae0
> 000000b88dfbe88c 0000000000000992 ffff81007df62a48 000000008002e254
>Call Trace:
> [<ffffffff80095b71>] add_timer_on+0x53/0x62
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>kondemand/1   S ffffffff80142f55     0  4246     27          4266  4245 (L-TLB)
> ffff81007dbafe70 0000000000000046 ffff810002381ae8 ffffffff80095b71
> 0000000300000000 000000000000000a ffff81007d0af7a0 ffff8100026d4100
> 000000b88dfbc94b 00000000000009c2 ffff81007d0af988 000000018002e254
>Call Trace:
> [<ffffffff80095b71>] add_timer_on+0x53/0x62
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_addr       S ffffffff80142f55     0  4266     27          4277  4246 (L-TLB)
> ffff81007d3d5e70 0000000000000046 ffff81007d3d5dd0 ffffffff8008a60e
> 0000000300000000 000000000000000a ffff81007d770820 ffffffff802e3ae0
> 000000b7b688e968 00000000000005d0 ffff81007d770a08 000000008002e254
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_mcast      S ffffffff80142f55     0  4277     27          4278  4266 (L-TLB)
> ffff81007c4d5e70 0000000000000046 ffff81007c4d5dd0 ffffffff8008a60e
> 0000001bc24bb72c 0000000000000004 ffff81007f15c7e0 ffff81007d6a50c0
> 0000001bc24be936 0000000000000922 ffff81007f15c9c8 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_inform     S ffffffff80142f55     0  4278     27          4279  4277 (L-TLB)
> ffff81007c4d7e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000004 ffff81007f109100 ffffffff802e3ae0
> 0000001bc24c7e2b 00000000000007d9 ffff81007f1092e8 0000000002376400
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>local_sa      S ffffffff80142f55     0  4279     27          4283  4278 (L-TLB)
> ffff81007c4d9e70 0000000000000046 0000000000000000 0000000000000000
> ffffffffffffffff 0000000000000004 ffff810037f6e040 ffff8100026d4100
> 0000001bc24d242d 00000000000007f5 ffff810037f6e228 000000010237e980
>Call Trace:
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>iw_cm_wq      S ffffffff80142f55     0  4283     27          4286  4279 (L-TLB)
> ffff81007cb25e70 0000000000000046 ffff81007cb25dd0 ffffffff8008a60e
> 0000001bc2a58cf3 0000000000000003 ffff81007d6a5820 ffff81007d6a50c0
> 0000001bc2a5be4e 0000000000000952 ffff81007d6a5a08 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_cm/0       S ffff81007cc977e0     0  4286     27          4287  4283 (L-TLB)
> ffff81007c4f3e70 0000000000000046 ffff81007c4f3dd0 ffffffff8008a60e
> 0000001bc3082969 0000000000000002 ffff81007cc977e0 ffff81007ff117e0
> 0000001bc308a1ab 0000000000000b22 ffff81007cc979c8 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>ib_cm/1       S ffffffff80142f55     0  4287     27          4291  4286 (L-TLB)
> ffff81007c4f5e70 0000000000000046 00000000000000e0 000000000003b2fc
> 00002b81a1a10300 0000000000000002 ffff81007ff117e0 ffff8100026d4100
> 0000001bc31ed578 0000000000001847 ffff81007ff119c8 0000000180066e26
>Call Trace:
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>rdma_cm       S ffffffff80142f55     0  4291     27                4287 (L-TLB)
> ffff81007c525e70 0000000000000046 ffff81007c525dd0 ffffffff8008a60e
> 0000001bc380c2b1 0000000000000001 ffff81007f1080c0 ffff81007d6a50c0
> 0000001bc380f690 0000000000000920 ffff81007f1082a8 0000000002376400
>Call Trace:
> [<ffffffff8008a60e>] __activate_task+0x27/0x39
> [<ffffffff80062efb>] thread_return+0x0/0xdf
> [<ffffffff800974cc>] recalc_sigpending_and_wake+0x9/0x1a
> [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff800497be>] worker_thread+0x0/0x122
> [<ffffffff8004987e>] worker_thread+0xc0/0x122
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003253d>] kthread+0xfe/0x132
> [<ffffffff8005dfb1>] child_rip+0xa/0x11
> [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
> [<ffffffff8003243f>] kthread+0x0/0x132
> [<ffffffff8005dfa7>] child_rip+0x0/0x11
>
>iscsid        S ffffffff80142f55     0  4300      1          4301  4204 (NOTLB)
> ffff81007c5cfeb8 0000000000000082 ffff810002380a60 000000003b9aca00
> 0000000000000000 0000000000000007 ffff81007d6a50c0 ffff8100026d4100
> 000000b882eaacf2 000000000000164c ffff81007d6a52a8 000000015e37dbd7
>Call Trace:
> [<ffffffff8009fbe6>] enqueue_hrtimer+0x55/0x70
> [<ffffffff80063c55>] do_nanosleep+0x3f/0x70
> [<ffffffff8005a10a>] hrtimer_nanosleep+0x58/0x118
> [<ffffffff8000d052>] dput+0x2c/0x114
> [<ffffffff8009fd51>] hrtimer_wakeup+0x0/0x22
> [<ffffffff8001d6df>] sigprocmask+0xb7/0xdb
> [<ffffffff8005445b>] sys_nanosleep+0x4c/0x62
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>iscsid        S ffffffff80142f55     0  4301      1                4300 (NOTLB)
> ffff81007c561b38 0000000000000082 ffffffff00100053 ffffffff00000000
> 0000000000000001 000000000000000a ffff810037f6d080 ffffffff802e3ae0
> 000000b88ddd7479 0000000000001373 ffff810037f6d268 0000000080009523
>Call Trace:
> [<ffffffff80063803>] schedule_timeout+0x8a/0xad
> [<ffffffff8009543e>] process_timeout+0x0/0x5
> [<ffffffff8002f61c>] do_sys_poll+0x277/0x35e
> [<ffffffff8001e476>] __pollwait+0x0/0xe2
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8011f36d>] ipc_has_perm+0x59/0x67
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff80114ccd>] sys_semtimedop+0x6e7/0x720
> [<ffffffff8011f7e2>] inode_has_perm+0x56/0x63
> [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
> [<ffffffff8000a82b>] get_page_from_freelist+0x377/0x3fa
> [<ffffffff8000f083>] __alloc_pages+0x65/0x2ce
> [<ffffffff8807deaf>] :scsi_mod:store_state_field+0x83/0xa5
> [<ffffffff8000c31a>] _atomic_dec_and_lock+0x39/0x57
> [<ffffffff8000d063>] dput+0x3d/0x114
> [<ffffffff800125f3>] __fput+0x16c/0x198
> [<ffffffff8004bbc9>] sys_poll+0x2d/0x34
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>S10network    S ffffffff80142f55     0  4320   4142  4326               (NOTLB)
> ffff81007bd35df8 0000000000000086 000000000000003a 000000000000003a
> 0000000000000000 0000000000000001 ffff81007f10a040 ffff810037f7a820
> 0000001bc8ab2408 000000000000955b ffff81007f10a228 0000000100000000
>Call Trace:
> [<ffffffff800477cf>] pipe_wait+0x69/0x93
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff80063a5d>] mutex_lock+0xd/0x1d
> [<ffffffff8002ec10>] pipe_readv+0x31d/0x3a2
> [<ffffffff800de208>] pipe_read+0x1a/0x1f
> [<ffffffff8000b337>] vfs_read+0xcb/0x171
> [<ffffffff80011715>] sys_read+0x45/0x6e
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>S10network    S ffffffff80142f55     0  4326   4320  4329               (NOTLB)
> ffff81007bdbdee8 0000000000000082 0000003a0000003a ffff810037f7a820
> 0000000000000000 0000000000000001 ffff810037f7a820 ffffffff802e3ae0
> 0000001bc8eaa60b 0000000000010d8b ffff810037f7aa08 0000000000000004
>Call Trace:
> [<ffffffff8011ef8f>] avc_has_perm+0x43/0x55
> [<ffffffff80028046>] do_wait+0x936/0xa0a
> [<ffffffff8008ac03>] default_wake_function+0x0/0xe
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>S10network    D ffffffff80142f55     0  4329   4326          4330       (NOTLB)
> ffff81007bd73b48 0000000000000086 ffff81007d7ff518 0000000000000004
> 000000000000000e 0000000000000001 ffff810037f82860 ffff8100026d4100
> 0000001bc8da4ef1 0000000000001d06 ffff810037f82a48 0000000100000001
>Call Trace:
> [<ffffffff8006d7bf>] do_gettimeofday+0x50/0x92
> [<ffffffff8002881b>] sync_page+0x0/0x42
> [<ffffffff80063742>] io_schedule+0x3f/0x67
> [<ffffffff80028859>] sync_page+0x3e/0x42
> [<ffffffff80063886>] __wait_on_bit_lock+0x36/0x66
> [<ffffffff8003f750>] __lock_page+0x5e/0x64
> [<ffffffff8009de10>] wake_bit_function+0x0/0x23
> [<ffffffff80063015>] cond_resched+0x3b/0x42
> [<ffffffff8000bf44>] do_generic_mapping_read+0x1eb/0x3f8
> [<ffffffff8000cd69>] file_read_actor+0x0/0x154
> [<ffffffff8000c29d>] __generic_file_aio_read+0x14c/0x190
> [<ffffffff800167be>] generic_file_aio_read+0x34/0x39
> [<ffffffff8000caa4>] do_sync_read+0xc7/0x104
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff8000b337>] vfs_read+0xcb/0x171
> [<ffffffff80044bf8>] kernel_read+0x41/0x55
> [<ffffffff8003e8e0>] do_execve+0x11c/0x243
> [<ffffffff80054760>] sys_execve+0x36/0x4c
> [<ffffffff8005d4d3>] stub_execve+0x67/0xb0
>
>sed           S ffffffff80142f55     0  4330   4326                4329 (NOTLB)
> ffff81007bde3df8 0000000000000082 000000000000003a 000000000000003a
> 0000000000000000 0000000000000001 ffff81007df62100 ffff810037f7a820
> 0000001bc8e99880 00000000000e8918 ffff81007df622e8 0000000000000000
>Call Trace:
> [<ffffffff800477cf>] pipe_wait+0x69/0x93
> [<ffffffff8009dde2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff80063a5d>] mutex_lock+0xd/0x1d
> [<ffffffff8002ec10>] pipe_readv+0x31d/0x3a2
> [<ffffffff8000dde2>] do_mmap_pgoff+0x66c/0x7d7
> [<ffffffff800de208>] pipe_read+0x1a/0x1f
> [<ffffffff8000b337>] vfs_read+0xcb/0x171
> [<ffffffff80011715>] sys_read+0x45/0x6e
> [<ffffffff8005d116>] system_call+0x7e/0x83
>
>BUG: soft lockup - CPU#0 stuck for 51s! [swapper:0]
>CPU 0:
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr cpufreq_ondemand acpi_cpufreq video sbs backlight i2c_ec button battery asus_acpi acpi_memhotplug ac parport_pc lp parport serio_raw i2c_i801 i2c_core e752x_edac edac_mc sg pcspkr ide_cd shpchp cdrom dm_round_robin dm_multipath dm_snapshot dm_zero dm_mirror dm_mod ata_piix libata mptspi mptscsih scsi_transport_spi mptbase tg3 iscsi_tcp libiscsi scsi_transport_iscsi sd_mod scsi_mod ext3 jbd uhci_hcd ohci_hcd ehci_hcd
>Pid: 0, comm: swapper Not tainted 2.6.18-92.el5 #1
>RIP: 0010:[<ffffffff80064aa8>]  [<ffffffff80064aa8>] _spin_unlock_irqrestore+0x8/0x9
>RSP: 0018:ffffffff80416ea0  EFLAGS: 00000292
>RAX: 0000000000000001 RBX: 0000000000000014 RCX: 0000000000000000
>RDX: ffff81007f0befd8 RSI: 0000000000000292 RDI: ffff81007f162c50
>RBP: ffffffff80416e20 R08: 0000000000000002 R09: 000000000000003e
>R10: ffffffff803c6260 R11: ffffffff80416d98 R12: ffffffff8005dc8e
>R13: 0000000000000001 R14: ffffffff80076f1d R15: ffffffff80416e20
>FS:  0000000000000000(0000) GS:ffffffff8039e000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
>CR2: 000000383b2cdcf0 CR3: 000000007df17000 CR4: 00000000000006e0
>
>Call Trace:
> <IRQ>  [<ffffffff801f0c29>] serio_interrupt+0x73/0x81
> [<ffffffff801f1765>] i8042_interrupt+0x1d7/0x1ec
> [<ffffffff8001097e>] handle_IRQ_event+0x29/0x58
> [<ffffffff800b71de>] __do_IRQ+0xa4/0x103
> [<ffffffff80011ed2>] __do

Actions: View

Attachments on bug 456228: 312338 | 312578 | 312635 | 312636 | 314924