Attachment 306317 Details for Bug 447799 – log from the startup hang

log from the startup hang

grant-01.log (text/plain), 66.89 KB, created by Corey Marthaler on 2008-05-21 21:27:22 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Corey Marthaler

Created: 2008-05-21 21:27:22 UTC

Size: 66.89 KB

patch

obsolete

>May 21 15:19:54 grant-01 lock_gulmd_main[3083]: Forked lock_gulmd_core. 
>May 21 15:19:54 grant-01 lock_gulmd_core[3085]: Starting lock_gulmd_core 1.0.10. (built Mar 14 2007 16:40:42) Copyright (C) 2004 Red Hat, Inc.  All rights reserved. 
>May 21 15:19:54 grant-01 lock_gulmd_core[3085]: I am running in Fail-over mode. 
>May 21 15:19:54 grant-01 lock_gulmd_core[3085]: I am (grant-01) with ip (::ffff:10.15.89.151) 
>May 21 15:19:54 grant-01 lock_gulmd_core[3085]: This is cluster GRANT 
>May 21 15:19:54 grant-01 lock_gulmd_core[3085]: EOF on xdr (Magma::3020 ::1 idx:1 fd:6) 
>May 21 15:19:55 grant-01 lock_gulmd_main[3083]: Forked lock_gulmd_LT. 
>May 21 15:19:55 grant-01 lock_gulmd_LT[3088]: Starting lock_gulmd_LT 1.0.10. (built Mar 14 2007 16:40:42) Copyright (C) 2004 Red Hat, Inc.  All rights reserved. 
>May 21 15:19:55 grant-01 lock_gulmd_LT[3088]: I am running in Fail-over mode. 
>May 21 15:19:55 grant-01 lock_gulmd_LT[3088]: I am (grant-01) with ip (::ffff:10.15.89.151) 
>May 21 15:19:55 grant-01 lock_gulmd_LT[3088]: This is cluster GRANT 
>May 21 15:19:55 grant-01 lock_gulmd_core[3085]: EOF on xdr (Magma::3020 ::1 idx:2 fd:7) 
>May 21 15:19:56 grant-01 lock_gulmd_main[3083]: Forked lock_gulmd_LTPX. 
>May 21 15:19:56 grant-01 lock_gulmd_LTPX[3092]: Starting lock_gulmd_LTPX 1.0.10. (built Mar 14 2007 16:40:42) Copyright (C) 2004 Red Hat, Inc.  All rights reserved. 
>May 21 15:19:56 grant-01 lock_gulmd_LTPX[3092]: I am running in Fail-over mode. 
>May 21 15:19:56 grant-01 lock_gulmd_LTPX[3092]: I am (grant-01) with ip (::ffff:10.15.89.151) 
>May 21 15:19:56 grant-01 lock_gulmd_LTPX[3092]: This is cluster GRANT 
>May 21 15:19:56 grant-01 lock_gulmd_core[3085]: Found Master at grant-03.lab.msp.redhat.com, so I'm a Slave. 
>May 21 15:19:56 grant-01 lock_gulmd_LT000[3088]: New Master at grant-03.lab.msp.redhat.com ::ffff:10.15.89.153 
>May 21 15:19:56 grant-01 lock_gulmd_LT000[3088]: Logged into Master at grant-03.lab.msp.redhat.com ::ffff:10.15.89.153 
>May 21 15:19:56 grant-01 lock_gulmd_LTPX[3092]: New Master at grant-03.lab.msp.redhat.com ::ffff:10.15.89.153 
>May 21 15:19:56 grant-01 lock_gulmd_LTPX[3092]: Logged into LT000 at grant-03.lab.msp.redhat.com ::ffff:10.15.89.153 
>May 21 15:19:56 grant-01 lock_gulmd_LTPX[3092]: Finished resending to LT000 
>May 21 15:19:56 grant-01 ccsd[3019]: Connected to cluster infrastruture via: GuLM Plugin v1.0.5 
>May 21 15:19:56 grant-01 ccsd[3019]: Initial status:: Quorate 
>May 21 15:19:57 grant-01 lock_gulmd: startup succeeded
>May 21 15:19:57 grant-01 fenced: Skipping because of <gulm> section detected in /etc/cluster/cluster.conf succeeded
>May 21 15:19:57 grant-01 clvmd: Can't open cluster manager socket: Address family not supported by protocol
>May 21 15:19:57 grant-01 clvmd: Cluster LVM daemon started - connected to GULM
>May 21 15:19:57 grant-01 clvmd: clvmd startup succeeded
>May 21 15:19:57 grant-01 ccsd[3019]: Cluster is quorate.  Allowing connections. 
>May 21 16:16:08 grant-01 kernel: SysRq : Show State
>May 21 16:16:08 grant-01 kernel: 
>May 21 16:16:08 grant-01 kernel:                                                        sibling
>May 21 16:16:08 grant-01 kernel:   task                 PC          pid father child younger older
>May 21 16:16:08 grant-01 kernel: init          S 000000000000000b     0     1      0     2               (NOTLB)
>May 21 16:16:08 grant-01 kernel: 000001011c091d58 0000000000000002 000001021addef00 000001021addef00 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 0000000000000246 000001011c091e58 0000000380191dd1 
>May 21 16:16:08 grant-01 kernel:        00000101200087f0 00000000000003a1 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff801409dc>{__mod_timer+293} <ffffffff803187c3>{schedule_timeout+396} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80141406>{process_timeout+0} <ffffffff8018e517>{do_select+939} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8018e0b1>{__pollwait+0} <ffffffff8018e896>{sys_select+820} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801102b6>{system_call+126} 
>May 21 16:16:08 grant-01 kernel: migration/0   S 000001012005e7e0     0     2      1             3       (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010037e19ec8 0000000000000046 000001012005e7e0 0000000000000076 
>May 21 16:16:08 grant-01 kernel:        00000001200077f0 0000000000000000 000001000103fb00 0000000000000001 
>May 21 16:16:08 grant-01 kernel:        00000101200077f0 0000000000000183 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80134712>{__wake_up_common+67} <ffffffff80135855>{migration_thread+323} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80135712>{migration_thread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: ksoftirqd/0   S 0000000000000000     0     3      1             4     2 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010037e1bf08 0000000000000046 00000100dfeac7f0 0000000000000077 
>May 21 16:16:08 grant-01 kernel:        00000100dfec9010 0000000000000246 000001000103fb00 0000000000000000 
>May 21 16:16:08 grant-01 kernel:        0000010120007030 0000000000000a61 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8013d9b0>{ksoftirqd+0} <ffffffff8013d9ec>{ksoftirqd+60} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: migration/1   S 000001000103e7e0     0     4      1             5     3 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010037e1dec8 0000000000000046 000001000103e7e0 0000000000000077 
>May 21 16:16:08 grant-01 kernel:        00000001200067f0 0000000000000001 000001012005fb00 0000000100000001 
>May 21 16:16:08 grant-01 kernel:        00000101200067f0 00000000000001a2 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80134712>{__wake_up_common+67} <ffffffff80135855>{migration_thread+323} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80135712>{migration_thread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: ksoftirqd/1   S 0000000000000000     0     5      1             6     4 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010037e1ff08 0000000000000046 00000100dfeac7f0 0000000000000077 
>May 21 16:16:08 grant-01 kernel:        000001021c7fb010 0000000000000246 000001012005fb00 0000000100000000 
>May 21 16:16:08 grant-01 kernel:        0000010120006030 000000000000063a 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8013d9b0>{ksoftirqd+0} <ffffffff8013d9ec>{ksoftirqd+60} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: migration/2   S 00000101200667e0     0     6      1             7     5 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001021c705ec8 0000000000000046 00000101200667e0 0000000000000075 
>May 21 16:16:08 grant-01 kernel:        000000010105e7f0 0000000000000002 0000010001047b00 0000000200000001 
>May 21 16:16:08 grant-01 kernel:        000001000105e7f0 00000000000000fc 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80134712>{__wake_up_common+67} <ffffffff80135855>{migration_thread+323} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80135712>{migration_thread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: ksoftirqd/2   S 0000000000000000     0     7      1             8     6 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001011c011f08 0000000000000046 0000010120e8a030 0000000000000077 
>May 21 16:16:08 grant-01 kernel:        000001011c010000 0000000000000246 0000010001047b00 0000000200000000 
>May 21 16:16:08 grant-01 kernel:        000001000105e030 0000000000000830 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8013d9b0>{ksoftirqd+0} <ffffffff8013d9ec>{ksoftirqd+60} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: migration/3   S 00000100010467e0     0     8      1             9     7 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001011c013ec8 0000000000000046 00000100010467e0 0000000000000075 
>May 21 16:16:08 grant-01 kernel:        000000011c7cc7f0 0000000000000003 0000010120067b00 0000000300000001 
>May 21 16:16:08 grant-01 kernel:        000001021c7cc7f0 00000000000001a9 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80134712>{__wake_up_common+67} <ffffffff80135855>{migration_thread+323} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80135712>{migration_thread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: ksoftirqd/3   S 0000000000000000     0     9      1            10     8 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001021c739f08 0000000000000046 0000010037dab030 ffffffff0000007d 
>May 21 16:16:08 grant-01 kernel:        00000100dfe99034 0000000020e16080 0000010120067b00 0000000300002002 
>May 21 16:16:08 grant-01 kernel:        000001021c7cc030 0000000000000571 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8013d9b0>{ksoftirqd+0} <ffffffff8013d9ec>{ksoftirqd+60} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: events/0      S ffffffff80164cee     0    10      1    14      11     9 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010001193e68 0000000000000046 ffffffff803e7d80 0000000000000069 
>May 21 16:16:08 grant-01 kernel:        0000000000000256 0000000000000246 000001000103fb00 0000000000000246 
>May 21 16:16:08 grant-01 kernel:        0000010120d807f0 0000000000000e1c 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80164cee>{cache_reap+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: events/1      S ffffffff80164cee     0    11      1            12    10 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010001195e68 0000000000000046 0000010120008030 0000010120061ec0 
>May 21 16:16:08 grant-01 kernel:        0000000000000008 0000000000000246 00000001002fcb71 0000000100000246 
>May 21 16:16:08 grant-01 kernel:        0000010120d80030 0000000000000c24 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80164cee>{cache_reap+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: events/2      S ffffffff8022f7e1     0    12      1            13    11 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010120db3e68 0000000000000046 0000010037e597f0 0000010001049ec0 
>May 21 16:16:08 grant-01 kernel:        0000000000000001 0000000000000246 00000001002fca52 0000000200000246 
>May 21 16:16:08 grant-01 kernel:        00000100011677f0 0000000000000145 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8022f7e1>{flush_to_ldisc+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: events/3      S ffffffff80164cee     0    13      1   472      55    12 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010001197e68 0000000000000046 0000010037e59030 0000010100000074 
>May 21 16:16:08 grant-01 kernel:        0000000000000002 0000000000000246 00000001002fd106 0000000300000246 
>May 21 16:16:08 grant-01 kernel:        0000010001167030 0000000000000cb4 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80164cee>{cache_reap+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: khelper       S 000001011b545cd8     0    14     10            15       (L-TLB)
>May 21 16:16:08 grant-01 kernel: 0000010001199e68 0000000000000046 ffffffff801480cd 000001010000006a 
>May 21 16:16:08 grant-01 kernel:        0000000000000297 000000001c020d40 000001000103fb00 000000001b545d48 
>May 21 16:16:08 grant-01 kernel:        0000010120d827f0 000000000000050d 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff801480cd>{__call_usermodehelper+0} <ffffffff801480cd>{__call_usermodehelper+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: kacpid        S 000001021c7e3890     0    15     10            51    14 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 00000100dfd2be68 0000000000000046 0000000100000000 000001000000007d 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 000000001f1f51d8 ffffffff80483700 0000000000000002 
>May 21 16:16:08 grant-01 kernel:        0000010120d82030 000000000000144d 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80209ce7>{acpi_os_execute_deferred+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014860f>{worker_thread+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: kblockd/0     S ffffffff80254423     0    51     10            52    15 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001021c561e68 0000000000000046 ffffffffa000288c 000001021c73c3c8 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 ffffffffa0035be8 0000010037ca1200 0000000020e16080 
>May 21 16:16:08 grant-01 kernel:        000001021c5207f0 000000000000e66b 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffffa000288c>{:scsi_mod:scsi_done+0} <ffffffffa0035be8>{:libata:ata_scsi_queuecmd+378} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80254423>{blk_unplug_work+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014860f>{worker_thread+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: kblockd/1     S 0000010120e16260     0    52     10            53    51 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 00000100dfd43e68 0000000000000046 ffffffffa000288c 0000010200000074 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 00000000a0035be8 000001012005fb00 0000000120e16080 
>May 21 16:16:08 grant-01 kernel:        000001021c520030 000000000000c5f0 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffffa000288c>{:scsi_mod:scsi_done+0} <ffffffff80254423>{blk_unplug_work+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: kblockd/2     S 000001021c55e300     0    53     10            54    52 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001021c565e68 0000000000000046 0000000000000000 0000000000000000 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 0000000000000007 0000000000001f36 0000000200000000 
>May 21 16:16:08 grant-01 kernel:        00000100dfd137f0 0000000000001db6 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: kblockd/3     S 0000010120e16260     0    54     10            90    53 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 00000100dfd45e68 0000000000000046 ffffffffa000288c 0000010200000074 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 00000000a0035be8 0000010120067b00 0000000320e16080 
>May 21 16:16:08 grant-01 kernel:        00000100dfd13030 000000000000da08 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffffa000288c>{:scsi_mod:scsi_done+0} <ffffffff80254423>{blk_unplug_work+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: khubd         S 00000100011fe400     0    55      1            92    13 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001021c577e78 0000000000000046 0000010219d5cd88 ffffffff8029c322 
>May 21 16:16:08 grant-01 kernel:        0000000300000000 ffffffff804279f0 0000000000000000 0000000000000001 
>May 21 16:16:08 grant-01 kernel:        00000100dfd2e7f0 00000000000059a8 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8029c322>{fs_create_file+325} <ffffffff80293dbd>{hub_thread+2579} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80136084>{autoremove_wake_function+0} <ffffffff80136084>{autoremove_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff802933aa>{hub_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: pdflush       S ffffffff8014c534     0    90     10            91    54 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001021c599ec8 0000000000000046 00000100dfd2e030 000000000000006a 
>May 21 16:16:08 grant-01 kernel:        00000100dfd2e030 000000000103f120 ffffffff80483700 000000000103e7e0 
>May 21 16:16:08 grant-01 kernel:        00000100dfd2e030 000000000000051c 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff80134992>{set_user_nice+259} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80161bb4>{pdflush+191} <ffffffff80161af5>{pdflush+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: pdflush       S ffffffff8014c534     0    91     10            94    90 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 00000100dfd8bec8 0000000000000046 00000001002fd7fa 000001011c091de8 
>May 21 16:16:08 grant-01 kernel:        00000000fffffffc 000001011c091dd8 ffffffff8014c534 000000008016124d 
>May 21 16:16:08 grant-01 kernel:        000001021c5557f0 00000000000000f2 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80161bb4>{pdflush+191} <ffffffff80161af5>{pdflush+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel: aio/0         S 00000100dfd695c0     0    94     10            95    91 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 00000100dfd9de68 0000000000000046 0000000000000000 000000000000006b 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 0000000000000008 ffffffff80483700 0000000000000000 
>May 21 16:16:08 grant-01 kernel:        00000100dfd49030 00000000000004d2 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: kswapd1       S 000001021c59bf08     0    92      1            93    55 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001021c59beb8 0000000000000046 0000000000200200 000001021c555030 
>May 21 16:16:08 grant-01 kernel:        000001021c59be38 000001000103e7e0 000001021c59beb8 0000000180134fdb 
>May 21 16:16:08 grant-01 kernel:        000001021c555030 00000000000013f2 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8016817f>{kswapd+231} <ffffffff80136084>{autoremove_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80136084>{autoremove_wake_function+0} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80168098>{kswapd+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: kswapd0       S 000001021c59df08     0    93      1           241    92 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 000001021c59deb8 0000000000000046 000001021c59de08 000000000000007d 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 0000000000000000 ffffffff80483700 0000000080134fee 
>May 21 16:16:08 grant-01 kernel:        00000100dfd497f0 0000000000000895 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8016817f>{kswapd+231} <ffffffff80136084>{autoremove_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80136084>{autoremove_wake_function+0} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80168098>{kswapd+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:08 grant-01 kernel:        
>May 21 16:16:08 grant-01 kernel: aio/1         S 00000100dfd69640     0    95     10            96    94 (L-TLB)
>May 21 16:16:08 grant-01 kernel: 00000100dfd9fe68 0000000000000046 0000000000000000 0000000000000000 
>May 21 16:16:08 grant-01 kernel:        0000000000000000 0000000000000008 000000000000231e 0000000100000000 
>May 21 16:16:08 grant-01 kernel:        000001021c57b7f0 0000000000003261 
>May 21 16:16:08 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:08 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: aio/2         S 00000100dfd696c0     0    96     10            97    95 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 00000100dfda1e68 0000000000000046 0000000000000000 0000000000000000 
>May 21 16:16:09 grant-01 kernel:        0000000000000000 0000000000000007 0000000000001f36 0000000200000000 
>May 21 16:16:09 grant-01 kernel:        000001021c57b030 0000000000001d70 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: aio/3         S 00000100dfd69740     0    97     10                  96 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 00000100dfda3e68 0000000000000046 0000000000000011 00000100dfda3e88 
>May 21 16:16:09 grant-01 kernel:        000001021c5ae460 000001021c57c7f0 0000000000000001 0000000300000000 
>May 21 16:16:09 grant-01 kernel:        000001021c57c7f0 00000000000031fe 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80144e6f>{do_sigaction+481} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014860f>{worker_thread+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014860f>{worker_thread+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: kseriod       S 0000000000000000     0   241      1           482    93 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021c5e3ec8 0000000000000046 000001021c5e3e18 000001020000007b 
>May 21 16:16:09 grant-01 kernel:        ffffffff80132af5 0000000000000000 ffffffff80483700 000000001c5a9f98 
>May 21 16:16:09 grant-01 kernel:        000001021c57c030 0000000000000f32 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80132af5>{deactivate_task+21} <ffffffff80246e3c>{serio_thread+469} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80136084>{autoremove_wake_function+0} <ffffffff8013b530>{do_exit+3319} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80136084>{autoremove_wake_function+0} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801dade8>{selinux_d_instantiate+0} <ffffffff801dade8>{selinux_d_instantiate+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80246c67>{serio_thread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: ata/0         S ffffffff8014c534     0   472     13           473       (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021c26de68 0000000000000046 0000000100000001 0000000000000002 
>May 21 16:16:09 grant-01 kernel:        000001021c21f9d0 0000000000000008 000000000000231e 0000000000000100 
>May 21 16:16:09 grant-01 kernel:        000001021c21f7f0 0000000000001190 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: ata/1         S ffffffff80317358     0   473     13           474   472 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021c26fe68 0000000000000046 000001012005e840 0000000200000002 
>May 21 16:16:09 grant-01 kernel:        000001012005fb00 0000000000000007 0000000000001f36 000000012005e7e0 
>May 21 16:16:09 grant-01 kernel:        0000010037c5e7f0 00000000000012ae 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: ata/2         S 000001021c73eee0     0   474     13           475   473 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 0000010037d39e68 0000000000000046 0000010037d39dd8 ffffffff00000074 
>May 21 16:16:09 grant-01 kernel:        000000007fffffff 000000001c73ed98 0000010001047b00 000000021c73c3c8 
>May 21 16:16:09 grant-01 kernel:        0000010037c5e030 0000000000025d30 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffffa002fdc5>{:libata:ata_pio_task+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014860f>{worker_thread+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: ata/3         S 000001021c73eee0     0   475     13           476   474 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021c273e68 0000000000000046 000001021c273dd8 ffffffff00000074 
>May 21 16:16:09 grant-01 kernel:        000000007fffffff 000000001c73ed98 0000010120067b00 000000031c73c3c8 
>May 21 16:16:09 grant-01 kernel:        0000010037c617f0 0000000000028fdc 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffffa002fdc5>{:libata:ata_pio_task+0} <ffffffff801486f1>{worker_thread+226} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80134712>{__wake_up_common+67} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014860f>{worker_thread+0} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: ata_aux       S 000001021c268940     0   476     13          1028   475 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 0000010037d3be68 0000000000000046 0000000100000001 0000000000000076 
>May 21 16:16:09 grant-01 kernel:        000001021c21f9d0 0000000000000006 0000010120067b00 0000000300000100 
>May 21 16:16:09 grant-01 kernel:        0000010037c61030 00000000000003bf 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801486f1>{worker_thread+226} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80134712>{__wake_up_common+67} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014860f>{worker_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: scsi_eh_0     S 0000000000000000     0   482      1           483   241 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 00000100dfe9ddf8 0000000000000046 00000100010467e0 0000000000000003 
>May 21 16:16:09 grant-01 kernel:        00000100dfd977f0 0000000000000012 0000000000000012 0000000380132ffe 
>May 21 16:16:09 grant-01 kernel:        0000010037ce47f0 00000000002e4668 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8031705b>{__down_interruptible+203} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80318a7b>{__down_failed_interruptible+53} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8011f5fc>{flat_send_IPI_mask+0} <ffffffffa0006a20>{:scsi_mod:.text.lock.scsi_error+45} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffffa0005bc6>{:scsi_mod:scsi_error_handler+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: scsi_eh_1     S 0000010037d3df00     0   483      1           484   482 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 0000010037d3ddf8 0000000000000046 00000100010467e0 0000000000000076 
>May 21 16:16:09 grant-01 kernel:        00000100dfd977f0 0000000000000002 0000010001047b00 0000000280132ffe 
>May 21 16:16:09 grant-01 kernel:        00000100dfeac030 0000000000d09d57 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8031705b>{__down_interruptible+203} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80318a7b>{__down_failed_interruptible+53} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa0006a20>{:scsi_mod:.text.lock.scsi_error+45} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffffa0005bc6>{:scsi_mod:scsi_error_handler+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: scsi_eh_2     S 00000100dfe95f00     0   484      1           485   483 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 00000100dfe95df8 0000000000000046 00000100010467e0 0000000000000076 
>May 21 16:16:09 grant-01 kernel:        00000100dfd977f0 0000000000000002 0000010001047b00 0000000280132ffe 
>May 21 16:16:09 grant-01 kernel:        0000010037c9a7f0 0000000000d09f46 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8031705b>{__down_interruptible+203} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80318a7b>{__down_failed_interruptible+53} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa0006a20>{:scsi_mod:.text.lock.scsi_error+45} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffffa0005bc6>{:scsi_mod:scsi_error_handler+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: scsi_eh_3     S 00000100dfe97f00     0   485      1           532   484 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 00000100dfe97df8 0000000000000046 00000100010467e0 0000000000000076 
>May 21 16:16:09 grant-01 kernel:        00000100dfd977f0 0000000000000002 0000010001047b00 0000000280132ffe 
>May 21 16:16:09 grant-01 kernel:        0000010037c9a030 0000000000d09c4f 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8031705b>{__down_interruptible+203} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80318a7b>{__down_failed_interruptible+53} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa0006a20>{:scsi_mod:.text.lock.scsi_error+45} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffffa0005bc6>{:scsi_mod:scsi_error_handler+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: kjournald     S 0000000000000000     0   532      1          1694   485 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021adffe78 0000000000000046 ffffffff803e7d80 0000010200000076 
>May 21 16:16:09 grant-01 kernel:        0000010218db73a0 0000000018db73a0 000001000103fb00 0000000018db73a0 
>May 21 16:16:09 grant-01 kernel:        00000100dfd977f0 00000000000002ba 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffffa006ab54>{:jbd:kjournald+506} <ffffffff80136084>{autoremove_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80136084>{autoremove_wake_function+0} <ffffffffa006a954>{:jbd:commit_timeout+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffffa006a95a>{:jbd:kjournald+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: kauditd       S 000001021a461ee8     0  1028     13          1981   476 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021a461ea8 0000000000000046 0000000231e74e46 0000010000000076 
>May 21 16:16:09 grant-01 kernel:        00000101200667e0 0000000000000003 0000010120067b00 0000000300000000 
>May 21 16:16:09 grant-01 kernel:        000001011b4617f0 0000000000000697 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8014c534>{keventd_create_kthread+0} <ffffffff80155ac4>{kauditd_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80155c43>{kauditd_thread+383} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c50b>{kthread+200} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffff8014c534>{keventd_create_kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c443>{kthread+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: scsi_eh_4     S 000001021a2c1f00     0  1694      1          1697   532 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021a2c1df8 0000000000000046 000001021a0a8000 0000010100000077 
>May 21 16:16:09 grant-01 kernel:        000000000000002f 0000000000000006 0000010120067b00 00000003803f7c60 
>May 21 16:16:09 grant-01 kernel:        000001011b1397f0 00000000000026bc 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80132ad3>{activate_task+124} <ffffffff8031705b>{__down_interruptible+203} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80318a7b>{__down_failed_interruptible+53} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa0006a20>{:scsi_mod:.text.lock.scsi_error+45} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffffa0005bc6>{:scsi_mod:scsi_error_handler+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: udevd         S 0000000000000006     0  1697      1          1727  1694 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001011b64dd58 0000000000000002 ffffffff803e7d80 0000000000000246 
>May 21 16:16:09 grant-01 kernel:        000000d200000046 0000000000000246 0000000000000256 0000000020000780 
>May 21 16:16:09 grant-01 kernel:        0000010037dc8030 00000000000082a1 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80318738>{schedule_timeout+257} <ffffffff802ba0c3>{datagram_poll+39} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e517>{do_select+939} <ffffffff8018e0b1>{__pollwait+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e896>{sys_select+820} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: qla2400_4_dpc S 000001021a0a8000     0  1727      1          1769  1697 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021a4dde58 0000000000000046 000001021a0aa625 00000001a00e5c20 
>May 21 16:16:09 grant-01 kernel:        0000000400000000 ffffffff00000000 00000000040000a0 0000000300834000 
>May 21 16:16:09 grant-01 kernel:        000001011b139030 0000000000000f68 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffffa00c41a3>{:qla2xxx:__qla2x00_marker+518} <ffffffff8031705b>{__down_interruptible+203} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80318a7b>{__down_failed_interruptible+53} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa00b9d9d>{:qla2xxx:.text.lock.qla_os+15} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa00b9244>{:qla2xxx:qla2x00_do_dpc+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: scsi_eh_5     S 0000010219ccbf00     0  1769      1          1903  1727 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 0000010219ccbdf8 0000000000000046 0000010219d18000 0000010200000077 
>May 21 16:16:09 grant-01 kernel:        0000000000000040 0000000000000006 000001012005fb00 00000001803f7c60 
>May 21 16:16:09 grant-01 kernel:        000001021c21f030 0000000000002d75 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80132ad3>{activate_task+124} <ffffffff8031705b>{__down_interruptible+203} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff80318a7b>{__down_failed_interruptible+53} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa0006a20>{:scsi_mod:.text.lock.scsi_error+45} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffffa0005bc6>{:scsi_mod:scsi_error_handler+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: qla2400_5_dpc S 0000010219d18000     0  1903      1          2323  1769 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001021ab6de58 0000000000000046 0000010120008030 0000000000000076 
>May 21 16:16:09 grant-01 kernel:        000000000000001d 0000000000000006 000001012005fb00 00000001803f7c60 
>May 21 16:16:09 grant-01 kernel:        000001021a7467f0 0000000000000627 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8031705b>{__down_interruptible+203} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80318a7b>{__down_failed_interruptible+53} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa00b9d9d>{:qla2xxx:.text.lock.qla_os+15} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa00b9244>{:qla2xxx:qla2x00_do_dpc+0} <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: kedac         S ffffffff8014c534     0  1981     13                1028 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 0000010120f73e88 0000000000000046 0000000000000000 0000000000000016 
>May 21 16:16:09 grant-01 kernel:        0000000000000016 ffffffff802b2065 000000000000004c 000000031c0e6e00 
>May 21 16:16:09 grant-01 kernel:        0000010120e8a7f0 0000000000000078 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff802b2065>{pci_conf1_read+197} <ffffffff801409dc>{__mod_timer+293} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff803187c3>{schedule_timeout+396} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80141406>{process_timeout+0} <ffffffffa013fd43>{:edac_mc:edac_kernel_thread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffffa013fd68>{:edac_mc:edac_kernel_thread+37} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c50b>{kthread+200} <ffffffff80110f93>{child_rip+8} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014c534>{keventd_create_kthread+0} <ffffffff8014c443>{kthread+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: kjournald     S 000001021c7c5a24     0  2323      1          2409  1903 (L-TLB)
>May 21 16:16:09 grant-01 kernel: 0000010219aa1e78 0000000000000046 0000010219aa1dc8 0000010200000076 
>May 21 16:16:09 grant-01 kernel:        000001021c7c5a98 0000000000000005 0000010120067b00 00000003000003e8 
>May 21 16:16:09 grant-01 kernel:        000001021c245030 0000000000002bb4 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffffa006ab54>{:jbd:kjournald+506} <ffffffff80136084>{autoremove_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80136084>{autoremove_wake_function+0} <ffffffffa006a954>{:jbd:commit_timeout+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f93>{child_rip+8} <ffffffffa006a95a>{:jbd:kjournald+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80110f8b>{child_rip+0} 
>May 21 16:16:09 grant-01 kernel: rc            S 0000007fbffff394     0  2409      1  3110    2883  2323 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001021a809eb8 0000000000000006 0000000000000000 000001021af4c010 
>May 21 16:16:09 grant-01 kernel:        0000000100000000 0000000000000000 ffffffff80149200 0000000000000000 
>May 21 16:16:09 grant-01 kernel:        0000010120e96030 0000000000011006 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80149200>{attach_pid+31} <ffffffff801ef23d>{__up_read+16} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80124889>{do_page_fault+577} <ffffffff8013c639>{do_wait+3413} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff801451f3>{sys_rt_sigaction+133} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: dhclient      S 0000000000000007     0  2883      1          2925  2409 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001011bb23d58 0000000000000002 ffffffff803e7d80 0000000000000073 
>May 21 16:16:09 grant-01 kernel:        00000000483483e5 000000002ea928f0 000000d00103fb00 0000000000000246 
>May 21 16:16:09 grant-01 kernel:        0000010120e8a030 0000000000006773 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff801409dc>{__mod_timer+293} <ffffffff803187c3>{schedule_timeout+396} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80141406>{process_timeout+0} <ffffffff8018e517>{do_select+939} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e0b1>{__pollwait+0} <ffffffff8018e896>{sys_select+820} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel: syslogd       S 0000000000000001     0  2925      1          2929  2883 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 00000102192fbd58 0000000000000002 0000010037e59030 00000000000003fe 
>May 21 16:16:09 grant-01 kernel:        00000102192fbef8 0000000000000246 0000000000000000 00000003802b3e6c 
>May 21 16:16:09 grant-01 kernel:        0000010037d367f0 000000000000031f 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80318738>{schedule_timeout+257} <ffffffff802ba0c3>{datagram_poll+39} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e517>{do_select+939} <ffffffff8018e0b1>{__pollwait+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e896>{sys_select+820} <ffffffff80144eb7>{do_sigaction+553} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel: klogd         R  running task       0  2929      1          2942  2925 (NOTLB)
>May 21 16:16:09 grant-01 kernel: irqbalance    S 0000000000000000     0  2942      1          2953  2929 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001021925bec8 0000000000000002 0000000000000001 0000000000000000 
>May 21 16:16:09 grant-01 kernel:        000001021fe19280 ffffffff8016a348 0000000000001000 000000039556d000 
>May 21 16:16:09 grant-01 kernel:        0000010037ca77f0 0000000000009609 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8016a348>{unmap_vmas+1345} <ffffffff801409dc>{__mod_timer+293} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff803187c3>{schedule_timeout+396} <ffffffff80141406>{process_timeout+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80141549>{sys_nanosleep+192} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: portmap       S 0000010120cc0ac0     0  2953      1          2972  2942 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 0000010218d99e68 0000000000000006 0000000000000000 ffffffff00000076 
>May 21 16:16:09 grant-01 kernel:        0000000000000000 00000000802b3803 0000010120067b00 0000000300000246 
>May 21 16:16:09 grant-01 kernel:        0000010120e93030 0000000000003275 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80318738>{schedule_timeout+257} <ffffffff80135ebc>{add_wait_queue+18} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff802dd553>{tcp_poll+44} <ffffffff8018ec3b>{sys_poll+588} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e0b1>{__pollwait+0} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: rpc.statd     S 0000000000000009     0  2972      1          3003  2953 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 0000010218e3dd58 0000000000000002 0000000000000246 ffffffffa00859bf 
>May 21 16:16:09 grant-01 kernel:        00000000000000d0 0000010218d6f00c 000000d00000003b 0000000300000246 
>May 21 16:16:09 grant-01 kernel:        00000100012177f0 0000000000003943 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffffa00859bf>{:ext3:ext3fs_dirhash+873} <ffffffff80318738>{schedule_timeout+257} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff802dd553>{tcp_poll+44} <ffffffff8018e517>{do_select+939} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e0b1>{__pollwait+0} <ffffffff8018e896>{sys_select+820} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80191e56>{dput+189} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: rpc.idmapd    S 0000000000000000     0  3003      1          3019  2972 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 0000010218935e58 0000000000000002 0000010037e59030 0000000200000076 
>May 21 16:16:09 grant-01 kernel:        0000000000106025 0000000000000000 0000010120067b00 000000031b4d4030 
>May 21 16:16:09 grant-01 kernel:        000001011b4d4030 0000000000000320 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff801884bb>{permission+96} <ffffffff801409dc>{__mod_timer+293} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff803187c3>{schedule_timeout+396} <ffffffff80141406>{process_timeout+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801a101d>{sys_epoll_wait+393} <ffffffff80141d4a>{recalc_sigpending+15} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: ccsd          S 0000000000000008     0  3019      1          3020  3003 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 0000010218a85d58 0000000000000006 ffffffff803e7d80 0000010218a85e88 
>May 21 16:16:09 grant-01 kernel:        0000010218a85d58 0000000000000246 0000000000000451 00000000802b3ce7 
>May 21 16:16:09 grant-01 kernel:        000001000130b030 0000000000000653 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80318738>{schedule_timeout+257} <ffffffff8018e517>{do_select+939} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e0b1>{__pollwait+0} <ffffffff8018e896>{sys_select+820} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel: ccsd          S 000000000000000b     0  3020      1          3085  3019 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 0000010218aa7d58 0000000000000006 0000010218aa7cb4 0000010218aa7e88 
>May 21 16:16:09 grant-01 kernel:        0000010218aa7d58 0000000000000246 000001021b977040 00000000802b3e6c 
>May 21 16:16:09 grant-01 kernel:        000001021a467030 0000000000001df4 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80318738>{schedule_timeout+257} <ffffffff802dd553>{tcp_poll+44} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e517>{do_select+939} <ffffffff8018e0b1>{__pollwait+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e896>{sys_select+820} <ffffffff80191dd1>{dput+56} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel: lock_gulmd    S 0000000000000003     0  3085      1          3086  3020 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 00000102182e3e68 0000000000000002 ffffffff803e7d80 000001010000006a 
>May 21 16:16:09 grant-01 kernel:        0000000000000000 0000000000000246 000001000103fb00 0000000000000000 
>May 21 16:16:09 grant-01 kernel:        000001011b07c7f0 0000000000000327 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff801409dc>{__mod_timer+293} <ffffffff803187c3>{schedule_timeout+396} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80141406>{process_timeout+0} <ffffffff8018ec3b>{sys_poll+588} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e0b1>{__pollwait+0} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: lock_gulmd    S 0000000000000001     0  3086      1          3088  3085 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 0000010217545d78 0000000000000002 0000000000000000 0000000000000000 
>May 21 16:16:09 grant-01 kernel:        0000000000000000 0000000000000000 0000000000000000 0000000300000000 
>May 21 16:16:09 grant-01 kernel:        0000010120ff1030 00000000000028eb 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80318738>{schedule_timeout+257} <ffffffff8016e426>{find_extend_vma+22} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80135ebc>{add_wait_queue+18} <ffffffff8014db1b>{do_futex+531} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014df71>{sys_futex+203} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel: lock_gulmd    S 00000000000003e9     0  3088      1          3089  3086 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001011b0cbe68 0000000000000002 ffffffff803e7d80 0000010000000073 
>May 21 16:16:09 grant-01 kernel:        0000000000000000 0000000000000246 000001000103fb00 0000000000560de1 
>May 21 16:16:09 grant-01 kernel:        0000010037ca7030 0000000000000289 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff801409dc>{__mod_timer+293} <ffffffff803187c3>{schedule_timeout+396} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80141406>{process_timeout+0} <ffffffff8018ec3b>{sys_poll+588} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e0b1>{__pollwait+0} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: lock_gulmd    S 0000000000000001     0  3089      1          3092  3088 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001011baf7d78 0000000000000002 0000000000000256 000001000000006d 
>May 21 16:16:09 grant-01 kernel:        000000000000002e 000000008015be1c 000001000103fb00 0000000000000000 
>May 21 16:16:09 grant-01 kernel:        000001011b07c030 0000000000003a08 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80318738>{schedule_timeout+257} <ffffffff8016e426>{find_extend_vma+22} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80135ebc>{add_wait_queue+18} <ffffffff8014db1b>{do_futex+531} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014df71>{sys_futex+203} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel: lock_gulmd    S 00000000000003e9     0  3092      1          3093  3089 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001021a985e68 0000000000000006 ffffffff803e7d80 0000010200000073 
>May 21 16:16:09 grant-01 kernel:        0000000000000000 0000000000000246 000001000103fb00 000000001a9604c0 
>May 21 16:16:09 grant-01 kernel:        0000010218a83030 0000000000000327 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff801409dc>{__mod_timer+293} <ffffffff803187c3>{schedule_timeout+396} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80141406>{process_timeout+0} <ffffffff8018ec3b>{sys_poll+588} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8018e0b1>{__pollwait+0} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: lock_gulmd    S 0000000000000001     0  3093      1          3116  3092 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 0000010219311d78 0000000000000006 0000000000000256 0000010100000074 
>May 21 16:16:09 grant-01 kernel:        000000000000002e ffffffff8015be1c 0000000000000075 0000000300000000 
>May 21 16:16:09 grant-01 kernel:        000001021a869030 000000000000502e 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8015be1c>{find_get_page+65} <ffffffff80318738>{schedule_timeout+257} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8016e426>{find_extend_vma+22} <ffffffff80135ebc>{add_wait_queue+18} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014db1b>{do_futex+531} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014df71>{sys_futex+203} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: S24clvmd      S 0000007fbfffe744     0  3110   2409  3121               (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001011b657eb8 0000000000000006 0000000000000000 0000010218ec8010 
>May 21 16:16:09 grant-01 kernel:        0000000100000000 0000000000000000 ffffffff80149200 0000000300000000 
>May 21 16:16:09 grant-01 kernel:        000001021c79e7f0 0000000000010cf3 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80149200>{attach_pid+31} <ffffffff801ef23d>{__up_read+16} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80124889>{do_page_fault+577} <ffffffff8013c639>{do_wait+3413} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff801451f3>{sys_rt_sigaction+133} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: clvmd         S 0000000000000002     0  3116      1          3119  3093 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001011b545d78 0000000000000002 000001011b545d88 ffffffff80317cdc 
>May 21 16:16:09 grant-01 kernel:        ffffffff803e7d80 0000000000000000 000000000000001c 000000001b586880 
>May 21 16:16:09 grant-01 kernel:        000001021a746030 0000000000002844 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80317cdc>{thread_return+88} <ffffffff802b4012>{sock_aio_read+297} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80318738>{schedule_timeout+257} <ffffffff8016e426>{find_extend_vma+22} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80135ebc>{add_wait_queue+18} <ffffffff8014db1b>{do_futex+531} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff802ebf58>{tcp_clear_xmit_timers+62} <ffffffff801346c1>{default_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8014df71>{sys_futex+203} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: clvmd         S 0000000000000001     0  3119      1  3122          3116 (NOTLB)
>May 21 16:16:09 grant-01 kernel: 000001011b589d78 0000000000000002 000000d20000003a 0000000000000076 
>May 21 16:16:09 grant-01 kernel:        0000000000000256 0000000000012780 000001000103fb00 00000000000000d2 
>May 21 16:16:09 grant-01 kernel:        00000100012d7030 0000000000014600 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff80318738>{schedule_timeout+257} <ffffffff8016e426>{find_extend_vma+22} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80135ebc>{add_wait_queue+18} <ffffffff8014db1b>{do_futex+531} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801346c1>{default_wake_function+0} <ffffffff8014df71>{sys_futex+203} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel: vgscan        S 0000010218ecbd48     0  3121   3110                     (NOTLB)
>May 21 16:16:09 grant-01 kernel: 0000010218ecbbb8 0000000000000002 0000010037e597f0 0000010001331b50 
>May 21 16:16:09 grant-01 kernel:        0000010001331a98 000001021c5537c8 0000010218ecbbe8 0000000201331a98 
>May 21 16:16:09 grant-01 kernel:        00000100dfd97030 0000000000000af1 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff801887bb>{do_lookup+44} <ffffffff80318738>{schedule_timeout+257} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff802b7a0f>{alloc_skb+92} <ffffffff80135f80>{prepare_to_wait+21} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80313830>{unix_stream_recvmsg+622} <ffffffff80136084>{autoremove_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff802b7784>{skb_queue_tail+23} <ffffffff80136084>{autoremove_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff802b4012>{sock_aio_read+297} <ffffffff802b4158>{sock_aio_write+306} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8017b969>{do_sync_read+178} <ffffffff802b7a0f>{alloc_skb+92} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801ef23d>{__up_read+16} <ffffffff80136084>{autoremove_wake_function+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8019688d>{dnotify_parent+34} <ffffffff8017ba77>{vfs_read+226} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8017bcc0>{sys_read+69} <ffffffff801102b6>{system_call+126} 
>May 21 16:16:09 grant-01 kernel:        
>May 21 16:16:09 grant-01 kernel: lvm           X 000001011b5f7f18     0  3122   3119                     (L-TLB)
>May 21 16:16:09 grant-01 kernel: 000001011b5f7ef8 0000000000000046 000001021a42e880 000001021a8027f0 
>May 21 16:16:09 grant-01 kernel:        0000000000000056 ffffffff8014388d 0000000000000011 0000000000040001 
>May 21 16:16:09 grant-01 kernel:        000001021a8027f0 0000000000155701 
>May 21 16:16:09 grant-01 kernel: Call Trace:<ffffffff8014388d>{do_notify_parent+382} <ffffffff8017b39d>{filp_close+103} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff80317def>{__cond_resched+23} <ffffffff8013b530>{do_exit+3319} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff8017bc6f>{vfs_write+248} <ffffffff8013b640>{sys_exit_group+0} 
>May 21 16:16:09 grant-01 kernel:        <ffffffff801102b6>{system_call+126}

Actions: View

Attachments on bug 447799: 306317 | 308383 | 308384