Attachment 304116 Details for Bug 252209 – kernel dump from taft-04 during the hung mnt attempt

kernel dump from taft-04 during the hung mnt attempt

taft-04.log (text/plain), 86.73 KB, created by Corey Marthaler on 2008-04-29 13:57:43 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Corey Marthaler

Created: 2008-04-29 13:57:43 UTC

Size: 86.73 KB

patch

obsolete

>Apr 29 08:46:27 taft-04 kernel: SysRq : Show State
>Apr 29 08:46:27 taft-04 kernel: 
>Apr 29 08:46:27 taft-04 kernel:                                                        sibling
>Apr 29 08:46:27 taft-04 kernel:   task                 PC          pid father child younger older
>Apr 29 08:46:27 taft-04 kernel: init          S 000000000000000b     0     1      0     2               (NOTLB)
>Apr 29 08:46:27 taft-04 kernel: 00000101fffa1d58 0000000000000006 0000010037e29200 0000010037e29200 
>Apr 29 08:46:27 taft-04 kernel:        0000000000000000 0000000000000246 00000101fffa1e58 00000003801912f5 
>Apr 29 08:46:27 taft-04 kernel:        00000100069387f0 0000000000000b11 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:27 taft-04 kernel: migration/0   S 0000010001070760     0     2      1             3       (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000101fff09ec8 0000000000000046 0000010001070760 0000001900000073 
>Apr 29 08:46:27 taft-04 kernel:        000001020e2a0030 0000000000000073 00000100010619c0 0000000000000001 
>Apr 29 08:46:27 taft-04 kernel:        000001000693c7f0 000000000000015c 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffff801357f9>{migration_thread+323} <ffffffff801356b6>{migration_thread+0} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: ksoftirqd/0   S 0000000000000000     0     3      1             4     2 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000101fff0df08 0000000000000046 000001020e809030 ffffffffa000739d 
>Apr 29 08:46:27 taft-04 kernel:        000001021787f734 0000010217881bc0 00001000fff94800 0000000000002002 
>Apr 29 08:46:27 taft-04 kernel:        000001000693c030 00000000000001e8 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffffa000739d>{:scsi_mod:scsi_io_completion+497} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8013d550>{ksoftirqd+0} <ffffffff8013d58c>{ksoftirqd+60} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: migration/1   S 0000010001060760     0     4      1             5     3 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000101fff0fec8 0000000000000046 0000010001060760 0000001900000074 
>Apr 29 08:46:27 taft-04 kernel:        00000101fffbc030 0000000000000074 00000100010699c0 0000000100000001 
>Apr 29 08:46:27 taft-04 kernel:        000001000693d7f0 0000000000000194 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffff801357f9>{migration_thread+323} <ffffffff801356b6>{migration_thread+0} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: ksoftirqd/1   S 0000000000000000     0     5      1             6     4 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000101fff51f08 0000000000000046 000001020d658030 0000001900000077 
>Apr 29 08:46:27 taft-04 kernel:        0000010208acf030 0000000000000077 00000100010699c0 0000000100000000 
>Apr 29 08:46:27 taft-04 kernel:        000001000693d030 00000000000003b6 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffff8013d550>{ksoftirqd+0} <ffffffff8013d58c>{ksoftirqd+60} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: migration/2   S 0000010001078760     0     6      1             7     5 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000101fff55ec8 0000000000000046 0000010001078760 0000001900000073 
>Apr 29 08:46:27 taft-04 kernel:        000001020e2a0030 0000000000000073 00000100010719c0 0000000200000001 
>Apr 29 08:46:27 taft-04 kernel:        00000101fff247f0 0000000000000195 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffff801357f9>{migration_thread+323} <ffffffff801356b6>{migration_thread+0} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: ksoftirqd/2   S 0000000000000000     0     7      1             8     6 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000100dff07f08 0000000000000046 000001020d7a27f0 0000001900000086 
>Apr 29 08:46:27 taft-04 kernel:        00000101fff24030 0000000000000086 00000100010719c0 0000000200000000 
>Apr 29 08:46:27 taft-04 kernel:        00000101fff24030 00000000000001df 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffff8013d550>{ksoftirqd+0} <ffffffff8013d58c>{ksoftirqd+60} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: migration/3   S 0000010001060760     0     8      1             9     7 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000100dff09ec8 0000000000000046 0000010001060760 0000001900000074 
>Apr 29 08:46:27 taft-04 kernel:        0000010006ad4030 0000000000000074 00000100010799c0 0000000300000001 
>Apr 29 08:46:27 taft-04 kernel:        00000101fff607f0 00000000000001ef 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffff801357f9>{migration_thread+323} <ffffffff801356b6>{migration_thread+0} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: ksoftirqd/3   S 0000000000000000     0     9      1            10     8 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000100dff4df08 0000000000000046 000001020d658030 ffffffffa000739d 
>Apr 29 08:46:27 taft-04 kernel:        000001021787f734 0000010217881bc0 00002000fff94800 0000000300002002 
>Apr 29 08:46:27 taft-04 kernel:        00000101fff60030 0000000000000217 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffffa000739d>{:scsi_mod:scsi_io_completion+497} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8013d550>{ksoftirqd+0} <ffffffff8013d58c>{ksoftirqd+60} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: events/0      S 0000010001070760     0    10      1    14      11     9 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000101ffca3e68 0000000000000046 00000101ffca3da8 0000001900000069 
>Apr 29 08:46:27 taft-04 kernel:        0000010216449030 0000000000000069 00000100010619c0 0000000000000246 
>Apr 29 08:46:27 taft-04 kernel:        00000101ffc807f0 0000000000001f25 
>Apr 29 08:46:27 taft-04 kernel: Call Trace:<ffffffff801643fa>{cache_reap+0} <ffffffff801481c5>{worker_thread+226} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff801346b6>{__wake_up_common+67} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:27 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:27 taft-04 kernel:        
>Apr 29 08:46:27 taft-04 kernel: events/1      S ffffffff801643fa     0    11      1            12    10 (L-TLB)
>Apr 29 08:46:27 taft-04 kernel: 00000101ffca5e68 0000000000000046 0000010006938030 000001000106be40 
>Apr 29 08:46:27 taft-04 kernel:        0000000000000005 0000000000000246 0000000101c46df2 0000000100000246 
>Apr 29 08:46:27 taft-04 kernel:        00000101ffc80030 000000000000123b 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff801643fa>{cache_reap+0} <ffffffff801481c5>{worker_thread+226} 
>Apr 29 08:46:34 taft-04 lock_gulmd_core[3812]: "Magma::27707" is logged out. fd:12 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff801346b6>{__wake_up_common+67} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 lock_gulmd_core[3812]: "Magma::27709" is logged out. fd:12 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: events/2      R  running task       0    12      1   544      13    11 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: events/3      S ffffffffa01369fa     0    13      1  1087      67    12 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 00000101ffcabe68 0000000000000046 00000000182a7c00 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        0000010217966758 ffffffffa0139c8c 0000000000000005 0000000300000246 
>Apr 29 08:46:34 taft-04 kernel:        00000101ffc81030 000000000000258a 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffffa0139c8c>{:e1000:e1000_read_phy_reg+517} <ffffffffa01369fa>{:e1000:e1000_watchdog_task+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfab>{kthread+200} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: khelper       S 000001020d4c5828     0    14     10            15       (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 00000101ffcbde68 0000000000000046 ffffffff80147ba5 000000190000006a 
>Apr 29 08:46:34 taft-04 kernel:        000001020d6587f0 000000000000006a 00000100010719c0 00000002dff546c0 
>Apr 29 08:46:34 taft-04 kernel:        00000101ffc837f0 0000000000000973 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80147ba5>{__call_usermodehelper+0} <ffffffff80147ba5>{__call_usermodehelper+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bfab>{kthread+200} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: kacpid        S 00000100dff54040     0    15     10            63    14 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 00000100dfde1e68 0000000000000046 0000000100000000 000001000000007d 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000000 000000001b9f8d28 ffffffff80471a00 0000000000000002 
>Apr 29 08:46:34 taft-04 kernel:        00000101ffc83030 00000000000015a6 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bfab>{kthread+200} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: kblockd/0     S 0000010001070760     0    63     10            64    15 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037c3be68 0000000000000046 676e696e6e616373 000000190000006a 
>Apr 29 08:46:34 taft-04 kernel:        0000010216449030 000000000000006a 00000100010619c0 0000000017881bc0 
>Apr 29 08:46:34 taft-04 kernel:        00000100dfdc6030 00000000000003d2 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80252b4f>{blk_unplug_work+0} <ffffffff801481c5>{worker_thread+226} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff801346b6>{__wake_up_common+67} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: kblockd/1     S 0000010217881da0     0    64     10            65    63 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037c5de68 0000000000000046 676e696e6e616373 0000001900000074 
>Apr 29 08:46:34 taft-04 kernel:        0000010216680030 0000000000000074 00000100010699c0 0000000117881bc0 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c157f0 000000000000447d 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80252b4f>{blk_unplug_work+0} <ffffffff801481c5>{worker_thread+226} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff801346b6>{__wake_up_common+67} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: kblockd/2     S 0000010217881da0     0    65     10            66    64 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037c5fe68 0000000000000046 676e696e6e616373 0000001900000074 
>Apr 29 08:46:34 taft-04 kernel:        0000010216680030 0000000000000074 00000100010719c0 0000000217881bc0 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c15030 0000000000000886 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80252b4f>{blk_unplug_work+0} <ffffffff801481c5>{worker_thread+226} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff801346b6>{__wake_up_common+67} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: kblockd/3     S 0000010217881da0     0    66     10            94    65 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037c61e68 0000000000000046 676e696e6e616373 0000001900000074 
>Apr 29 08:46:34 taft-04 kernel:        0000010216680030 0000000000000074 00000100010799c0 0000000317881bc0 
>Apr 29 08:46:34 taft-04 kernel:        00000100dfdf67f0 0000000000000656 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80252b4f>{blk_unplug_work+0} <ffffffff801481c5>{worker_thread+226} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff801346b6>{__wake_up_common+67} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: khubd         S 00000101fff6c400     0    67      1            96    13 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037c85e78 0000000000000046 0000010006938030 ffffffff8029439e 
>Apr 29 08:46:34 taft-04 kernel:        0000000300000000 ffffffff80417170 0000000000000000 0000000100000001 
>Apr 29 08:46:34 taft-04 kernel:        00000100dfdf6030 0000000000000d87 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8029439e>{fs_create_file+325} <ffffffff8028be6d>{hub_thread+2579} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8028b45a>{hub_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: pdflush       S ffffffff8014bfd4     0    94     10            95    66 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037c87ec8 0000000000000046 0000010037c577f0 000000000000006a 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c577f0 00000000010610a0 ffffffff80471a00 0000000001060760 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c577f0 00000000000004ef 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80134936>{set_user_nice+259} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801612ec>{pdflush+191} <ffffffff8016122d>{pdflush+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: pdflush       R  running task       0    95     10            97    94 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: aio/0         S 0000010037c38900     0    97     10            98    95 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037ccde68 0000000000000046 0000000000000000 000000000000006b 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000000 0000000000000008 ffffffff80471a00 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c7b030 00000000000006fd 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bfab>{kthread+200} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: kswapd0       S 0000010037cabf08     0    96      1           244    67 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037cabeb8 0000000000000046 0000010037cabe08 000000000000007d 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000000 0000000000000000 ffffffff80471a00 0000000080134f92 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c7b7f0 0000000000000fba 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80167827>{kswapd+231} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80167740>{kswapd+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: aio/1         S 0000010037c38980     0    98     10            99    97 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037cd1e68 0000000000000046 0000000000000000 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000000 0000000000000008 000000000000231e 0000000100000000 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c9e7f0 0000000000000bbb 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bfab>{kthread+200} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: aio/2         S 0000010037c38a00     0    99     10           100    98 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037cd3e68 0000000000000046 0000000000000000 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000000 0000000000000008 000000000000231e 0000000200000000 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c9e030 0000000000000e1d 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bfab>{kthread+200} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: aio/3         S 0000010037c38a80     0   100     10           546    99 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037cd5e68 0000000000000046 0000000000000000 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000000 0000000000000008 000000000000231e 0000000300000000 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c9f7f0 0000000000000b8e 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bfab>{kthread+200} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: kseriod       S 0000000000000000     0   244      1           480    96 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010037d19ec8 0000000000000046 0000010037d19e18 0000010000000079 
>Apr 29 08:46:34 taft-04 kernel:        ffffffff80132abd 0000000000000000 ffffffff80471a00 00000000dfdddb18 
>Apr 29 08:46:34 taft-04 kernel:        00000100dfdc67f0 000000000000118d 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80132abd>{deactivate_task+21} <ffffffff8024552c>{serio_thread+469} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff8013b141>{do_exit+3225} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80245357>{serio_thread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: scsi_eh_0     S 0000010037c0a7c0     0   480      1           504   244 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 000001021786fdf8 0000000000000046 00000101fff94800 0000010006bfa412 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000018 0000000000000006 0000000000001b4e 00000003803ebfa0 
>Apr 29 08:46:34 taft-04 kernel:        0000010006bfa030 0000000000003585 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8030eb17>{__down_interruptible+203} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80310537>{__down_failed_interruptible+53} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffffa00069ac>{:scsi_mod:.text.lock.scsi_error+45} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8013b141>{do_exit+3225} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffffa0005b48>{:scsi_mod:scsi_error_handler+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: scsi_eh_1     S 0000000000574730     0   504      1           505   480 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010217877df8 0000000000000046 0000010006bb8000 0000010217994412 
>Apr 29 08:46:34 taft-04 kernel:        0000010217994030 0000000000000006 0000000000001b12 00000002803ebfa0 
>Apr 29 08:46:34 taft-04 kernel:        0000010217994030 000000000000117c 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8030eb17>{__down_interruptible+203} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80310537>{__down_failed_interruptible+53} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffffa00069ac>{:scsi_mod:.text.lock.scsi_error+45} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa0005b48>{:scsi_mod:scsi_error_handler+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: qla2300_1_dpc S 0000010006bb8000     0   505      1           591   504 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010217871e58 0000000000000046 0000010006bbc588 0000000106bb83c8 
>Apr 29 08:46:34 taft-04 kernel:        0000000500000000 0000010000000000 00000000040000a0 00000003a0072960 
>Apr 29 08:46:34 taft-04 kernel:        0000010006aa6030 0000000000002352 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffffa005148f>{:qla2xxx:__qla2x00_marker+518} <ffffffff8030eb17>{__down_interruptible+203} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff80310537>{__down_failed_interruptible+53} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffffa0047d08>{:qla2xxx:.text.lock.qla_os+15} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffffa00471af>{:qla2xxx:qla2x00_do_dpc+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: ata/0         S ffffffff8014bfd4     0   544     12           545       (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010217b03e68 0000000000000046 0000000000000000 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000000 0000000000000009 0000000000002706 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        0000010217995030 0000000000000e10 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: ata/1         S ffffffff8014bfd4     0   545     12           547   544 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010217b01e68 0000000000000046 0000000100000001 0000000000000002 
>Apr 29 08:46:34 taft-04 kernel:        0000010006a969d0 0000000000000009 0000000000002706 0000000100000100 
>Apr 29 08:46:34 taft-04 kernel:        00000102179947f0 0000000000001212 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: ata/2         S 0000010217845140     0   546     10           548   100 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010217afbe68 0000000000000046 0000010217afbe18 000000190000006a 
>Apr 29 08:46:34 taft-04 kernel:        00000101fffbc7f0 000000000000006a 00000100010719c0 0000000200000008 
>Apr 29 08:46:34 taft-04 kernel:        0000010006bfc030 0000000000000916 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: ata/3         S ffffffff8014bfd4     0   547     12                 545 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010217afde68 0000000000000046 0000000100000001 0000000000000002 
>Apr 29 08:46:34 taft-04 kernel:        0000010006a969d0 0000000000000009 0000000000002706 0000000300000100 
>Apr 29 08:46:34 taft-04 kernel:        00000101fffbc7f0 000000000000135a 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: ata_aux       S ffffffff8014bfd4     0   548     10                 546 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010217affe68 0000000000000046 0000000100000001 0000000000000002 
>Apr 29 08:46:34 taft-04 kernel:        0000010006a969d0 0000000000000009 0000000000002706 0000000000000001 
>Apr 29 08:46:34 taft-04 kernel:        0000010037c9f030 00000000000009a6 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff801480e3>{worker_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801481c5>{worker_thread+226} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801480e3>{worker_thread+0} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfab>{kthread+200} <ffffffff80110f47>{child_rip+8} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bee3>{kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: kjournald     S ffffffff8030ee14     0   591      1          2371   505 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010216dc1e78 0000000000000046 000001000693b030 0000001900000073 
>Apr 29 08:46:34 taft-04 kernel:        0000010216680030 0000000000000073 00000100010619c0 000000030e430be0 
>Apr 29 08:46:34 taft-04 kernel:        00000102179957f0 00000000000001f5 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffffa00d2b5c>{:jbd:kjournald+506} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffffa00d295c>{:jbd:commit_timeout+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa00d2962>{:jbd:kjournald+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: kauditd       S ffffffff8014bfd4     0  1087     13                     (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 000001021674dea8 0000000000000046 00000004073dfeea 00000101ffc81030 
>Apr 29 08:46:34 taft-04 kernel:        0000010001078760 0000000000000003 00000102178227f0 0000000300000000 
>Apr 29 08:46:34 taft-04 kernel:        00000102178227f0 0000000000000dcd 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8015527c>{kauditd_thread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801553fb>{kauditd_thread+383} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bfd4>{keventd_create_kthread+0} <ffffffff8014bfab>{kthread+200} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffff8014bfd4>{keventd_create_kthread+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014bee3>{kthread+0} <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: udevd         S 0000000000000006     0  2371      1          2970   591 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010215c2fd58 0000000000000006 ffffffff803dc080 0000000000000246 
>Apr 29 08:46:34 taft-04 kernel:        000000d200000000 0000000000000246 0000000000000246 0000000000012780 
>Apr 29 08:46:34 taft-04 kernel:        0000010006976030 000000000000bb37 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff802b1ed3>{datagram_poll+39} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018da3b>{do_select+939} <ffffffff8018d5d5>{__pollwait+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018ddba>{sys_select+820} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: kjournald     S 0000000000000000     0  2970      1          3553  2371 (L-TLB)
>Apr 29 08:46:34 taft-04 kernel: 00000102158efe78 0000000000000046 00000102158efdc8 00000102158bbaf8 
>Apr 29 08:46:34 taft-04 kernel:        00000101fff73a98 0000000000000005 0000000000000000 00000003000003e8 
>Apr 29 08:46:34 taft-04 kernel:        0000010216aed7f0 000000000000427a 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffffa00d2b5c>{:jbd:kjournald+506} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffffa00d295c>{:jbd:commit_timeout+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa00d2962>{:jbd:kjournald+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:34 taft-04 kernel: dhclient      S 0000000000000007     0  3553      1          3651  2970 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 00000102153e7d58 0000000000000002 ffffffff803dc080 00000102153e7e88 
>Apr 29 08:46:34 taft-04 kernel:        00000102153e7d58 0000000000000246 00000102156f5680 00000000802abce8 
>Apr 29 08:46:34 taft-04 kernel:        0000010216c8e7f0 0000000000004f89 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: syslogd       R  running task       0  3651      1          3655  3553 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: klogd         S ffffffff8030ee14     0  3655      1          3668  3651 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001021502dbc8 0000000000000006 000001000693b030 0000001900000075 
>Apr 29 08:46:34 taft-04 kernel:        0000010216680030 0000000000000075 000001021502db98 0000000380132a0d 
>Apr 29 08:46:34 taft-04 kernel:        00000102179807f0 000000000000058b 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80162dc6>{cache_alloc_refill+390} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80135f80>{prepare_to_wait_exclusive+21} <ffffffff80309e5d>{unix_wait_for_peer+163} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff8013470c>{__wake_up+54} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff8030a96f>{unix_dgram_sendmsg+957} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff802abfd4>{sock_aio_write+306} <ffffffff8017b1b7>{do_sync_write+178} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8013863e>{do_syslog+482} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80195dc1>{dnotify_parent+34} <ffffffff8017b2c5>{vfs_write+226} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8017b39a>{sys_write+69} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: irqbalance    S 0000000000000000     0  3668      1          3679  3655 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001021579fec8 0000000000000002 0000000000000001 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        000001021fac2920 ffffffff801699f0 0000000000001000 000000009556d000 
>Apr 29 08:46:34 taft-04 kernel:        0000010006ad47f0 000000000000f5d4 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff801699f0>{unmap_vmas+1345} <ffffffff8014057c>{__mod_timer+293} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8031027f>{schedule_timeout+396} <ffffffff80140fa6>{process_timeout+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801410e9>{sys_nanosleep+192} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: portmap       S 7fffffffffffffff     0  3679      1          3698  3668 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010214c55e68 0000000000000006 0000000000000000 ffffffff802ad51a 
>Apr 29 08:46:34 taft-04 kernel:        0000010214c54000 0000000000000246 0000010214c55e48 000000012abb4070 
>Apr 29 08:46:34 taft-04 kernel:        00000102165bd030 0000000000007e16 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff802ad51a>{sys_sendmsg+534} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80135e60>{add_wait_queue+18} <ffffffff802d5203>{tcp_poll+44} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018e15f>{sys_poll+588} <ffffffff8018d5d5>{__pollwait+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: rpc.statd     S 0000000000000009     0  3698      1          3729  3679 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010214cfbd58 0000000000000002 0000000000000246 ffffffffa00ec9bf 
>Apr 29 08:46:34 taft-04 kernel:        00000000000000d0 0000000000000246 000000000000003b 0000000137d293e0 
>Apr 29 08:46:34 taft-04 kernel:        0000010216c8e030 000000000000675f 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffffa00ec9bf>{:ext3:ext3fs_dirhash+873} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff802d5203>{tcp_poll+44} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8019137a>{dput+189} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: rpc.idmapd    S 0000000000000000     0  3729      1          3745  3698 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 00000102149afe58 0000000000000002 0000010006938030 0000001900000074 
>Apr 29 08:46:34 taft-04 kernel:        000001020dcbb7f0 0000000000000074 00000100010699c0 0000000106ac6030 
>Apr 29 08:46:34 taft-04 kernel:        0000010006ac6030 00000000000006a3 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff801a0513>{sys_epoll_wait+403} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801418ea>{recalc_sigpending+15} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: ccsd          S 0000000000000008     0  3745      1          3746  3729 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010214bb1d58 0000000000000006 0000010216f8a080 0000000000000014 
>Apr 29 08:46:34 taft-04 kernel:        0000010214bb1d90 0000000000000246 0000000000000246 00000001802aee03 
>Apr 29 08:46:34 taft-04 kernel:        000001021668d7f0 0000000000000dab 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801912f5>{dput+56} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: ccsd          S 000000000000000b     0  3746      1          3812  3745 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010214be3d58 0000000000000006 0000010214be3cb4 0000010214be3e88 
>Apr 29 08:46:34 taft-04 kernel:        0000010214be3d58 0000000000000246 000001020e00cc80 00000000802abce8 
>Apr 29 08:46:34 taft-04 kernel:        0000010006bfc7f0 0000000000008801 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff802d5203>{tcp_poll+44} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018da3b>{do_select+939} <ffffffff8018d5d5>{__pollwait+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018ddba>{sys_select+820} <ffffffff801912f5>{dput+56} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: lock_gulmd    S 0000000101c46b82     0  3812      1          3813  3746 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010215ab7e68 0000000000000006 000001020e2a0030 0000001900000072 
>Apr 29 08:46:34 taft-04 kernel:        000001020e2a0030 0000000000000072 00000100010619c0 00000000802e05f4 
>Apr 29 08:46:34 taft-04 kernel:        0000010216449030 0000000000000739 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018e15f>{sys_poll+588} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: lock_gulmd    S 0000000000000001     0  3813      1          3818  3812 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010213f2fd78 0000000000000006 0000000000000000 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000000 0000000000000000 0000000000000000 0000000300000000 
>Apr 29 08:46:34 taft-04 kernel:        00000102169727f0 000000000000282d 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff8016daba>{find_extend_vma+22} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80135e60>{add_wait_queue+18} <ffffffff8014d37f>{do_futex+531} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8014d7d5>{sys_futex+203} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: lock_gulmd    R  running task       0  3818      1          3819  3813 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: lock_gulmd    S 0000000000000001     0  3819      1          3885  3818 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010213fb1d78 0000000000000002 0000000000000000 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        000000000000002e ffffffff8015b5a0 0000000000000075 0000000000000000 
>Apr 29 08:46:34 taft-04 kernel:        00000102166807f0 0000000000002fe9 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8015b5a0>{find_get_page+65} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8016daba>{find_extend_vma+22} <ffffffff80135e60>{add_wait_queue+18} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014d37f>{do_futex+531} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014d7d5>{sys_futex+203} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: clvmd         S 000000000000000c     0  3885      1          3888  3819 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010213347d58 0000000000000002 000001000693b7f0 0000001900000074 
>Apr 29 08:46:34 taft-04 kernel:        0000010216680030 0000000000000074 00000100010719c0 0000000200000246 
>Apr 29 08:46:34 taft-04 kernel:        00000102165bd7f0 0000000000000b54 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: clvmd         S 0000000000000033     0  3888      1          4024  3885 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 00000102132d3d78 0000000000000002 ffffffff803dc080 0000000000000002 
>Apr 29 08:46:34 taft-04 kernel:        00000102132d3cf8 ffffffff80132a9b 0000000000000001 0000000001060760 
>Apr 29 08:46:34 taft-04 kernel:        00000100dfe627f0 00000000000022c1 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80132a9b>{activate_task+124} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8016daba>{find_extend_vma+22} <ffffffff80135e60>{add_wait_queue+18} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014d37f>{do_futex+531} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8014d7d5>{sys_futex+203} <ffffffff8017b3b5>{sys_write+96} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: acpid         S 0000000000000005     0  4024      1          4033  3888 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020ef59d58 0000000000000002 000000004816b200 000000003acd3f48 
>Apr 29 08:46:34 taft-04 kernel:        000000004816b200 000000003acd3f48 00000102133a2d18 0000000200000246 
>Apr 29 08:46:34 taft-04 kernel:        0000010216aab030 0000000000024528 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80195dc1>{dnotify_parent+34} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: cupsd         S 0000000000000004     0  4033      1          4069  4024 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 0000010212c49d58 0000000000000006 0000000048172663 0000000030668f00 
>Apr 29 08:46:34 taft-04 kernel:        0000000048172663 0000000000000246 000001020ef9e8d0 0000000200000000 
>Apr 29 08:46:34 taft-04 kernel:        000001021668d030 0000000000006617 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8019137a>{dput+189} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: sshd          S 0000000000000004     0  4069      1 27247    4082  4033 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020efcdd58 0000000000000002 0000010006bfa7f0 0000001000000246 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000046 0000000000000246 000000d216520380 0000000000000246 
>Apr 29 08:46:34 taft-04 kernel:        000001020e8097f0 0000000000004aee 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff802d5203>{tcp_poll+44} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018da3b>{do_select+939} <ffffffff8018d5d5>{__pollwait+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018ddba>{sys_select+820} <ffffffff801912f5>{dput+56} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: xinetd        S 0000000000000007     0  4082      1  5633    4100  4069 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020e691d58 0000000000000006 0000000000000048 000001020e691e88 
>Apr 29 08:46:34 taft-04 kernel:        000001020e691d58 0000000000000246 000000d200000048 0000000000000246 <4>warning: many lost ticks.
>Apr 29 08:46:34 taft-04 kernel: Your time source seems to be instable or some driver is hogging interupts
>Apr 29 08:46:34 taft-04 kernel: rip __do_softirq+0x4d/0xd0
>Apr 29 08:46:34 taft-04 kernel: Falling back to HPET
>Apr 29 08:46:34 taft-04 kernel: 
>Apr 29 08:46:34 taft-04 kernel:        000001020e9e3030 0000000000013228 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff802d5203>{tcp_poll+44} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018da3b>{do_select+939} <ffffffff8018d5d5>{__pollwait+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018ddba>{sys_select+820} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: sendmail      S 0000000000000005     0  4100      1          4109  4082 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020e577d58 0000000000000002 000001020e577d28 ffffffff801ade37 
>Apr 29 08:46:34 taft-04 kernel:        fffffffffffffff4 0000000000000246 0000000000000028 00000003085a5015 
>Apr 29 08:46:34 taft-04 kernel:        000001020e9c5030 0000000000001ecf 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff801ade37>{proc_root_lookup+49} <ffffffff8014057c>{__mod_timer+293} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8031027f>{schedule_timeout+396} <ffffffff80140fa6>{process_timeout+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018da3b>{do_select+939} <ffffffff8018d5d5>{__pollwait+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018ddba>{sys_select+820} <ffffffff801912f5>{dput+56} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: sendmail      S 0000000000000000     0  4109      1          4134  4100 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020e1adf68 0000000000000006 0000000101eaf858 0000000000000246 
>Apr 29 08:46:34 taft-04 kernel:        0000000000000246 ffffffff8014057c 0000000000000004 000000020036f0a4 
>Apr 29 08:46:34 taft-04 kernel:        000001020e58d7f0 000000000000c0a4 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8013c722>{do_setitimer+332} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80144e50>{sys_pause+23} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: gpm           S 0000000000000006     0  4134      1          4250  4109 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020dc2fd58 0000000000000006 0000000000000003 0000010001060760 
>Apr 29 08:46:34 taft-04 kernel:        0000010001060760 0000000000000002 00000001dfdd04a8 0000000000000246 
>Apr 29 08:46:34 taft-04 kernel:        000001020e3aa030 00000000000060da 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80195dc1>{dnotify_parent+34} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: crond         S 0000000000000000     0  4250      1          4268  4134 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020de13ec8 0000000000000002 00000000000000b2 0000010215b069e8 
>Apr 29 08:46:34 taft-04 kernel:        0000010215b069e8 ffffffff8019137a 000001020de13e58 000000020de13ef8 
>Apr 29 08:46:34 taft-04 kernel:        000001020e3aa7f0 0000000000001b9a 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8019137a>{dput+189} <ffffffff8014057c>{__mod_timer+293} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8031027f>{schedule_timeout+396} <ffffffff80140fa6>{process_timeout+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801410e9>{sys_nanosleep+192} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: xfs           S 0000000000000004     0  4268      1          4285  4250 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020dc25d58 0000000000000002 000001000693b030 000001020dc25e88 
>Apr 29 08:46:34 taft-04 kernel:        000001020dc25d58 0000000000000000 0000000000000066 0000000300000246 
>Apr 29 08:46:34 taft-04 kernel:        00000100069767f0 0000000000004ad8 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: atd           S 0000000000000000     0  4285      1          4294  4268 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020df75ec8 0000000000000002 0000010208bf0e50 0000000000000246 
>Apr 29 08:46:34 taft-04 kernel:        00000101fff5c800 0000000000000246 0000000014560d14 000000038018d3f4 
>Apr 29 08:46:34 taft-04 kernel:        000001020dd0f7f0 000000000000dede 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff801410e9>{sys_nanosleep+192} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: dbus-daemon-1 S 7fffffffffffffff     0  4294      1          4305  4285 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020d857e68 0000000000000002 0000010006938030 0000001900000074 
>Apr 29 08:46:34 taft-04 kernel:        000001020deb2030 0000000000000074 00000100010699c0 0000000100000246 
>Apr 29 08:46:34 taft-04 kernel:        000001020deb2030 00000000000000ab 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff8017bf4c>{fget+75} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018e15f>{sys_poll+588} <ffffffff8018d5d5>{__pollwait+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8017b851>{sys_writev+69} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: hald          R  running task       0  4305      1          4330  4294 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: modclusterd   R  running task       0  4330      1          4331  4305 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: modclusterd   R  running task       0  4331      1          4332  4330 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: modclusterd   S 0000000101c46c4a     0  4332      1          4346  4331 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020d513e68 0000000000000006 0000010216449030 0000001900000073 
>Apr 29 08:46:34 taft-04 kernel:        0000010216680030 0000000000000073 00000100010619c0 0000000006b9b6c0 
>Apr 29 08:46:34 taft-04 kernel:        000001020dd97030 0000000000000d97 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018e15f>{sys_poll+588} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: clurgmgrd     S 00000000fffffe00     0  4346      1  4347    4685  4332 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020d63deb8 0000000000000006 000001020d51a000 0000001900000077 
>Apr 29 08:46:34 taft-04 kernel:        000001020e768030 0000000000000077 00000100010699c0 0000000100000000 
>Apr 29 08:46:34 taft-04 kernel:        000001021661e7f0 00000000000184c3 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff801248fd>{do_page_fault+577} <ffffffff8013c1da>{do_wait+3299} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff80144d5d>{sys_rt_sigaction+133} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: clurgmgrd     S 0000000101c48219     0  4347   4346          4651       (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020d51bd58 0000000000000006 ffffffff80136028 0000001900000074 
>Apr 29 08:46:34 taft-04 kernel:        000001020dcbb030 0000000000000074 00000100010719c0 000000020e9e37f0 
>Apr 29 08:46:34 taft-04 kernel:        000001020e9e37f0 0000000000000eaf 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff80136028>{autoremove_wake_function+0} <ffffffff8014057c>{__mod_timer+293} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8031027f>{schedule_timeout+396} <ffffffff80140fa6>{process_timeout+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018da3b>{do_select+939} <ffffffff8018d5d5>{__pollwait+0} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff801332ab>{wake_up_new_task+694} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80137c8b>{do_fork+340} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel: clurgmgrd     R  running task       0  4651   4346                4347 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: oddjobd       S 0000000000000004     0  4685      1          4705  4346 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020d055d58 0000000000000002 000001000693b7f0 0000001900000076 
>Apr 29 08:46:34 taft-04 kernel:        000001020bd37030 0000000000000076 00000100010719c0 0000000200000246 
>Apr 29 08:46:34 taft-04 kernel:        000001020e6667f0 00000000001cff44 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:34 taft-04 kernel:        <ffffffff80195dc1>{dnotify_parent+34} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:34 taft-04 kernel:        
>Apr 29 08:46:34 taft-04 kernel: saslauthd     S 000001020da539d0     0  4705      1  4706    4720  4685 (NOTLB)
>Apr 29 08:46:34 taft-04 kernel: 000001020d0d7e78 0000000000000006 000001020d6ad888 000001020d7f47f0 
>Apr 29 08:46:34 taft-04 kernel:        0000000000511b90 00000102178a56c0 000001020ded7108 0000000300000246 
>Apr 29 08:46:34 taft-04 kernel:        000001020d7f47f0 0000000000006191 
>Apr 29 08:46:34 taft-04 kernel: Call Trace:<ffffffff8018f279>{__posix_lock_file+1147} <ffffffff80190592>{fcntl_setlk+473} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8018c84f>{sys_fcntl+736} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: saslauthd     S 0000000000000000     0  4706   4705          4707       (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d109d58 0000000000000002 0000002a95567b30 0000001900000078 
>Apr 29 08:46:35 taft-04 kernel:        000001020d7f47f0 0000000000000078 00000100010799c0 0000000300000246 
>Apr 29 08:46:35 taft-04 kernel:        000001020d7df030 0000000000012d04 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff80135f80>{prepare_to_wait_exclusive+21} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802b17a9>{skb_recv_datagram+373} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff8030a394>{unix_accept+99} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802acd1b>{sys_accept+201} <ffffffff80110d91>{error_exit+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel: saslauthd     S 0000010215a8a9c0     0  4707   4705          4708  4706 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d759e78 0000000000000002 000001020d110dd0 0000001900000078 
>Apr 29 08:46:35 taft-04 kernel:        000001020d7f47f0 0000000000000078 00000100010799c0 0000000300000246 
>Apr 29 08:46:35 taft-04 kernel:        000001020d663030 0000000000010c5a 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff8018f279>{__posix_lock_file+1147} <ffffffff80190592>{fcntl_setlk+473} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8018c84f>{sys_fcntl+736} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: saslauthd     S 0000010037c71f60     0  4708   4705          4709  4707 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d067e78 0000000000000002 000001020d123dd0 0000001900000078 
>Apr 29 08:46:35 taft-04 kernel:        000001020d7f47f0 0000000000000078 00000100010799c0 0000000300000246 
>Apr 29 08:46:35 taft-04 kernel:        000001020db20030 000000000000fc24 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff8018f279>{__posix_lock_file+1147} <ffffffff80190592>{fcntl_setlk+473} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8018c84f>{sys_fcntl+736} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: saslauthd     S 0000010037c719c0     0  4709   4705                4708 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d14be78 0000000000000002 000001020d656dd0 0000001900000078 
>Apr 29 08:46:35 taft-04 kernel:        000001020d7f47f0 0000000000000078 00000100010799c0 0000000300000246 
>Apr 29 08:46:35 taft-04 kernel:        00000102164497f0 0000000000013879 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff8018f279>{__posix_lock_file+1147} <ffffffff80190592>{fcntl_setlk+473} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8018c84f>{sys_fcntl+736} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: ricci         R  running task       0  4720      1          4725  4705 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: agetty        S 0000000000000001     0  4725      1          4726  4720 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 0000010216c41d68 0000000000000006 0000000000000246 ffffffff80230ccd 
>Apr 29 08:46:35 taft-04 kernel:        0000000000000000 0000010216381030 0000000000000067 000000038015b5a0 
>Apr 29 08:46:35 taft-04 kernel:        0000010216381030 00000000000110d7 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff80230ccd>{tty_wait_until_sent+237} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80135e60>{add_wait_queue+18} <ffffffff80230328>{read_chan+1059} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8013470c>{__wake_up+54} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8022af55>{tty_read+230} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8017b0d0>{vfs_read+207} <ffffffff8017b32c>{sys_read+69} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel: mingetty      S 0000010216c64a80     0  4726      1          4727  4725 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d699d68 0000000000000002 0000000000000020 0000001900000076 
>Apr 29 08:46:35 taft-04 kernel:        000001020d019030 0000000000000076 00000100010799c0 000000030d699dd8 
>Apr 29 08:46:35 taft-04 kernel:        000001020e9007f0 0000000000083c74 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff80237385>{complement_pos+12} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80135e60>{add_wait_queue+18} <ffffffff80230328>{read_chan+1059} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8013470c>{__wake_up+54} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8022af55>{tty_read+230} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8017b0d0>{vfs_read+207} <ffffffff8017b32c>{sys_read+69} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel: mingetty      S 000001020d6ce480     0  4727      1          4728  4726 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 0000010215863d68 0000000000000002 000000000000000f 0000001900000076 
>Apr 29 08:46:35 taft-04 kernel:        000001020e9007f0 0000000000000076 00000100010799c0 000000030d7a2030 
>Apr 29 08:46:35 taft-04 kernel:        000001020d7a2030 0000000000008905 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff803104fd>{__down_failed+53} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80135e60>{add_wait_queue+18} <ffffffff80230328>{read_chan+1059} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8013470c>{__wake_up+54} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff8022af55>{tty_read+230} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8017b0d0>{vfs_read+207} <ffffffff8017b32c>{sys_read+69} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel: mingetty      S 0000010216610780     0  4728      1          4729  4727 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d73fd68 0000000000000002 0000000000000020 0000001900000002 
>Apr 29 08:46:35 taft-04 kernel:        000001020d019030 0000000100000076 00000100010799c0 000000030d73fdd8 
>Apr 29 08:46:35 taft-04 kernel:        000001020d7f4030 000000000001b953 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff80135e60>{add_wait_queue+18} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80230328>{read_chan+1059} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8013470c>{__wake_up+54} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8022af55>{tty_read+230} <ffffffff8017b0d0>{vfs_read+207} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8017b32c>{sys_read+69} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: mingetty      S 000001020c2aedc0     0  4729      1          4730  4728 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020da59d68 0000000000000002 0000000000000020 0000001900000077 
>Apr 29 08:46:35 taft-04 kernel:        0000010216cf7030 0000000000000077 00000100010799c0 000000030da59dd8 
>Apr 29 08:46:35 taft-04 kernel:        000001020d019030 0000000000034544 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff80135e60>{add_wait_queue+18} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80230328>{read_chan+1059} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8013470c>{__wake_up+54} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8022af55>{tty_read+230} <ffffffff8017b0d0>{vfs_read+207} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8017b32c>{sys_read+69} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: mingetty      S 0000010001068760     0  4730      1          4731  4729 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d073d68 0000000000000006 0000000000000020 0000001900000086 
>Apr 29 08:46:35 taft-04 kernel:        00000101fff60030 0000000000000086 00000100010799c0 000000030d073dd8 
>Apr 29 08:46:35 taft-04 kernel:        0000010216cf7030 000000000002d5bb 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff80135e60>{add_wait_queue+18} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80230328>{read_chan+1059} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8013470c>{__wake_up+54} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8022af55>{tty_read+230} <ffffffff8017b0d0>{vfs_read+207} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8017b32c>{sys_read+69} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: mingetty      S 00000102169a6d80     0  4731      1          5663  4730 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d5a7d68 0000000000000006 0000000000000020 0000001900000076 
>Apr 29 08:46:35 taft-04 kernel:        000001020e9007f0 0000000000000076 00000100010699c0 000000010d5a7dd8 
>Apr 29 08:46:35 taft-04 kernel:        000001020d6d0030 000000000001e5ac 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff80135e60>{add_wait_queue+18} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80230328>{read_chan+1059} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8013470c>{__wake_up+54} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8022af55>{tty_read+230} <ffffffff8017b0d0>{vfs_read+207} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8017b32c>{sys_read+69} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: btimed        S 0000000000000100     0  5633   4082          5639       (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020c06daf8 0000000000000002 ffffffff803dc080 0000010217966000 
>Apr 29 08:46:35 taft-04 kernel:        00000102167d8e00 00000101ffc8ce00 00000102179661d4 0000000000001000 
>Apr 29 08:46:35 taft-04 kernel:        000001020df58030 0000000000000105 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff802b4b37>{dev_queue_xmit+541} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80135f80>{prepare_to_wait_exclusive+21} <ffffffff802b17a9>{skb_recv_datagram+373} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802ee938>{udp_recvmsg+118} <ffffffff802af1d6>{sock_common_recvmsg+48} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802abce8>{sock_recvmsg+284} <ffffffff80188f85>{link_path_walk+176} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80310672>{__lock_text_start+8} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802ab8eb>{sockfd_lookup+16} <ffffffff802ad117>{sys_recvfrom+182} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel: qarshd        S 0000000000000001     0  5639   4082  5640          5633 (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020bfefd58 0000000000000002 0000000000000030 000001020bfefe88 
>Apr 29 08:46:35 taft-04 kernel:        000001020bfefd58 0000000000000246 0000000000000030 00000000802abb63 
>Apr 29 08:46:35 taft-04 kernel:        000001020c83c7f0 000000000000118d 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel: mount         D 0000000000000000     0  5640   5639                     (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d4c5938 0000000000000006 0000000137cba6e8 0000000000000002 
>Apr 29 08:46:35 taft-04 kernel:        0000000000000012 0000000000000001 ffffffffa02cc670 0000000200000000 
>Apr 29 08:46:35 taft-04 kernel:        000001020d2c0030 0000000000002b79 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff8013470c>{__wake_up+54} <ffffffff8030f984>{wait_for_completion+167} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffffa028216f>{:gfs:gfs_lm_lock+50} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffffa027791a>{:gfs:glock_wait_internal+350} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa0278158>{:gfs:gfs_glock_nq+961} <ffffffffa0278383>{:gfs:gfs_glock_nq_init+20} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa02783cd>{:gfs:gfs_glock_nq_num+53} <ffffffffa0298f8a>{:gfs:gfs_get_qinode+68} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa028e4e3>{:gfs:gfs_get_sb+3223} <ffffffff80181962>{do_kern_mount+161} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80197d6f>{do_mount+1690} <ffffffff801eddc5>{__up_read+16} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff801248fd>{do_page_fault+577} <ffffffff8016b880>{handle_mm_fault+373} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80189479>{__user_walk+94} <ffffffff80198112>{sys_mount+186} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel: gulm_res_recv S 0000000000000000     0  5663      1          5664  4731 (L-TLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020c969a68 0000000000000046 000001020e099550 0000000100000002 
>Apr 29 08:46:35 taft-04 kernel:        0000002a955e700f ffffffff802541d9 0000000000000246 0000000200012780 
>Apr 29 08:46:35 taft-04 kernel:        000001020bfd97f0 00000000000033d8 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff802541d9>{submit_bio+247} <ffffffff8016b880>{handle_mm_fault+373} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff803101f4>{schedule_timeout+257} <ffffffff802ae661>{release_sock+16} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802aebf0>{sk_wait_data+156} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80132a0d>{recalc_task_prio+337} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802d77d6>{tcp_recvmsg+969} <ffffffff802af1d6>{sock_common_recvmsg+48} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802abce8>{sock_recvmsg+284} <ffffffff80132a0d>{recalc_task_prio+337} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80115e9f>{do_gettimeofday+77} <ffffffff8015e992>{free_pages_bulk+692} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80132a0d>{recalc_task_prio+337} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa02c49bf>{:lock_gulm:do_tfer+275} <ffffffff80132a9b>{activate_task+124} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa02c4aa5>{:lock_gulm:xdr_recv+31} <ffffffffa02c401a>{:lock_gulm:get_next+25} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa02c421c>{:lock_gulm:xdr_dec_uint32+46} <ffffffffa02c161e>{:lock_gulm:lg_core_handle_messages+185} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa02bc1b7>{:lock_gulm:cm_io_recving_thread+73} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa02bc16e>{:lock_gulm:cm_io_recving_thread+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:35 taft-04 kernel: gulm_glq_recv S 0000010001070760     0  5664      1          5665  5663 (L-TLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d1cfa58 0000000000000046 0000010216cf77f0 0000001900000073 
>Apr 29 08:46:35 taft-04 kernel:        000001020e6297f0 0000000000000073 00000100010619c0 0000000000000000 
>Apr 29 08:46:35 taft-04 kernel:        000001020d6587f0 00000000000088f2 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff803101f4>{schedule_timeout+257} <ffffffff802df3cf>{tcp_rcv_established+1322} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802ae661>{release_sock+16} <ffffffff802aebf0>{sk_wait_data+156} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffff80136028>{autoremove_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802d77d6>{tcp_recvmsg+969} <ffffffff802af1d6>{sock_common_recvmsg+48} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff802abce8>{sock_recvmsg+284} <ffffffff802abce8>{sock_recvmsg+284} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80132a9b>{activate_task+124} <ffffffff80132fc6>{try_to_wake_up+876} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffff8013470c>{__wake_up+54} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80136028>{autoremove_wake_function+0} <ffffffffa02c133f>{:lock_gulm:qu_async_rpl+167} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa02c49bf>{:lock_gulm:do_tfer+275} <ffffffffa02c4aa5>{:lock_gulm:xdr_recv+31} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa02c401a>{:lock_gulm:get_next+25} <ffffffffa02c421c>{:lock_gulm:xdr_dec_uint32+46} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffffa02c2358>{:lock_gulm:lg_lock_handle_messages+208} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff801346b6>{__wake_up_common+67} <ffffffffa02bf420>{:lock_gulm:glq_recving_thread+74} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa02bf3d6>{:lock_gulm:glq_recving_thread+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:35 taft-04 kernel: gulm_glq_send S 000001021784ae80     0  5665      1          5666  5664 (L-TLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020c713ec8 0000000000000046 0000010037c99800 0000000000000049 
>Apr 29 08:46:35 taft-04 kernel:        0000010037cc4e00 ffffffffa02c3b07 0000010037cc4e98 00000000a02c2de5 
>Apr 29 08:46:35 taft-04 kernel:        0000010216aed030 000000000000a652 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffffa02c3b07>{:lock_gulm:xdr_enc_flush+44} <ffffffffa02beba9>{:lock_gulm:glq_sender_thread+199} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa02beae2>{:lock_gulm:glq_sender_thread+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:35 taft-04 kernel: gulm_Cb_Handl S 0000010001070760     0  5666      1          5667  5665 (L-TLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d3e3e78 0000000000000046 00000102168d32b0 0000001900000073 
>Apr 29 08:46:35 taft-04 kernel:        000001020e03b030 0000000000000073 00000100010619c0 00000000a026d067 
>Apr 29 08:46:35 taft-04 kernel:        000001020e6297f0 0000000000005329 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffffa02786a4>{:gfs:drop_bh+358} <ffffffffa02c101b>{:lock_gulm:handler+183} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa02c0f64>{:lock_gulm:handler+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:35 taft-04 kernel: gulm_Cb_Handl S 000001020c431eb8     0  5667      1          5671  5666 (L-TLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020c431e78 0000000000000046 000001020e6297f0 0000001900000073 
>Apr 29 08:46:35 taft-04 kernel:        000001020e6297f0 0000000000000073 00000100010619c0 0000000000000000 
>Apr 29 08:46:35 taft-04 kernel:        000001020e03b030 0000000000000c76 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff801347d9>{complete+53} <ffffffffa02c101b>{:lock_gulm:handler+183} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8013b141>{do_exit+3225} <ffffffff80144d5d>{sys_rt_sigaction+133} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa02c0f64>{:lock_gulm:handler+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:35 taft-04 kernel: gfs_scand     S 000001020dc2c000     0  5671      1          5672  5667 (L-TLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020e383ea8 0000000000000046 ffffffff803dc080 0000000000000000 
>Apr 29 08:46:35 taft-04 kernel:        000001020d0197f0 00000100010710a0 000001020dc2c000 0000000000000000 
>Apr 29 08:46:35 taft-04 kernel:        000001020d0197f0 00000000000273ca 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffffa026b6d1>{:gfs:gfs_scand+137} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa026b648>{:gfs:gfs_scand+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:35 taft-04 kernel: gfs_glockd    S 0000010001070760     0  5672      1          5673  5671 (L-TLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020e8e7ed8 0000000000000046 0000000000000001 0000001900000073 
>Apr 29 08:46:35 taft-04 kernel:        0000010216aed030 0000000000000073 00000100010619c0 00000000168d33b8 
>Apr 29 08:46:35 taft-04 kernel:        000001020d2137f0 0000000000002e42 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffffa0277239>{:gfs:unlock_on_glock+37} <ffffffffa026b7d6>{:gfs:gfs_glockd+185} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80134665>{default_wake_function+0} <ffffffff80134665>{default_wake_function+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa026b71d>{:gfs:gfs_glockd+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:35 taft-04 kernel: gfs_recoverd  S 000001020dc2c000     0  5673      1                5672 (L-TLB)
>Apr 29 08:46:35 taft-04 kernel: 000001020d345ea8 0000000000000046 ffffffff803dc080 0000001900000074 
>Apr 29 08:46:35 taft-04 kernel:        0000010216680030 0000000000000074 00000100010719c0 0000000000000002 
>Apr 29 08:46:35 taft-04 kernel:        000001020ccd0030 0000000000000181 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff8014057c>{__mod_timer+293} <ffffffff8031027f>{schedule_timeout+396} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80140fa6>{process_timeout+0} <ffffffffa026b897>{:gfs:gfs_recoverd+137} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f47>{child_rip+8} <ffffffffa026b80e>{:gfs:gfs_recoverd+0} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80110f3f>{child_rip+0} 
>Apr 29 08:46:35 taft-04 kernel: sshd          S 000000000000000a     0 27247   4069 27249               (NOTLB)
>Apr 29 08:46:35 taft-04 kernel: 00000102085c1d58 0000000000000002 0000000500000001 000001020a986b30 
>Apr 29 08:46:35 taft-04 kernel:        000001020a986b30 0000000000000246 000001020a986b30 0000000000000246 
>Apr 29 08:46:35 taft-04 kernel:        0000010006bfa7f0 000000000001df63 
>Apr 29 08:46:35 taft-04 kernel: Call Trace:<ffffffff8022aa29>{tty_ldisc_try+60} <ffffffff803101f4>{schedule_timeout+257} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8022ab5c>{tty_ldisc_deref+103} <ffffffff8018da3b>{do_select+939} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff8018d5d5>{__pollwait+0} <ffffffff8018ddba>{sys_select+820} 
>Apr 29 08:46:35 taft-04 kernel:        <ffffffff80195dc1>{dnotify_parent+34} <ffffffff8011026a>{system_call+126} 
>Apr 29 08:46:35 taft-04 kernel:        
>Apr 29 08:46:35 taft-04 kernel: bash          R  running task       0 27249  27247                     (NOTLB)

Actions: View

Attachments on bug 252209: 161297 | 304116