Attachment 258181 Details for Bug 382621 – stack traces form grant-01

stack traces form grant-01

stacks (text/plain), 99.16 KB, created by Corey Marthaler on 2007-11-14 15:31:10 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Corey Marthaler

Created: 2007-11-14 15:31:10 UTC

Size: 99.16 KB

patch

obsolete

>Nov 14 08:57:15 grant-01 kernel: SysRq : Show State
>Nov 14 08:57:15 grant-01 kernel: 
>Nov 14 08:57:15 grant-01 kernel:                                                        sibling
>Nov 14 08:57:15 grant-01 kernel:   task                 PC          pid father child younger older
>Nov 14 08:57:15 grant-01 kernel: init          S 0000000103601ac5     0     1      0     2               (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010037ff3d28 0000000000000006 0000010107788140 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel:        0000010037ff1110 000000000000091d ffffffff8042f980 0000010037ff13f8 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8019fa96>{pipe_poll+47} <ffffffff801a72ea>{do_select+1435} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6c95>{__pollwait+0} <ffffffff801a7669>{sys_select+820} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel: ksoftirqd/0   S 0000000000000000     0     2      1             3       (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010037ff5f08 0000000000000046 00000101fa0c41b0 0000007780152d5a 
>Nov 14 08:57:15 grant-01 kernel:        0000010037ff08a0 000000000000009d 00000101fa0c4a20 0000010037ff0b88 
>Nov 14 08:57:15 grant-01 kernel:        000000000000000a 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff801408c5>{ksoftirqd+0} <ffffffff80140900>{ksoftirqd+59} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: events/0      R  running task       0     3      1     4      42     2 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: khelper       S 00000101077a9200     0     4      3             5       (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 00000100dfda1e98 0000000000000046 00000100dfda1e68 0000006a8013562e 
>Nov 14 08:57:15 grant-01 kernel:        00000100dfd9f150 00000000000000ba 00000102040f6070 00000100dfd9f438 
>Nov 14 08:57:15 grant-01 kernel:        0000010037ff3d28 00000000fffffffc 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff80150e73>{worker_thread+0} <ffffffff80150f49>{worker_thread+214} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: kacpid        S 00000101077aac00     0     5      3            41     4 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010002aa3e98 0000000000000046 0000000000000001 0000007d804c6aa0 
>Nov 14 08:57:15 grant-01 kernel:        00000100dfd9e8e0 00000000000011c6 0000010037ff1110 00000100dfd9ebc8 
>Nov 14 08:57:15 grant-01 kernel:        0000010037ff3ce8 00000000fffffffc 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff80150e73>{worker_thread+0} <ffffffff80150f49>{worker_thread+214} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80208163>{selinux_d_instantiate+0} <ffffffff80208163>{selinux_d_instantiate+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: kblockd/0     S 00000101077ac400     0    41      3            63     5 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010002ae5e98 0000000000000046 000001021fc29600 000001021fc3b040 
>Nov 14 08:57:15 grant-01 kernel:        00000100dfd9e070 000000000000185f ffffffff8042f980 00000100dfd9e358 
>Nov 14 08:57:15 grant-01 kernel:        0000010037ff3d18 00000000fffffffc 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff80150e73>{worker_thread+0} <ffffffff80150f49>{worker_thread+214} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: khubd         S 0000000000000000     0    42      1            65     3 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010002b19e78 0000000000000046 000001021fec8800 000001021fec8800 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b17190 00000000000041ed ffffffff8042f980 0000010002b17478 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 ffffffff802d7d45 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff802d7d45>{usbfs_add_device+320} <ffffffff802cd1aa>{hub_thread+3339} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff802cc49f>{hub_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: pdflush       S 00000010918377f4     0    63      3            64    41 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010002b4ded8 0000000000000046 0000010002ab9180 0000006a02b16920 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b16920 00000000000003d6 0000010037ff0030 0000010002b16c08 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b4ded8 0000000000000297 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8016fcf1>{pdflush+0} <ffffffff8016fe86>{pdflush+405} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: pdflush       S 0000010002b4fee8     0    64      3            66    63 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010002b4fed8 0000000000000046 0000000000000000 0000000000000000 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b160b0 00000000000005ed ffffffff8042f980 0000010002b16398 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 0000000000000005 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8016fcf1>{pdflush+0} <ffffffff8016fe86>{pdflush+405} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0}<4>warning: many lost ticks.
>Nov 14 08:57:15 grant-01 kernel: Your time source seems to be instable or some driver is hogging interupts
>Nov 14 08:57:15 grant-01 kernel: rip serial8250_console_write+0x3b3/0x3c2
>Nov 14 08:57:15 grant-01 kernel: Falling back to HPET
>Nov 14 08:57:15 grant-01 kernel:  
>Nov 14 08:57:15 grant-01 kernel: aio/0         S 00000010922c0750     0    66      3           431    64 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010002b59e98 0000000000000046 000000000000231e 0000008a00000000 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b52960 0000000000000587 0000010037ff08a0 0000010002b52c48 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000010 0000010002b52960 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff80150e73>{worker_thread+0} <ffffffff80150f49>{worker_thread+214} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: kswapd0       S 0000010002b55f08     0    65      1           210    42 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010002b55eb8 0000000000000046 0000000000000000 0000007d00000000 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b531d0 00000000000007cf 0000010037ff1110 0000010002b534b8 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 0000000000000000 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff80177e6e>{kswapd+203} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80177da3>{kswapd+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: kseriod       S ffffffff80583be8     0   210      1           434    65 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 0000010002b9feb8 0000000000000046 0000010002b9d210 0000007b00000016 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b9d210 0000000000001236 0000010037ff1110 0000010002b9d4f8 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b9fef8 0000000000000046 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8027eb9e>{serio_thread+923} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8013e0e4>{do_exit+3840} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80208163>{selinux_d_instantiate+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8027e803>{serio_thread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: ata/0         S 00000100dfd81e00     0   431      3           432    66 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021fe83e98 0000000000000046 000001021fd945c0 00000074a006f07d 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b9c9a0 0000000000026836 000001021fe7f250 0000010002b9cc88 
>Nov 14 08:57:15 grant-01 kernel:        000001021fc41d48 00000000fffffffc 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff80150e73>{worker_thread+0} <ffffffff80150f49>{worker_thread+214} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: ata_aux       S 00000100dfd81a00     0   432      3          1014   431 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021fe85e98 0000000000000046 0000000000002706 0000007a00000000 
>Nov 14 08:57:15 grant-01 kernel:        0000010002b9c130 0000000000000451 0000010002b520f0 0000010002b9c418 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000010 0000010002b9c130 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff80150e73>{worker_thread+0} <ffffffff80150f49>{worker_thread+214} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: scsi_eh_0     S 000001021fdf3ec8     0   434      1           435   210 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021fdf3da8 0000000000000046 00000011b5160f40 0000007600000000 
>Nov 14 08:57:15 grant-01 kernel:        000001021fe7f250 00000000002dfb29 0000010002b520f0 000001021fe7f538 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 0000000000000046 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8035f44f>{__down_interruptible+373} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8036163e>{__down_failed_interruptible+53} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa0007fb1>{:scsi_mod:.text.lock.scsi_error+45} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffffa0006f25>{:scsi_mod:scsi_error_handler+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: scsi_eh_1     S 000001021fc0bec8     0   435      1           436   434 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021fc0bda8 0000000000000046 00000011c83852ce 0000007600000000 
>Nov 14 08:57:15 grant-01 kernel:        000001021fe7e9e0 0000000000d84eb2 0000010002b520f0 000001021fe7ecc8 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 0000000000000046 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8035f44f>{__down_interruptible+373} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8036163e>{__down_failed_interruptible+53} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa0007fb1>{:scsi_mod:.text.lock.scsi_error+45} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffffa0006f25>{:scsi_mod:scsi_error_handler+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: scsi_eh_2     S 000001021fd6dec8     0   436      1           437   435 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021fd6dda8 0000000000000046 00000011db5a8925 0000007600000000 
>Nov 14 08:57:15 grant-01 kernel:        000001021fe7e170 0000000000d85603 0000010002b520f0 000001021fe7e458 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 0000000000000046 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8035f44f>{__down_interruptible+373} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8036163e>{__down_failed_interruptible+53} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa0007fb1>{:scsi_mod:.text.lock.scsi_error+45} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffffa0006f25>{:scsi_mod:scsi_error_handler+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: scsi_eh_3     S 00000011ee7cb257     0   437      1           448   436 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021fc2dda8 0000000000000046 00000011ee7caf59 0000006900000000 
>Nov 14 08:57:15 grant-01 kernel:        000001021fc59290 0000000000d84dcc 0000010037ff0030 000001021fc59578 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 0000000000000046 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8035f44f>{__down_interruptible+373} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8036163e>{__down_failed_interruptible+53} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa0007fb1>{:scsi_mod:.text.lock.scsi_error+45} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffffa0006f25>{:scsi_mod:scsi_error_handler+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: scsi_eh_4     S 000001021ff99ec8     0   448      1           449   437 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021ff99da8 0000000000000046 ffffffff8042fce8 0000007700000086 
>Nov 14 08:57:15 grant-01 kernel:        000001021ff97310 0000000000000bae 0000010002b520f0 000001021ff975f8 
>Nov 14 08:57:15 grant-01 kernel:        0000010037e20000 0000000000000006 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8035f44f>{__down_interruptible+373} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8036163e>{__down_failed_interruptible+53} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa0007fb1>{:scsi_mod:.text.lock.scsi_error+45} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffffa0006f25>{:scsi_mod:scsi_error_handler+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: qla2400_4_dpc S 000001021eca3ee8     0   449      1           483   448 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021eca3de8 0000000000000046 00000007006a0e13 00001fc600034000 
>Nov 14 08:57:15 grant-01 kernel:        000001021fe2a1f0 0000000000001d93 ffffffff8042f980 000001021fe2a4d8 
>Nov 14 08:57:15 grant-01 kernel:        000000000000d800 0000000000000006 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8035f44f>{__down_interruptible+373} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa0043087>{:qla2xxx:qla2x00_loop_resync+141} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8036163e>{__down_failed_interruptible+53} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa003de4d>{:qla2xxx:.text.lock.qla_os+15} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa003c99a>{:qla2xxx:qla2x00_do_dpc+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: scsi_eh_5     S 000001021eda3ec8     0   483      1           484   449 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021eda3da8 0000000000000046 ffffffff8042fce8 0000007a00000086 
>Nov 14 08:57:15 grant-01 kernel:        000001021ff96230 0000000000001ec7 0000010002b520f0 000001021ff96518 
>Nov 14 08:57:15 grant-01 kernel:        000001021eda8000 0000000000000003 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8035f44f>{__down_interruptible+373} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8036163e>{__down_failed_interruptible+53} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa0007fb1>{:scsi_mod:.text.lock.scsi_error+45} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffffa0006f25>{:scsi_mod:scsi_error_handler+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: qla2400_5_dpc S 000001021ed23ee8     0   484      1           500   483 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021ed23de8 0000000000000046 ffffffff8042f980 0000007300000086 
>Nov 14 08:57:15 grant-01 kernel:        000001021fc58a20 00000000000013c1 ffffffff8042f980 000001021fc58d08 
>Nov 14 08:57:15 grant-01 kernel:        000000000000dc00 0000000000000006 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8035f44f>{__down_interruptible+373} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8036163e>{__down_failed_interruptible+53} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa003de4d>{:qla2xxx:.text.lock.qla_os+15} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa003c99a>{:qla2xxx:qla2x00_do_dpc+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: kjournald     S 0000010002bdc800     0   500      1          2074   484 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021e46be48 0000000000000046 ffffffff8042f980 00000074ce5e8768 
>Nov 14 08:57:15 grant-01 kernel:        000001021fe2aa60 00000000000002cc ffffffff8042f980 000001021fe2ad48 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 0000010002bd4400 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffffa00e4380>{:jbd:kjournald+1030} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffffa00e3f74>{:jbd:commit_timeout+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffffa00e3f7a>{:jbd:kjournald+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: kauditd       S 000001021ddc1ee8     0  1014      3          2129   432 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021ddc1ea8 0000000000000046 0000000000002710 0000007b37ff0030 
>Nov 14 08:57:15 grant-01 kernel:        000001021df09550 0000000000000400 000001021d9ce5b0 000001021df09838 
>Nov 14 08:57:15 grant-01 kernel:        000001021da279f8 00000000fffffffc 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff8016100d>{kauditd_thread+0} <ffffffff8016116c>{kauditd_thread+351} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: udevd         S 000008db9b4b93b1     0  2074      1          2400   500 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021d489d28 0000000000000002 00000102040f6070 0000007200000246 
>Nov 14 08:57:15 grant-01 kernel:        000001021d8d8da0 000000000000135c 000001021e3c9510 000001021d8d9088 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 000001021de63380 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff802f8e91>{datagram_poll+42} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8013be33>{release_task+530} <ffffffff801a7669>{sys_select+820} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel: kedac         R  running task       0  2129      3         17233  1014 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: kjournald     S 000001021fef2800     0  2400      1          2894  2074 (L-TLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021d1f7e48 0000000000000046 000001021d1f7e28 00000076801370cf 
>Nov 14 08:57:15 grant-01 kernel:        000001021d80d5d0 000000000000275f 000001021d80c4f0 000001021d80d8b8 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000000 0000010002b0c800 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffffa00e4380>{:jbd:kjournald+1030} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff8035fe82>{__cond_resched+23} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffffa00e3f74>{:jbd:commit_timeout+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff802f8e67>{datagram_poll+0} <ffffffffa00e3f7a>{:jbd:kjournald+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:15 grant-01 kernel: dhclient      S 000000010400d22d     0  2894      1          2936  2400 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021ca35d28 0000000000000006 ffffffff8042f980 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel:        000001021d8d9610 00000000000024b3 ffffffff8042f980 000001021d8d98f8 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff802f8e91>{datagram_poll+42} <ffffffff801a72ea>{do_select+1435} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6c95>{__pollwait+0} <ffffffff801a7669>{sys_select+820} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel: syslogd       S 000001021e59b6c0     0  2936      1          2940  2894 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021ceedd28 0000000000000006 0000000000000000 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel:        000001021e3c8ca0 0000000000000bf5 ffffffff8042f980 000001021e3c8f88 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 000001021ceedc68 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff802f8e91>{datagram_poll+42} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: klogd         R  running task       0  2940      1          2960  2936 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: portmap       S 000001021e59b580     0  2960      1          2979  2940 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021ca17e38 0000000000000002 000001021ca17e48 0000007800000246 
>Nov 14 08:57:15 grant-01 kernel:        000001021e18f3d0 0000000000002ecc 000001021ff96aa0 000001021e18f6b8 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 0000000000000020 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff80320bf1>{tcp_poll+47} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a7a0e>{sys_poll+588} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel: rpc.statd     S 000001021db02e40     0  2979      1          3006  2960 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021ca9bd28 0000000000000002 000000000000003b 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel:        000001021ff96aa0 00000000000033ca ffffffff8042f980 000001021ff96d88 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 000001021ca817a8 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff80320bf1>{tcp_poll+47} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: rpc.idmapd    R  running task       0  3006      1          3086  2979 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: acpid         S 000001021dfe1940     0  3086      1          3095  3006 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021c071d28 0000000000000006 000001021c69eb58 0000000000000000 
>Nov 14 08:57:15 grant-01 kernel:        000001021fc581b0 00000000000171f4 ffffffff8042f980 000001021fc58498 
>Nov 14 08:57:15 grant-01 kernel:        000001021c071e80 000000d08016ae88 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: cupsd         S 0000000103606c9c     0  3095      1          3125  3086 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021c193d28 0000000000000006 000001021c2892b8 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel:        000001021e0b9450 0000000000006048 ffffffff8042f980 000001021e0b9738 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff8019fa96>{pipe_poll+47} <ffffffff801a72ea>{do_select+1435} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6c95>{__pollwait+0} <ffffffff801a7669>{sys_select+820} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel: sshd          S 000001021e6aa7c0     0  3125      1  4694    3161  3095 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021bc87d28 0000000000000002 000001020cf2d310 0000000000000246 
>Nov 14 08:57:15 grant-01 kernel:        000001021d80cd60 0000000000072485 ffffffff8042f980 000001021d80d048 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 000000001e0be780 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff80320bf1>{tcp_poll+47} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff8035fb2c>{thread_return+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel: xinetd        S 0000090b42cd2b29     0  3161      1  4700    3179  3125 (NOTLB)
>Nov 14 08:57:15 grant-01 kernel: 000001021be4dd28 0000000000000006 0000000000000049 0000007400000246 
>Nov 14 08:57:15 grant-01 kernel:        000001021d952de0 000000000000241a 000001021e3c8ca0 000001021d9530c8 
>Nov 14 08:57:15 grant-01 kernel:        0000000000000246 000001021be4dc68 
>Nov 14 08:57:15 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff80320bf1>{tcp_poll+47} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:15 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:15 grant-01 kernel:        
>Nov 14 08:57:15 grant-01 kernel: sendmail      R  running task       0  3179      1          3188  3161 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: sendmail      S 0000007fbfffd600     0  3188      1          3226  3179 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021bab1f68 0000000000000002 000000552aafce30 ffffffff8013f9d6 
>Nov 14 08:57:16 grant-01 kernel:        000001021d80c4f0 000000000000dcf4 ffffffff8042f980 000001021d80c7d8 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000001 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff8013f9d6>{do_setitimer+332} <ffffffff8014d3b7>{sys_pause+23} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: gpm           S 0000001f1d8a67ca     0  3226      1          3359  3188 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021b54dd28 0000000000000006 0000001f1ca8f1f4 0000008600000000 
>Nov 14 08:57:16 grant-01 kernel:        000001021ebd5390 0000000000004ad9 0000010037ff08a0 000001021ebd5678 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: crond         S 000000010360d6b9     0  3359      1          3377  3226 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021bba1e98 0000000000000006 000000007fffffff 000001021bba1e58 
>Nov 14 08:57:16 grant-01 kernel:        000001021d952570 000000000000215f ffffffff8042f980 000001021d952858 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000001 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8014af22>{sigprocmask+502} <ffffffff80145902>{sys_nanosleep+192} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: xfs           S 0000000103622c98     0  3377      1          3394  3359 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021bb09d28 0000000000000002 ffffffff8042f980 00000076802f1fad 
>Nov 14 08:57:16 grant-01 kernel:        000001021d9cf690 00000000000030e1 ffffffff8042f980 000001021d9cf978 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: atd           S 00000001036250fd     0  3394      1          3403  3377 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021b71de98 0000000000000002 0000000000000000 ffffffff801a6ab6 
>Nov 14 08:57:16 grant-01 kernel:        000001021e18eb60 0000000000002040 ffffffff8042f980 000001021e18ee48 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff801a6ab6>{filldir64+0} <ffffffff803611a7>{schedule_timeout+445} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801457bf>{process_timeout+0} <ffffffff8014af22>{sigprocmask+502} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80145902>{sys_nanosleep+192} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: dbus-daemon-1 S 000001021acae200     0  3403      1          3414  3394 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021b02de38 0000000000000006 000001021e344c20 0000007407788ec0 
>Nov 14 08:57:16 grant-01 kernel:        000001021d9cee20 00000000000000cb ffffffff8042f980 000001021d9cf108 
>Nov 14 08:57:16 grant-01 kernel:        fffffffffffffff7 000000d0802f24e9 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff801a7a0e>{sys_poll+588} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a6c95>{__pollwait+0} <ffffffff8018faac>{sys_writev+69} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: hald          R  running task       0  3414      1          3549  3403 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: oddjobd       S 00000783667aa761     0  3549      1          3592  3414 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021aeffd28 0000000000000006 000001021e3443b0 00000074ffffffff 
>Nov 14 08:57:16 grant-01 kernel:        000001021e344c20 0000000000002003 000001021d9cee20 000001021e344f08 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000000 000000d000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: saslauthd     S 000001021eecdd98     0  3592      1  3593    3644  3549 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021ad85e88 0000000000000006 000001021eecd050 000000781ad85e88 
>Nov 14 08:57:16 grant-01 kernel:        000001021df82d20 00000000000030bd 000001021d8d8530 000001021df83008 
>Nov 14 08:57:16 grant-01 kernel:        fffffff500000000 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff801aa81a>{fcntl_setlk+479} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff801a5eb5>{sys_fcntl+1163} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: saslauthd     S 000001021b4f4dc0     0  3593   3592          3623       (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021a837d38 0000000000000002 000001021ac8fb38 0000007900000202 
>Nov 14 08:57:16 grant-01 kernel:        000001021d953650 0000000000010357 000001021df82d20 000001021d953938 
>Nov 14 08:57:16 grant-01 kernel:        000001021afe6550 000001021aef8640 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8017bf05>{do_no_page+1701} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802f878c>{skb_recv_datagram+648} <ffffffff8017c1e6>{handle_mm_fault+465} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80359dd5>{unix_accept+95} <ffffffff802f31dc>{sys_accept+183} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80111415>{error_exit+0} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: saslauthd     S 000001021eecd370     0  3623   3592          3624  3593 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021a839e88 0000000000000002 000001021eecd050 000000791a839e88 
>Nov 14 08:57:16 grant-01 kernel:        000001021d9ce5b0 000000000000a70b 000001021df82d20 000001021d9ce898 
>Nov 14 08:57:16 grant-01 kernel:        fffffff500000000 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff801aa81a>{fcntl_setlk+479} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff801a5eb5>{sys_fcntl+1163} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: saslauthd     S 000001021eecdf28     0  3624   3592          3625  3623 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021a869e88 0000000000000002 000001021eecd050 000000791a869e88 
>Nov 14 08:57:16 grant-01 kernel:        000001021e0b8370 0000000000009aa7 000001021df82d20 000001021e0b8658 
>Nov 14 08:57:16 grant-01 kernel:        fffffff500000000 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff801aa81a>{fcntl_setlk+479} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff801a5eb5>{sys_fcntl+1163} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: saslauthd     S 000001021eecde60     0  3625   3592                3624 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021a88be88 0000000000000006 000001021eecd050 000000791a88be88 
>Nov 14 08:57:16 grant-01 kernel:        000001021b5d4670 0000000000009b02 000001021df82d20 000001021b5d4958 
>Nov 14 08:57:16 grant-01 kernel:        fffffff500000000 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff801aa81a>{fcntl_setlk+479} <ffffffff801370c6>{autoremove_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff801a5eb5>{sys_fcntl+1163} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: ricci         R  running task       0  3644      1          3649  3592 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: login         S 00000000fffffe00     0  3649      1  4551    3650  3644 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021e0d1eb8 0000000000000006 0000007fbfffeb90 0000000000000202 
>Nov 14 08:57:16 grant-01 kernel:        000001021e0b8be0 00000000000053a3 ffffffff8042f980 000001021e0b8ec8 
>Nov 14 08:57:16 grant-01 kernel:        000001021e0d1f58 ffffffff8037a571 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff8013f49e>{do_wait+3862} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8014d074>{sys_rt_sigaction+97} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: mingetty      S 000001021a903080     0  3650      1          3651  3649 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021b1e7d28 0000000000000002 000000101b1e7e80 000000761b1e7dc8 
>Nov 14 08:57:16 grant-01 kernel:        000001021ebd42b0 0000000000024ce0 000001021b6808a0 000001021ebd4598 
>Nov 14 08:57:16 grant-01 kernel:        00000100000b9240 00000100000b9220 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff80268485>{write_chan+914} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802679e4>{read_chan+1037} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff802602c8>{tty_read+378} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8018f32b>{vfs_read+207} <ffffffff8018f587>{sys_read+69} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: mingetty      S 000001021a6b7b80     0  3651      1          3659  3650 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021b1cdd28 0000000000000002 000000101b1cde80 0000007c1b1cddc8 
>Nov 14 08:57:16 grant-01 kernel:        000001021df83590 0000000000017c62 000001021e3443b0 000001021df83878 
>Nov 14 08:57:16 grant-01 kernel:        000001021e0ba2a0 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff80268485>{write_chan+914} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802679e4>{read_chan+1037} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff802602c8>{tty_read+378} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8018f32b>{vfs_read+207} <ffffffff8018f587>{sys_read+69} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: mingetty      S 000001021a066e00     0  3659      1          3660  3651 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021b21bd28 0000000000000002 000000101b21be80 000000761b21bdc8 
>Nov 14 08:57:16 grant-01 kernel:        000001021b6808a0 000000000001b302 000001021b681110 000001021b680b88 
>Nov 14 08:57:16 grant-01 kernel:        000001021e0792a0 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff80268485>{write_chan+914} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802679e4>{read_chan+1037} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff802602c8>{tty_read+378} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8018f32b>{vfs_read+207} <ffffffff8018f587>{sys_read+69} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: mingetty      S 0000010219d9b900     0  3660      1          3661  3659 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021ad19d28 0000000000000006 000000101ad19e80 000000761ad19dc8 
>Nov 14 08:57:16 grant-01 kernel:        000001021b681110 00000000000176d3 000001021d8d8530 000001021b6813f8 
>Nov 14 08:57:16 grant-01 kernel:        000001021dc152a0 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff80268485>{write_chan+914} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802679e4>{read_chan+1037} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff802602c8>{tty_read+378} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8018f32b>{vfs_read+207} <ffffffff8018f587>{sys_read+69} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: mingetty      S 0000010219fd4d40     0  3661      1          3662  3660 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021b237d28 0000000000000002 000000101b237e80 000000781b237dc8 
>Nov 14 08:57:16 grant-01 kernel:        000001021d8d8530 00000000000174ee 000001021df83590 000001021d8d8818 
>Nov 14 08:57:16 grant-01 kernel:        000001021e0052a0 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff80268485>{write_chan+914} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802679e4>{read_chan+1037} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff802602c8>{tty_read+378} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8018f32b>{vfs_read+207} <ffffffff8018f587>{sys_read+69} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: mingetty      S 000001021ab86080     0  3662      1         17226  3661 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021ad77d28 0000000000000006 000000101ad77e80 000000761ad77dc8 
>Nov 14 08:57:16 grant-01 kernel:        000001021b680030 000000000001899a 000001021d8d8530 000001021b680318 
>Nov 14 08:57:16 grant-01 kernel:        000001021dc122a0 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff80268485>{write_chan+914} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802679e4>{read_chan+1037} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff802602c8>{tty_read+378} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8018f32b>{vfs_read+207} <ffffffff8018f587>{sys_read+69} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: bash          S 000001021addb440     0  4551   3649                     (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021b5dfd28 0000000000000002 ffffffff801355dd 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel:        000001021ebd4b20 0000000000010e14 ffffffff8042f980 000001021ebd4e08 
>Nov 14 08:57:16 grant-01 kernel:        ffffffff801355dd 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff803610ee>{schedule_timeout+260} <ffffffff80268485>{write_chan+914} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802679e4>{read_chan+1037} <ffffffff8014a425>{get_signal_to_deliver+859} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802602c8>{tty_read+378} <ffffffff8018f32b>{vfs_read+207} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8018f587>{sys_read+69} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: sshd          S 000033d6903295c7     0  4694   3125  4716               (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021a75bd28 0000000000000006 0000000000000000 0000007500000246 
>Nov 14 08:57:16 grant-01 kernel:        000001021b5d5750 0000000000000bd0 000001021b5d4ee0 000001021b5d5a38 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000246 000000001a75bd80 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff801a72ea>{do_select+1435} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a6c95>{__pollwait+0} <ffffffff801a7669>{sys_select+820} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: btimed        R  running task       0  4700   3161         21399       (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: bash          R  running task       0  4716   4694                     (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: ccsd          S 000001020de6f680     0 17226      1         17227  3662 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101d4eb3d28 0000000000000006 ffffffff8042f980 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel:        0000010217c712d0 000000000000057f ffffffff8042f980 0000010217c715b8 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000246 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff801a72ea>{do_select+1435} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a6c95>{__pollwait+0} <ffffffff801a7669>{sys_select+820} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: ccsd          S 0000010211826800     0 17227      1         17231 17226 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010200d69d28 0000000000000006 0000010200d69e80 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel:        000001020d3f8a20 0000000000010c9a ffffffff8042f980 000001020d3f8d08 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000246 000000000000000f 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8016da2a>{__get_free_pages+29} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a6ccf>{__pollwait+58} <ffffffff802f8e91>{datagram_poll+42} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a72ea>{do_select+1435} <ffffffff801a6c95>{__pollwait+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a7669>{sys_select+820} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: cman_comms    R  running task       0 17231      1         17232 17227 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: cman_serviced S 0000090b435ede47     0 17233      3         17289  2129 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010215a9df08 0000000000000046 000001020d3f81b0 0000007300000070 
>Nov 14 08:57:16 grant-01 kernel:        00000101ebe133d0 0000000000000019 000001020d3f81b0 00000101ebe136b8 
>Nov 14 08:57:16 grant-01 kernel:        0000010200000001 0000010213352260 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa027a7cc>{:cman:serviced+0} <ffffffffa027a8ed>{:cman:serviced+289} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: cman_memb     S 00000101ea4522b0     0 17232      1         17250 17231 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000102028e3e38 0000000000000046 00000102028e3da8 0000000000000008 
>Nov 14 08:57:16 grant-01 kernel:        00000101ea4522b0 0000000000000098 ffffffff8042f980 00000101ea452598 
>Nov 14 08:57:16 grant-01 kernel:        0000010100000000 000000000000000a 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa0278d65>{:cman:membership_kthread+4054} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffffa0277d8f>{:cman:membership_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: cman_hbeat    S 000033d670c380d5     0 17250      1         17268 17232 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000102165aff18 0000000000000046 0000000000000000 0000007300000000 
>Nov 14 08:57:16 grant-01 kernel:        00000101ebe122f0 00000000000008cf 000001020d3f81b0 00000101ebe125d8 
>Nov 14 08:57:16 grant-01 kernel:        0000000000110000 00000101ebe122f0 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa027539b>{:cman:hello_kthread+471} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02751c4>{:cman:hello_kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: fenced        S 00000102164edf58     0 17268      1         17288 17250 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 00000102164edf28 0000000000000006 0000010100000000 00000101f968c6c0 
>Nov 14 08:57:16 grant-01 kernel:        00000101ea452b20 000000000000074c ffffffff8042f980 00000101ea452e08 
>Nov 14 08:57:16 grant-01 kernel:        00000000801c7850 0000007fbffff9f0 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff80110a92>{system_call+126} <ffffffff801103c4>{sys_rt_sigsuspend+762} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110e07>{ptregscall_common+103} 
>Nov 14 08:57:16 grant-01 kernel: clvmd         S 0000000103608235     0 17288      1         17315 17268 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010212f8fd28 0000000000000006 ffffffff8042f980 00000073fa3aabe0 
>Nov 14 08:57:16 grant-01 kernel:        000001020d3f9290 0000000000000740 ffffffff8042f980 000001020d3f9578 
>Nov 14 08:57:16 grant-01 kernel:        0000010212f8fd28 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802f8e91>{datagram_poll+42} <ffffffff801a72ea>{do_select+1435} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801a6c95>{__pollwait+0} <ffffffff801a7669>{sys_select+820} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: clvmd         S 000006f45f135eaa     0 17315      1         17316 17288 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 000001021559fe58 0000000000000006 00000101ea453390 0000007340a00001 
>Nov 14 08:57:16 grant-01 kernel:        00000101fa3ab450 0000000000001921 00000101fa3aabe0 00000101fa3ab738 
>Nov 14 08:57:16 grant-01 kernel:        00000101fa3ab450 000001021559fea8 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa029615a>{:dlm:dlm_read+451} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff8018f32b>{vfs_read+207} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8018f587>{sys_read+69} <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: clvmd         S 00000101ed453e28     0 17316      1         21219 17315 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101ed453ce8 0000000000000006 00000100dfeeda28 00000101ed453ea8 
>Nov 14 08:57:16 grant-01 kernel:        00000101fa3aabe0 000000000000029c ffffffff8042f980 00000101fa3aaec8 
>Nov 14 08:57:16 grant-01 kernel:        fffffffffffffff4 0000010207137c50 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803610ee>{schedule_timeout+260} <ffffffff8021dfe5>{vsnprintf+848} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801370c6>{autoremove_wake_function+0} <ffffffff8017ee5f>{find_extend_vma+22} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80157723>{get_futex_key+72} <ffffffff801584b5>{do_futex+685} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff80158ab7>{sys_futex+204} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126} 
>Nov 14 08:57:16 grant-01 kernel: dlm_astd      S 0000000000000000     0 17289      3         17290 17233 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010217eabe88 0000000000000046 ffffffff8042f980 00000072ea453390 
>Nov 14 08:57:16 grant-01 kernel:        00000101ea453390 00000000000000ff ffffffff8042f980 00000101ea453678 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000246 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa03488e3>{:lock_dlm:lock_bast+0} <ffffffffa0294a76>{:dlm:dlm_astd+385} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02948f5>{:dlm:dlm_astd+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: dlm_recvd     S 000023c11fb3f910     0 17290      3         17291 17289 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101fde59ec8 0000000000000046 0000000000000000 0000006900000000 
>Nov 14 08:57:16 grant-01 kernel:        000001021df08ce0 0000000000000128 00000101ea453390 000001021df08fc8 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000000 0000000000000000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa029f03c>{:dlm:dlm_recvd+388} <ffffffffa029eeb8>{:dlm:dlm_recvd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: dlm_sendd     S 0000000000000001     0 17291      3         17292 17290 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101e4153e88 0000000000000046 ffffffff8042f980 00000069074df730 
>Nov 14 08:57:16 grant-01 kernel:        000001021e3c8430 0000000000000045 ffffffff8042f980 000001021e3c8718 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000000 00000101074df730 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff80320ffc>{tcp_sendpage+0} <ffffffffa029f7c7>{:dlm:dlm_sendd+653} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa029f53a>{:dlm:dlm_sendd+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 000006dfa20678a0     0 17292      3         21201 17291 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101e29c1ea8 0000000000000046 0000000000000018 0000007300000246 
>Nov 14 08:57:16 grant-01 kernel:        0000010002b520f0 0000000000006de0 000001020d3f81b0 0000010002b523d8 
>Nov 14 08:57:16 grant-01 kernel:        000001020421d340 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 0000090b435d6cd8     0 21201      3         21216 17292 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101d786fea8 0000000000000046 00000101ebe133d0 0000007300000246 
>Nov 14 08:57:16 grant-01 kernel:        00000101fa0c5290 00000000000003a9 000001020d3f81b0 00000101fa0c5578 
>Nov 14 08:57:16 grant-01 kernel:        00000101ce323ea0 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 0000000000000000     0 21216      3         21217 21201 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101ffeddea8 0000000000000046 0000000000000000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel:        00000101b632e270 0000000000004d46 ffffffff8042f980 00000101b632e558 
>Nov 14 08:57:16 grant-01 kernel:        00000101ce3239c0 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: lock_dlm1     S 0000010210d19800     0 21217      3         21218 21216 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010204d19e68 0000000000000046 ffffff00103ba000 0000006900000000 
>Nov 14 08:57:16 grant-01 kernel:        000001018e937390 000000000000001e 0000010214bcee20 000001018e937678 
>Nov 14 08:57:16 grant-01 kernel:        000001020ba640b8 0000000000000206 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: lock_dlm2     S 0000010210d19800     0 21218      3         21240 21217 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 000001020cb19e68 0000000000000046 0000010214bcf690 000000761754cc00 
>Nov 14 08:57:16 grant-01 kernel:        000001018e936b20 0000000000000019 000001021207ca20 000001018e936e08 
>Nov 14 08:57:16 grant-01 kernel:        000001020ba64040 0000000000000003 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_scand     R  running task       0 21219      1         21229 17316 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_glockd    S 00000950bc9ff51d     0 21229      1         21230 21219 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000102067a3ed8 0000000000000046 0000010211c4bb80 00000069a02d0925 
>Nov 14 08:57:16 grant-01 kernel:        0000010217c701f0 000000000000126e 00000101ea453390 0000010217c704d8 
>Nov 14 08:57:16 grant-01 kernel:        0000010211c4bb80 ffffff00103ba000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02c089b>{:gfs:gfs_glockd+184} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c07e3>{:gfs:gfs_glockd+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_recoverd  S 000000010360237f     0 21230      1         21231 21229 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101f981fe78 0000000000000046 ffffffff8042f980 0000007480134735 
>Nov 14 08:57:16 grant-01 kernel:        00000101fa3aa370 00000000000000ff ffffffff8042f980 00000101fa3aa658 
>Nov 14 08:57:16 grant-01 kernel:        0000000000001b4e 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c0a28>{:gfs:gfs_recoverd+341} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80297711>{cfq_remove_request+0} <ffffffffa02c08d3>{:gfs:gfs_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_logd      R  running task       0 21231      1         21232 21230 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_quotad    R  running task       0 21232      1         21233 21231 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_inoded    S 000033d4a89909ad     0 21233      1         21243 21232 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101d8edbe78 0000000000000046 ffffffff8042f980 0000007380134735 
>Nov 14 08:57:16 grant-01 kernel:        0000010203c102f0 00000000000000fb 0000010203c10b60 0000010203c105d8 
>Nov 14 08:57:16 grant-01 kernel:        ffffff00103ba000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c11f7>{:gfs:gfs_inoded+339} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c10a4>{:gfs:gfs_inoded+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 0000000000000000     0 21240      3         21241 21218 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101eae0dea8 0000000000000046 0000000000000000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel:        00000101f23f2330 000000000000077d ffffffff8042f980 00000101f23f2618 
>Nov 14 08:57:16 grant-01 kernel:        00000102140c63e8 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: lock_dlm1     S 0000010210d19c00     0 21241      3         21242 21240 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101952dde68 0000000000000046 000001020fd2cbe0 0000006a00000000 
>Nov 14 08:57:16 grant-01 kernel:        000001020fd2d450 0000000000000031 ffffffff8042f980 000001020fd2d738 
>Nov 14 08:57:16 grant-01 kernel:        0000010215503bf8 0000000000000202 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: lock_dlm2     S 0000010210d19c00     0 21242      3         21255 21241 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010215795e68 0000000000000046 ffffff00103e4000 0000006a00000000 
>Nov 14 08:57:16 grant-01 kernel:        000001020fd2cbe0 000000000000001a 000001020fd2d450 000001020fd2cec8 
>Nov 14 08:57:16 grant-01 kernel:        00000101cee727c0 0000000000000206 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_scand     R  running task       0 21243      1         21244 21233 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_glockd    S 0000095010201131     0 21244      1         21245 21243 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010208a91ed8 0000000000000046 000001020c4bf5e0 00000069a02d0925 
>Nov 14 08:57:16 grant-01 kernel:        000001020fbcb490 00000000000016a6 00000101ea453390 000001020fbcb778 
>Nov 14 08:57:16 grant-01 kernel:        000001020c4bf5e0 ffffff00103e4000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02c089b>{:gfs:gfs_glockd+184} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c07e3>{:gfs:gfs_glockd+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_recoverd  S 0000000103602bbb     0 21245      1         21246 21244 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101f9681e78 0000000000000046 ffffffff8042f980 0000007480134735 
>Nov 14 08:57:16 grant-01 kernel:        000001020fbcac20 00000000000000d7 ffffffff8042f980 000001020fbcaf08 
>Nov 14 08:57:16 grant-01 kernel:        0000000000001766 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c0a28>{:gfs:gfs_recoverd+341} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80297711>{cfq_remove_request+0} <ffffffffa02c08d3>{:gfs:gfs_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_logd      R  running task       0 21246      1         21247 21245 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_quotad    R  running task       0 21247      1         21248 21246 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_inoded    S 000033d52630093e     0 21248      1         21267 21247 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010215555e78 0000000000000046 ffffffff8042f980 0000007300000000 
>Nov 14 08:57:16 grant-01 kernel:        00000102081b0c60 0000000000000118 00000102081b14d0 00000102081b0f48 
>Nov 14 08:57:16 grant-01 kernel:        000001021a8fbe58 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c11f7>{:gfs:gfs_inoded+339} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c10a4>{:gfs:gfs_inoded+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 00000908a37ebd61     0 21255      3         21265 21242 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 000001020f64fea8 0000000000000046 0000000000000000 0000007300000246 
>Nov 14 08:57:16 grant-01 kernel:        00000101ecc44ca0 0000000000000833 000001020d3f81b0 00000101ecc44f88 
>Nov 14 08:57:16 grant-01 kernel:        0000010217fadbf0 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: lock_dlm1     S 00000101d8fbf800     0 21265      3         21266 21255 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 000001020a58be68 0000000000000046 00000101b632eae0 0000006900000004 
>Nov 14 08:57:16 grant-01 kernel:        00000101b632f350 000000000000001f 00000101b632eae0 00000101b632f638 
>Nov 14 08:57:16 grant-01 kernel:        00000000000000c2 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: lock_dlm2     S 00000101d8fbf800     0 21266      3         21279 21265 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010214265e68 0000000000000046 00000101b632f350 0000007600000000 
>Nov 14 08:57:16 grant-01 kernel:        00000101b632eae0 0000000000000020 000001021207ca20 00000101b632edc8 
>Nov 14 08:57:16 grant-01 kernel:        00000000000000c2 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_scand     R  running task       0 21267      1         21268 21248 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_glockd    S 00000950ab56db63     0 21268      1         21269 21267 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101f21e7ed8 0000000000000046 00000101ec1b5040 00000069a02d0925 
>Nov 14 08:57:16 grant-01 kernel:        00000101da153550 0000000000001476 00000101ea453390 00000101da153838 
>Nov 14 08:57:16 grant-01 kernel:        00000101ec1b5040 ffffff001040e000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02c089b>{:gfs:gfs_glockd+184} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa00768e0>{:libata:ata_exec_command+0} <ffffffffa02c07e3>{:gfs:gfs_glockd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_recoverd  S 0000000103603606     0 21269      1         21270 21268 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101da151e78 0000000000000046 ffffffff8042f980 0000007680134735 
>Nov 14 08:57:16 grant-01 kernel:        00000101da152ce0 0000000000000123 ffffffff8042f980 00000101da152fc8 
>Nov 14 08:57:16 grant-01 kernel:        0000000000001b4e 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c0a28>{:gfs:gfs_recoverd+341} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80297711>{cfq_remove_request+0} <ffffffffa02c08d3>{:gfs:gfs_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_logd      R  running task       0 21270      1         21271 21269 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_quotad    R  running task       0 21271      1         21272 21270 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_inoded    S 000033d5c34f2203     0 21272      1         21300 21271 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101ed7c7e78 0000000000000046 ffffffff8042f980 00000073fb89ed20 
>Nov 14 08:57:16 grant-01 kernel:        00000101fb89ed20 0000000000000124 00000101fb89f590 00000101fb89f008 
>Nov 14 08:57:16 grant-01 kernel:        0000000000000246 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c11f7>{:gfs:gfs_inoded+339} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c10a4>{:gfs:gfs_inoded+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 000008f7d9ad563c     0 21279      3         21289 21266 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 000001016f579ea8 0000000000000046 0000000000000000 0000007300000246 
>Nov 14 08:57:16 grant-01 kernel:        00000102040f4d60 0000000000000d8b 000001020d3f81b0 00000102040f5048 
>Nov 14 08:57:16 grant-01 kernel:        00000101ec1b44e0 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: lock_dlm1     S 000001021339fc00     0 21289      3         21290 21279 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 000001020c6bbe68 0000000000000046 00000101f23f2ba0 0000006a1368ba00 
>Nov 14 08:57:16 grant-01 kernel:        00000101f23f3410 0000000000000020 00000101ea453390 00000101f23f36f8 
>Nov 14 08:57:16 grant-01 kernel:        0000010212d4a928 0000000000000206 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: lock_dlm2     S 000001021339fc00     0 21290      3         21312 21289 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010206053e68 0000000000000046 00000101f23f3410 000000691368b980 
>Nov 14 08:57:16 grant-01 kernel:        00000101f23f2ba0 000000000000001e 00000101f23f3410 00000101f23f2e88 
>Nov 14 08:57:16 grant-01 kernel:        00000102172e9928 0000000000000202 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_scand     R  running task       0 21300      1         21301 21272 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_glockd    S 000023be55f3985a     0 21301      1         21302 21300 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101d53bfed8 0000000000000046 00000102172e98b0 00000069a02d0925 
>Nov 14 08:57:16 grant-01 kernel:        00000101ecc45510 00000000000ccaaa 000001021e3c8430 00000101ecc457f8 
>Nov 14 08:57:16 grant-01 kernel:        00000102172e98b0 ffffff0010438000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02c089b>{:gfs:gfs_glockd+184} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c07e3>{:gfs:gfs_glockd+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_recoverd  S 000000010360405c     0 21302      1         21303 21301 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010212db1e78 0000000000000046 ffffffff8042f980 0000007b80134735 
>Nov 14 08:57:16 grant-01 kernel:        00000102040f44f0 0000000000000100 ffffffff8042f980 00000102040f47d8 
>Nov 14 08:57:16 grant-01 kernel:        0000000000001b4e 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c0a28>{:gfs:gfs_recoverd+341} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80297711>{cfq_remove_request+0} <ffffffffa02c08d3>{:gfs:gfs_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_logd      R  running task       0 21303      1         21304 21302 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_quotad    R  running task       0 21304      1         21305 21303 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_inoded    S 000033d66106ce23     0 21305      1         21315 21304 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010210f65e78 0000000000000046 ffffffff8042f980 0000007300000000 
>Nov 14 08:57:16 grant-01 kernel:        0000010206050530 000000000000011d 0000010206050da0 0000010206050818 
>Nov 14 08:57:16 grant-01 kernel:        ffffff0010438000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c11f7>{:gfs:gfs_inoded+339} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c10a4>{:gfs:gfs_inoded+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 0000000000000000     0 21312      3         21313 21290 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010214bcdea8 0000000000000046 0000000000000000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel:        00000101ce2e8570 00000000000007a0 ffffffff8042f980 00000101ce2e8858 
>Nov 14 08:57:16 grant-01 kernel:        00000101e57e5cb0 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: lock_dlm1     S 000001016ac74000     0 21313      3         21314 21312 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 000001018ec41e68 0000000000000046 0000010214bcee20 0000006918174d00 
>Nov 14 08:57:16 grant-01 kernel:        0000010214bcf690 0000000000000048 00000101ce2e8de0 0000010214bcf978 
>Nov 14 08:57:16 grant-01 kernel:        00000101f82d5658 0000000000000206 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: lock_dlm2     S 000001016ac74000     0 21314      3         21327 21313 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 000001019a849e68 0000000000000046 000001021370f040 00000069120d6980 
>Nov 14 08:57:16 grant-01 kernel:        0000010214bcee20 000000000000001b 0000010214bcf690 0000010214bcf108 
>Nov 14 08:57:16 grant-01 kernel:        000001021370f0b8 0000000000000202 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_scand     R  running task       0 21315      1         21316 21305 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_glockd    S 000023bdab5aec45     0 21316      1         21317 21315 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101e1ddbed8 0000000000000046 000001021370f040 00000069a02d0925 
>Nov 14 08:57:16 grant-01 kernel:        00000101e1dd96d0 00000000000bfc79 000001021e3c8430 00000101e1dd99b8 
>Nov 14 08:57:16 grant-01 kernel:        000001021370f040 ffffff0010462000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02c089b>{:gfs:gfs_glockd+184} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c07e3>{:gfs:gfs_glockd+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_recoverd  S 00000001036048be     0 21317      1         21318 21316 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101fd68fe78 0000000000000046 ffffffff8042f980 0000007680134735 
>Nov 14 08:57:16 grant-01 kernel:        00000101e1dd8e60 0000000000000111 ffffffff8042f980 00000101e1dd9148 
>Nov 14 08:57:16 grant-01 kernel:        0000000000001b4e 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c0a28>{:gfs:gfs_recoverd+341} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80297711>{cfq_remove_request+0} <ffffffffa02c08d3>{:gfs:gfs_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_logd      R  running task       0 21318      1         21319 21317 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_quotad    R  running task       0 21319      1         21320 21318 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_inoded    R  running task       0 21320      1         21339 21319 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 000008faf0955f05     0 21327      3         21337 21314 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010218111ea8 0000000000000046 0000000000000000 0000007300000246 
>Nov 14 08:57:16 grant-01 kernel:        00000101e3b20ee0 0000000000000dbb 000001020d3f81b0 00000101e3b211c8 
>Nov 14 08:57:16 grant-01 kernel:        0000010215a6d4a0 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: lock_dlm1     S 000001021339f000     0 21337      3         21338 21327 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101fb89de68 0000000000000046 0000010212565748 0000006912768980 
>Nov 14 08:57:16 grant-01 kernel:        00000101fb89e4b0 0000000000000017 00000102040f55d0 00000101fb89e798 
>Nov 14 08:57:16 grant-01 kernel:        00000102125657c0 0000000000000202 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: lock_dlm2     S 000001021339f000     0 21338      3         21351 21337 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101cd7d3e68 0000000000000046 00000101fb89e4b0 00000069120d6a00 
>Nov 14 08:57:16 grant-01 kernel:        00000102040f55d0 0000000000000039 00000101ce2e8de0 00000102040f58b8 
>Nov 14 08:57:16 grant-01 kernel:        00000101f4ed2928 0000000000000206 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_scand     R  running task       0 21339      1         21340 21320 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_glockd    S 000023be2baf9830     0 21340      1         21341 21339 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010205fdfed8 0000000000000046 0000010212565748 00000069a02d0925 
>Nov 14 08:57:16 grant-01 kernel:        000001020171d110 00000000000baa34 000001021e3c8430 000001020171d3f8 
>Nov 14 08:57:16 grant-01 kernel:        0000010212565748 ffffff001048c000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02c089b>{:gfs:gfs_glockd+184} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa00768e0>{:libata:ata_exec_command+0} <ffffffffa02c07e3>{:gfs:gfs_glockd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_recoverd  S 0000000103605125     0 21341      1         21342 21340 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101a5d25e78 0000000000000046 ffffffff8042f980 0000007680134735 
>Nov 14 08:57:16 grant-01 kernel:        000001020171c8a0 00000000000000a7 ffffffff8042f980 000001020171cb88 
>Nov 14 08:57:16 grant-01 kernel:        0000000000001b4e 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c0a28>{:gfs:gfs_recoverd+341} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80297711>{cfq_remove_request+0} <ffffffffa02c08d3>{:gfs:gfs_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_logd      R  running task       0 21342      1         21343 21341 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_quotad    R  running task       0 21343      1         21344 21342 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_inoded    R  running task       0 21344      1         21363 21343 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: dlm_recoverd  S 0000000000000000     0 21351      3         21361 21338 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000102111d9ea8 0000000000000046 0000000000000000 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel:        00000101ed850920 0000000000000767 ffffffff8042f980 00000101ed850c08 
>Nov 14 08:57:16 grant-01 kernel:        0000010217e25c70 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02a840e>{:dlm:dlm_recoverd+58} <ffffffffa02a83d4>{:dlm:dlm_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156bbf>{kthread+188} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115cb>{child_rip+8} <ffffffff80150e73>{worker_thread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156be8>{keventd_create_kthread+0} <ffffffff80156b03>{kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: lock_dlm1     S 0000010216cff800     0 21361      3         21362 21351 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 0000010189cade68 0000000000000046 00000101ce2e8de0 000000691754e700 
>Nov 14 08:57:16 grant-01 kernel:        00000101ce2e9650 000000000000002d ffffffff8042f980 00000101ce2e9938 
>Nov 14 08:57:16 grant-01 kernel:        000001021778f7c0 0000000000000206 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: lock_dlm2     S 0000010216cff800     0 21362      3               21361 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101f1593e68 0000000000000046 00000101ce2e9650 000000691368cf00 
>Nov 14 08:57:16 grant-01 kernel:        00000101ce2e8de0 000000000000002a 00000101ce2e9650 00000101ce2e90c8 
>Nov 14 08:57:16 grant-01 kernel:        0000010217eee388 0000000000000206 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa034dcc0>{:lock_dlm:dlm_async+361} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034db57>{:lock_dlm:dlm_async+0} <ffffffff80156bbf>{kthread+188} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80150e73>{worker_thread+0} <ffffffff80156be8>{keventd_create_kthread+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80156b03>{kthread+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_scand     R  running task       0 21363      1         21364 21344 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_glockd    S 000023c11d4c4433     0 21364      1         21365 21363 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 000001019ed61ed8 0000000000000046 0000010217eee310 00000069a02d0925 
>Nov 14 08:57:16 grant-01 kernel:        000001020ed791d0 00000000000174e4 000001021e3c8430 000001020ed794b8 
>Nov 14 08:57:16 grant-01 kernel:        0000010217eee310 ffffff00104b6000 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffffa02c089b>{:gfs:gfs_glockd+184} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c07e3>{:gfs:gfs_glockd+0} <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel:        
>Nov 14 08:57:16 grant-01 kernel: gfs_recoverd  S 000033cd8499dcb0     0 21365      1         21366 21364 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101ebdd7e78 0000000000000046 000001020ed7a9a0 0000007380134735 
>Nov 14 08:57:16 grant-01 kernel:        000001020ed78960 00000000000000ea 000001020ed7b210 000001020ed78c48 
>Nov 14 08:57:16 grant-01 kernel:        0000000000001b4e 0000000000000246 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff803611a7>{schedule_timeout+445} <ffffffff801457bf>{process_timeout+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02c0a28>{:gfs:gfs_recoverd+341} <ffffffff801115cb>{child_rip+8} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff802b2090>{ide_outsw+0} <ffffffffa02c08d3>{:gfs:gfs_recoverd+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801115c3>{child_rip+0} 
>Nov 14 08:57:16 grant-01 kernel: gfs_logd      R  running task       0 21366      1         21367 21365 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_quotad    R  running task       0 21367      1         21368 21366 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: gfs_inoded    R  running task       0 21368      1               21367 (L-TLB)
>Nov 14 08:57:16 grant-01 kernel: qarshd        R  running task       0 21399   3161 21400          4700 (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: umount        D 0000090b435b5e79     0 21400  21399                     (NOTLB)
>Nov 14 08:57:16 grant-01 kernel: 00000101f1955d08 0000000000000006 ffffffff804c6b20 000000698035fc0c 
>Nov 14 08:57:16 grant-01 kernel:        00000101ed851190 000000000000469b 00000101ebe133d0 00000101ed851478 
>Nov 14 08:57:16 grant-01 kernel:        00000101fa0c41b0 00000101ed851478 
>Nov 14 08:57:16 grant-01 kernel: Call Trace:<ffffffff8035ffec>{wait_for_completion+312} <ffffffff801355dd>{default_wake_function+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801355dd>{default_wake_function+0} <ffffffffa027fc7b>{:cman:kcl_leave_service+243} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa029d1e0>{:dlm:release_lockspace+157} <ffffffffa034a325>{:lock_dlm:release_gdlm+15} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa034ab3f>{:lock_dlm:lm_dlm_unmount+54} <ffffffffa02bb383>{:lock_harness:lm_unmount+61} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffffa02dd7c2>{:gfs:gfs_lm_unmount+32} <ffffffffa02ee543>{:gfs:gfs_put_super+787} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff801965c7>{generic_shutdown_super+334} <ffffffffa02eba74>{:gfs:gfs_kill_sb+41} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80196460>{deactivate_super+220} <ffffffff801b6c09>{sys_umount+1822} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff8019b9b7>{sys_newstat+17} <ffffffff80111415>{error_exit+0} 
>Nov 14 08:57:16 grant-01 kernel:        <ffffffff80110a92>{system_call+126}

Actions: View

Attachments on bug 382621: 258181