Attachment 915143 Details for Bug 450194 – Comment

Comment

comment_1758914.txt (text/plain), 227.60 KB, created by Issue Tracker on 2008-06-05 20:10:29 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Issue Tracker

Created: 2008-06-05 20:10:29 UTC

Size: 227.60 KB

patch

obsolete

>Another hit, this time grabbed sysrq-t 
>
>
>2008-05-08 13:53:01 BUG: soft lockup - CPU#1 stuck for 10s!
>[cp2k.popt:6790]
>2008-05-08 13:53:01 CPU 1:
>2008-05-08 13:53:01 Modules linked in: job(U) w83627hf hwmon_vid i2c_isa
>ib_ipoib rdma_ucm rdma_cm iw_cm ib_addr ib_ucm ib_uverbs ib_umad ib_mthca
>ib_cm ib_sa ib_mad ib_core ipv6 xfrm_nalgo crypto_api sd_mod sg dm_mirror
>dm_multipath dm_mod video sbs backlight i2c_ec button battery asus_acpi
>acpi_memhotplug ac parport_pc lp parport joydev usb_storage floppy sata_nv
>pcspkr libata ohci_hcd scsi_mod i2c_nforce2 i2c_core k8temp hwmon k8_edac
>edac_mc shpchp serio_raw nfs nfs_acl lockd fscache sunrpc e1000
>2008-05-08 13:53:01 Pid: 6790, comm: cp2k.popt Tainted: G     
>2.6.18-92.el5 #1
>2008-05-08 13:53:01 RIP: 0010:[<ffffffff8002e7ff>]  [<ffffffff8002e7ff>]
>prune_dcache+0x55/0x149
>2008-05-08 13:53:01 RSP: 0018:ffff8100a40d7a38  EFLAGS: 00000206
>2008-05-08 13:53:01 RAX: 0000000000000d49 RBX: ffff8103ea5b03d8 RCX:
>0000000000000001
>2008-05-08 13:53:01 RDX: ffff8103ea5b0418 RSI: ffffffff802f4080 RDI:
>ffffffff803c5480
>2008-05-08 13:53:01 RBP: ffff8101cbd94ed0 R08: ffff81000b5008e0 R09:
>ffff8101cbd94ed0
>2008-05-08 13:53:01 R10: 0000000000000246 R11: ffffffff80039784 R12:
>0000000000000246
>2008-05-08 13:53:01 R13: ffffffff80039784 R14: ffff8100a40d7a28 R15:
>0000000000000000
>2008-05-08 13:53:01 FS:  0000000040201940(0063) GS:ffff81000cd266c0(0000)
>knlGS:0000000000000000
>2008-05-08 13:53:01 CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>2008-05-08 13:53:01 CR2: 00002aaaab56b0f4 CR3: 00000000a4a62000 CR4:
>00000000000006e0
>2008-05-08 13:53:01 
>2008-05-08 13:53:01 Call Trace:
>2008-05-08 13:53:01  [<ffffffff8002e7d7>] prune_dcache+0x2d/0x149
>2008-05-08 13:53:01  [<ffffffff8004cd59>] shrink_dcache_parent+0x68/0xe1
>2008-05-08 13:53:01  [<ffffffff8004cd0d>] shrink_dcache_parent+0x1c/0xe1
>2008-05-08 13:53:01  [<ffffffff8808f41b>]
>:nfs:nfs_lookup_revalidate+0x35c/0x416
>2008-05-08 13:53:01  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:01  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:01  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:01  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:01  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:01  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:01  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:01  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:01  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:01  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:01  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:01  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:01  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:01  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:01  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:01  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:01  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:01  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:01  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:01 
>2008-05-08 13:53:11 BUG: soft lockup - CPU#1 stuck for 10s!
>[cp2k.popt:6790]
>2008-05-08 13:53:11 CPU 1:
>2008-05-08 13:53:11 Modules linked in: job(U) w83627hf hwmon_vid i2c_isa
>ib_ipoib rdma_ucm rdma_cm iw_cm ib_addr ib_ucm ib_uverbs ib_umad ib_mthca
>ib_cm ib_sa ib_mad ib_core ipv6 xfrm_nalgo crypto_api sd_mod sg dm_mirror
>dm_multipath dm_mod video sbs backlight i2c_ec button battery asus_acpi
>acpi_memhotplug ac parport_pc lp parport joydev usb_storage floppy sata_nv
>pcspkr libata ohci_hcd scsi_mod i2c_nforce2 i2c_core k8temp hwmon k8_edac
>edac_mc shpchp serio_raw nfs nfs_acl lockd fscache sunrpc e1000
>2008-05-08 13:53:11 Pid: 6790, comm: cp2k.popt Tainted: G     
>2.6.18-92.el5 #1
>2008-05-08 13:53:11 RIP: 0010:[<ffffffff8002e7ff>]  [<ffffffff8002e7ff>]
>prune_dcache+0x55/0x149
>2008-05-08 13:53:11 RSP: 0018:ffff8100a40d7a38  EFLAGS: 00000206
>2008-05-08 13:53:11 RAX: 0000000000000e59 RBX: ffff8100a16bf9c0 RCX:
>0000000000000001
>2008-05-08 13:53:11 RDX: ffff8100a16bfa00 RSI: ffffffff802f4080 RDI:
>ffffffff803c5480
>2008-05-08 13:53:11 RBP: ffff8101cbd94ed0 R08: ffff81000b5008e0 R09:
>ffff8101cbd94ed0
>2008-05-08 13:53:11 R10: 0000000000000246 R11: ffffffff80039784 R12:
>0000000000000246
>2008-05-08 13:53:11 R13: ffffffff80039784 R14: ffffffff802f4080 R15:
>0000000000000000
>2008-05-08 13:53:11 FS:  0000000040201940(0063) GS:ffff81000cd266c0(0000)
>knlGS:0000000000000000
>2008-05-08 13:53:11 CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>2008-05-08 13:53:11 CR2: 00002aaaab56b0f4 CR3: 00000000a4a62000 CR4:
>00000000000006e0
>2008-05-08 13:53:11 
>2008-05-08 13:53:11 Call Trace:
>2008-05-08 13:53:11  [<ffffffff8002e7d7>] prune_dcache+0x2d/0x149
>2008-05-08 13:53:11  [<ffffffff8004cd59>] shrink_dcache_parent+0x68/0xe1
>2008-05-08 13:53:11  [<ffffffff8004cd0d>] shrink_dcache_parent+0x1c/0xe1
>2008-05-08 13:53:11  [<ffffffff8808f41b>]
>:nfs:nfs_lookup_revalidate+0x35c/0x416
>2008-05-08 13:53:11  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:11  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:11  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:11  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:11  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:11  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:11  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:11  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:11  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:11  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:11  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:11  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:11  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:11  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:11  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:11  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:11  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:11  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:11  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:11 
>2008-05-08 13:53:11 BUG: soft lockup - CPU#0 stuck for 10s! [crond:5947]
>2008-05-08 13:53:11 CPU 0:
>2008-05-08 13:53:11 Modules linked in: job(U) w83627hf hwmon_vid i2c_isa
>ib_ipoib rdma_ucm rdma_cm iw_cm ib_addr ib_ucm ib_uverbs ib_umad ib_mthca
>ib_cm ib_sa ib_mad ib_core ipv6 xfrm_nalgo crypto_api sd_mod sg dm_mirror
>dm_multipath dm_mod video sbs backlight i2c_ec button battery asus_acpi
>acpi_memhotplug ac parport_pc lp parport joydev usb_storage floppy sata_nv
>pcspkr libata ohci_hcd scsi_mod i2c_nforce2 i2c_core k8temp hwmon k8_edac
>edac_mc shpchp serio_raw nfs nfs_acl lockd fscache sunrpc e1000
>2008-05-08 13:53:11 Pid: 5947, comm: crond Tainted: G      2.6.18-92.el5
>#1
>2008-05-08 13:53:11 RIP: 0010:[<ffffffff80064b54>]  [<ffffffff80064b54>]
>.text.lock.spinlock+0x2/0x30
>2008-05-08 13:53:11 RSP: 0018:ffff8102fd16fe20  EFLAGS: 00000286
>2008-05-08 13:53:11 RAX: ffff81000cf3ac00 RBX: ffffffff802f4610 RCX:
>0000000000000000
>2008-05-08 13:53:11 RDX: ffff81008d5e62dc RSI: ffffffff8028b4bb RDI:
>ffffffff803c5480
>2008-05-08 13:53:11 RBP: 00000000ffffffe9 R08: ffff8100cefdec00 R09:
>ffff81020385a000
>2008-05-08 13:53:11 R10: 0000000000000246 R11: 000000d0fd16fea8 R12:
>ffff8102fd16fea8
>2008-05-08 13:53:11 R13: ffff8102fd16fea8 R14: ffffffff8005bdf0 R15:
>ffff8100c4872c80
>2008-05-08 13:53:11 FS:  00002aaaabf29b30(0000) GS:ffffffff8039e000(0000)
>knlGS:0000000000000000
>2008-05-08 13:53:11 CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>2008-05-08 13:53:12 CR2: 00002aaaab56b0f4 CR3: 00000002fd4f5000 CR4:
>00000000000006e0
>2008-05-08 13:53:12 
>2008-05-08 13:53:12 Call Trace:
>2008-05-08 13:53:12  [<ffffffff80022655>] d_alloc+0x166/0x1a9
>2008-05-08 13:53:12  [<ffffffff800e88e6>] dcache_dir_open+0x0/0x26
>2008-05-08 13:53:12  [<ffffffff800e88fa>] dcache_dir_open+0x14/0x26
>2008-05-08 13:53:12  [<ffffffff8001e336>] __dentry_open+0xd9/0x1dc
>2008-05-08 13:53:12  [<ffffffff80027338>] do_filp_open+0x2a/0x38
>2008-05-08 13:53:12  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:12  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:12 
>
><ConMan> Console [chimp6] joined by <root@localhost> on pts/1 at 05-08
>13:53.
>2008-05-08 13:53:16 SysRq : Show State
>2008-05-08 13:53:16 
>2008-05-08 13:53:16                                                       
>sibling
>2008-05-08 13:53:16   task                 PC          pid father child
>younger older
>2008-05-08 13:53:16 init          D ffff8100b566b001     0     1      0   
> 2               (NOTLB)
>2008-05-08 13:53:16  ffff81000cd35b38 0000000000000086 0000000000000000
>ffff81000cd35f50
>2008-05-08 13:53:16  0000000000000000 000000000000000a ffff8103038a3040
>ffffffff802e3ae0
>2008-05-08 13:53:16  000001b87c416aee 0000000000004f51 ffff8103038a3228
>000000000cd35dd0
>2008-05-08 13:53:16 Call Trace:
>2008-05-08 13:53:16  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:16  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:16  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:16  [<ffffffff8802f98a>]
>:sunrpc:rpcauth_lookup_credcache+0x12e/0x24c
>2008-05-08 13:53:16  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:16  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:16  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:16  [<ffffffff8809018a>] :nfs:nfs_permission+0xad/0x1cb
>2008-05-08 13:53:16  [<ffffffff8000cb46>] do_lookup+0x65/0x1d4
>2008-05-08 13:53:16  [<ffffffff8000d5ab>] permission+0x81/0xc8
>2008-05-08 13:53:16  [<ffffffff800096e5>] __link_path_walk+0x173/0xf42
>2008-05-08 13:53:16  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:16  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:16  [<ffffffff800122d3>] getname+0x15b/0x1c1
>2008-05-08 13:53:16  [<ffffffff800236c7>] __user_walk_fd+0x37/0x4c
>2008-05-08 13:53:16  [<ffffffff800285de>] vfs_stat_fd+0x1b/0x4a
>2008-05-08 13:53:16  [<ffffffff800233f9>] sys_newstat+0x19/0x31
>2008-05-08 13:53:16  [<ffffffff800162cb>] sys_select+0x11c/0x17c
>2008-05-08 13:53:16  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:16 
>2008-05-08 13:53:16 migration/0   S ffff81010396d7a0     0     2      1   
>         3       (L-TLB)
>2008-05-08 13:53:16  ffff8103038c3ea0 0000000000000046 0000000000000080
>0000000000000000
>2008-05-08 13:53:16  0000000000000000 0000000000000001 ffff81020389c040
>ffff81010396d7a0
>2008-05-08 13:53:17  000001bd0212a721 0000000000001651 ffff81020389c228
>0000000000000001
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff80044784>] migration_thread+0x1a4/0x23c
>2008-05-08 13:53:17  [<ffffffff800445e0>] migration_thread+0x0/0x23c
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 ksoftirqd/0   S 0000000000000000     0     3      1   
>         4     2 (L-TLB)
>2008-05-08 13:53:17  ffff8102038a5ed0 0000000000000046 ffff8101038a7040
>ffff8101ff00c7e0
>2008-05-08 13:53:17  0000000f6dac2d53 000000000000000a ffff8101038a7040
>ffffffff802e3ae0
>2008-05-08 13:53:17  000000c91f770ac8 000000000000094e ffff8101038a7228
>000000008008a335
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
>2008-05-08 13:53:17  [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 watchdog/0    S 0000000000000000     0     4      1   
>         5     3 (L-TLB)
>2008-05-08 13:53:17  ffff8101038c5ec0 0000000000000046 0000000000000001
>ffffffff80062efb
>2008-05-08 13:53:17  ffff81000b4f6478 0000000000000001 ffff81000cd337a0
>ffffffff802e3ae0
>2008-05-08 13:53:17  000001bdb4dd6d50 000000000000019a ffff81000cd33988
>00000000800a1eb9
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6f00>] watchdog+0x4f/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 migration/1   S 0000000000000001     0     5      1   
>         6     4 (L-TLB)
>2008-05-08 13:53:17  ffff81000cd39ea0 0000000000000046 ffff81000cd39ea0
>ffffffff8007553f
>2008-05-08 13:53:17  0000000000000008 0000000000000001 ffff8103038a37a0
>ffff8101038b4080
>2008-05-08 13:53:17  0000017175cd88d6 0000000000000d7c ffff8103038a3988
>0000000100000000
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:17  [<ffffffff80044784>] migration_thread+0x1a4/0x23c
>2008-05-08 13:53:17  [<ffffffff800445e0>] migration_thread+0x0/0x23c
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 ksoftirqd/1   S ffff81020389c7a0     0     6      1   
>         7     5 (L-TLB)
>2008-05-08 13:53:17  ffff8103038c7ed0 0000000000000046 ffff81020389c7a0
>ffff8102fdd610c0
>2008-05-08 13:53:17  0000000fd82d9441 000000000000000a ffff81020389c7a0
>ffff81000cf64080
>2008-05-08 13:53:17  000001bd02131517 00000000000009fd ffff81020389c988
>000000018008a335
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
>2008-05-08 13:53:17  [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 watchdog/1    S 0000000000000000     0     7      1   
>         8     6 (L-TLB)
>2008-05-08 13:53:17  ffff8102038c7ec0 0000000000000046 0000000000000000
>ffffffff80062efb
>2008-05-08 13:53:17  ffff81000b4fe9f8 0000000000000009 ffff8101038a77a0
>ffff8101038b4080
>2008-05-08 13:53:17  000001bdb7206396 00000000000001ca ffff8101038a7988
>00000001800a1eb9
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6f00>] watchdog+0x4f/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff800471cd>] seq_puts+0xf/0x46
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 migration/2   S ffff8102038b6080     0     8      1   
>         9     7 (L-TLB)
>2008-05-08 13:53:17  ffff8103038cfea0 0000000000000046 ffff8103038cfea0
>ffffffff8007553f
>2008-05-08 13:53:17  0000000000000010 0000000000000001 ffff8102038b6080
>ffff81000cf53860
>2008-05-08 13:53:17  000001906f391944 0000000000000ffe ffff8102038b6268
>0000000200000000
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:17  [<ffffffff80044784>] migration_thread+0x1a4/0x23c
>2008-05-08 13:53:17  [<ffffffff800445e0>] migration_thread+0x0/0x23c
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 ksoftirqd/2   S 0000000000000000     0     9      1   
>        10     8 (L-TLB)
>2008-05-08 13:53:17  ffff8102038e9ed0 0000000000000046 ffff8101038b47e0
>ffff8102ff4530c0
>2008-05-08 13:53:17  0000000fcaa16fb0 000000000000000a ffff8101038b47e0
>ffff8103038b8080
>2008-05-08 13:53:17  000000696b6df5c9 0000000000000515 ffff8101038b49c8
>000000028008a335
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
>2008-05-08 13:53:17  [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 watchdog/2    S 0000000000000000     0    10      1   
>        11     9 (L-TLB)
>2008-05-08 13:53:17  ffff81010392bec0 0000000000000046 0000000000000000
>ffffffff80062efb
>2008-05-08 13:53:17  ffff810103841478 0000000000000009 ffff81000cd33040
>ffff8103038b8080
>2008-05-08 13:53:17  000001bdbdcb6d95 00000000000001cb ffff81000cd33228
>00000002800a1eb9
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6f00>] watchdog+0x4f/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 migration/3   S ffff81000cd3e7e0     0    11      1   
>        12    10 (L-TLB)
>2008-05-08 13:53:17  ffff810103935ea0 0000000000000046 ffff810103935ea0
>ffffffff8007553f
>2008-05-08 13:53:17  0000000000000080 0000000000000001 ffff81000cd3e7e0
>ffff8103f5f89100
>2008-05-08 13:53:17  000001455cda9262 0000000000002b12 ffff81000cd3e9c8
>0000000300000000
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:17  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:17  [<ffffffff80044784>] migration_thread+0x1a4/0x23c
>2008-05-08 13:53:17  [<ffffffff800445e0>] migration_thread+0x0/0x23c
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 ksoftirqd/3   S 0000000000000000     0    12      1   
>        13    11 (L-TLB)
>2008-05-08 13:53:17  ffff81000cd5bed0 0000000000000046 ffff8103038b87e0
>ffff8101ff040100
>2008-05-08 13:53:17  0000000dfb1a90f4 000000000000000a ffff8103038b87e0
>ffff81010396a0c0
>2008-05-08 13:53:17  000000186ec2432a 00000000000025f5 ffff8103038b89c8
>000000038008a335
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
>2008-05-08 13:53:17  [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 watchdog/3    R  running task       0    13      1    
>       14    12 (L-TLB)
>2008-05-08 13:53:17 migration/4   S ffff8102038b80c0     0    14      1   
>        15    13 (L-TLB)
>2008-05-08 13:53:17  ffff8103038f9ea0 0000000000000046 ffff8103038f9ea0
>ffffffff8007553f
>2008-05-08 13:53:17  0000000000000040 0000000000000001 ffff8102038b80c0
>ffff81000cf46080
>2008-05-08 13:53:17  000001906f56c784 00000000000011e3 ffff8102038b82a8
>0000000400000000
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:17  [<ffffffff80044784>] migration_thread+0x1a4/0x23c
>2008-05-08 13:53:17  [<ffffffff800445e0>] migration_thread+0x0/0x23c
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 ksoftirqd/4   S 0000000000000000     0    15      1   
>        16    14 (L-TLB)
>2008-05-08 13:53:17  ffff81020396fed0 0000000000000046 ffff81010396a820
>ffff81000cf2a7e0
>2008-05-08 13:53:17  0000000f5080209a 000000000000000a ffff81010396a820
>ffff8103038b90c0
>2008-05-08 13:53:17  00000018768e973c 00000000000006f4 ffff81010396aa08
>000000048008a335
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
>2008-05-08 13:53:17  [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 watchdog/4    S 0000000000000000     0    16      1   
>        17    15 (L-TLB)
>2008-05-08 13:53:17  ffff810103999ec0 0000000000000046 0000000000000000
>ffffffff80062efb
>2008-05-08 13:53:17  ffff810203841478 0000000000000009 ffff81000cd3e080
>ffff8103038b90c0
>2008-05-08 13:53:17  000001bdf9568230 0000000000000183 ffff81000cd3e268
>00000004800a1eb9
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6f00>] watchdog+0x4f/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 migration/5   S 0000000000000005     0    17      1   
>        18    16 (L-TLB)
>2008-05-08 13:53:17  ffff8101039a1ea0 0000000000000046 ffff8101039a1ea0
>ffffffff8007553f
>2008-05-08 13:53:17  0000000000000080 0000000000000001 ffff8100cec00820
>ffff81010396b100
>2008-05-08 13:53:17  000000c912ea78fd 00000000000012fd ffff8100cec00a08
>0000000500000000
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:17  [<ffffffff80044784>] migration_thread+0x1a4/0x23c
>2008-05-08 13:53:17  [<ffffffff800445e0>] migration_thread+0x0/0x23c
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 ksoftirqd/5   S 0000000000000000     0    18      1   
>        19    17 (L-TLB)
>2008-05-08 13:53:17  ffff81000cd9fed0 0000000000000046 ffff8103038b9820
>ffff8100cec90040
>2008-05-08 13:53:17  0000000fb15e247d 000000000000000a ffff8103038b9820
>ffff81010396b100
>2008-05-08 13:53:17  000000c91a0b0392 00000000000027d4 ffff8103038b9a08
>000000058008a335
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
>2008-05-08 13:53:17  [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 watchdog/5    S ffff8102038b8820     0    19      1   
>        20    18 (L-TLB)
>2008-05-08 13:53:17  ffff81030391bec0 0000000000000046 0000000000000000
>ffffffff80062efb
>2008-05-08 13:53:17  ffff8102038499f8 0000000000000009 ffff8102038b8820
>ffff8102fe7147a0
>2008-05-08 13:53:17  000001bdfc22b6df 00000000000001b2 ffff8102038b8a08
>00000005800a1eb9
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6f00>] watchdog+0x4f/0x5f
>2008-05-08 13:53:17  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 migration/6   S 0000000000000006     0    20      1   
>        21    19 (L-TLB)
>2008-05-08 13:53:17  ffff810303923ea0 0000000000000046 ffff810303923ea0
>ffffffff8007553f
>2008-05-08 13:53:17  0000000000000010 0000000000000001 ffff8102039c3100
>ffff81030395c100
>2008-05-08 13:53:17  00000171782301f2 00000000000007f8 ffff8102039c32e8
>0000000600000000
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:17  [<ffffffff80044784>] migration_thread+0x1a4/0x23c
>2008-05-08 13:53:17  [<ffffffff800445e0>] migration_thread+0x0/0x23c
>2008-05-08 13:53:17  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:17  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:17  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:17 
>2008-05-08 13:53:17 ksoftirqd/6   S ffff81010396b860     0    21      1   
>        22    20 (L-TLB)
>2008-05-08 13:53:17  ffff8102039f5ed0 0000000000000046 ffff8102039f5ee0
>0000000000000046
>2008-05-08 13:53:17  ffff81010396b860 000000000000000a ffff81010396b860
>ffff81000cf3d820
>2008-05-08 13:53:17  000000252522a2da 0000000000000807 ffff81010396ba48
>000000068008a335
>2008-05-08 13:53:17 Call Trace:
>2008-05-08 13:53:17  [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
>2008-05-08 13:53:17  [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 watchdog/6    S 0000000000000000     0    22      1   
>        23    21 (L-TLB)
>2008-05-08 13:53:18  ffff8101039c3ec0 0000000000000046 0000000000000000
>ffffffff80062efb
>2008-05-08 13:53:18  ffff810303841478 0000000000000009 ffff8100cec000c0
>ffff81030395c100
>2008-05-08 13:53:18  000001bdf9654a30 00000000000001cf ffff8100cec002a8
>00000006800a1eb9
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:18  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:18  [<ffffffff800b6f00>] watchdog+0x4f/0x5f
>2008-05-08 13:53:18  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8004d322>] proc_pident_lookup+0x122/0x38a
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 migration/7   S ffff8100cec03860     0    23      1   
>        24    22 (L-TLB)
>2008-05-08 13:53:18  ffff8101039cbea0 0000000000000046 ffff8101039cbea0
>ffffffff8007553f
>2008-05-08 13:53:18  0000000000000040 0000000000000001 ffff8100cec03860
>ffff8101ff92c040
>2008-05-08 13:53:18  000000696dbd3240 00000000000012b5 ffff8100cec03a48
>0000000700000000
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:18  [<ffffffff80044784>] migration_thread+0x1a4/0x23c
>2008-05-08 13:53:18  [<ffffffff800445e0>] migration_thread+0x0/0x23c
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 ksoftirqd/7   S 0000000000000000     0    24      1   
>        25    23 (L-TLB)
>2008-05-08 13:53:18  ffff81000cde3ed0 0000000000000046 ffff81030395c860
>ffff81000cf5a100
>2008-05-08 13:53:18  0000000fded7d9b4 000000000000000a ffff81030395c860
>ffff81010396d040
>2008-05-08 13:53:18  00000069640ac4f0 00000000000031f5 ffff81030395ca48
>000000078008a335
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800927b2>] ksoftirqd+0x0/0xbf
>2008-05-08 13:53:18  [<ffffffff800927ed>] ksoftirqd+0x3b/0xbf
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 watchdog/7    S 0000000000000000     0    25      1   
>        26    24 (L-TLB)
>2008-05-08 13:53:18  ffff8103039c9ec0 0000000000000046 0000000000000000
>ffffffff80062efb
>2008-05-08 13:53:18  ffff8103038499f8 0000000000000009 ffff8102039c3860
>ffff81010396d040
>2008-05-08 13:53:18  000001bdf25e4b8a 000000000000013f ffff8102039c3a48
>00000007800a1eb9
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:18  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:18  [<ffffffff800b6f00>] watchdog+0x4f/0x5f
>2008-05-08 13:53:18  [<ffffffff800b6eb1>] watchdog+0x0/0x5f
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 events/0      S 0000000000000000     0    26      1   
>        27    25 (L-TLB)
>2008-05-08 13:53:18  ffff8102ffe0de70 0000000000000046 0000000000000282
>ffffffff8001c5ea
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff81010396d7a0
>ffffffff802e3ae0
>2008-05-08 13:53:18  000001bdf03d01a2 000000000001e13d ffff81010396d988
>000000008002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff8001c5ea>] __mod_timer+0xb0/0xbe
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 events/1      S 0000000000000000     0    27      1   
>        28    26 (L-TLB)
>2008-05-08 13:53:18  ffff8101ffdbde70 0000000000000046 0000000000000000
>ffff8102ffe671c0
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff8100cec03100
>ffff8101038b4080
>2008-05-08 13:53:18  000001bd792511cf 0000000000013453 ffff8100cec032e8
>000000018002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 events/2      S 0000000000000000     0    28      1   
>        29    27 (L-TLB)
>2008-05-08 13:53:18  ffff8100ceefde70 0000000000000046 0000000000000001
>ffff81010385e940
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff8103ffda1040
>ffff8103038b8080
>2008-05-08 13:53:18  000001bdfb3f3635 0000000000006ec2 ffff8103ffda1228
>000000028002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 events/3      R  running task       0    29      1    
>       30    28 (L-TLB)
>2008-05-08 13:53:18 events/4      S 0000000000000000     0    30      1   
>        31    29 (L-TLB)
>2008-05-08 13:53:18  ffff8102ffe0fe70 0000000000000046 ffff8102e6961000
>ffff810203860b60
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff8101ffdbb080
>ffff8103038b90c0
>2008-05-08 13:53:18  000001bdfccad8ed 00000000000036ee ffff8101ffdbb268
>000000048002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 events/5      S ffff8100cefb37a0     0    31      1   
>        32    30 (L-TLB)
>2008-05-08 13:53:18  ffff8101ffddbe70 0000000000000046 0000000000001600
>0000000000000002
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff8100cefb37a0
>ffff8102fe7147a0
>2008-05-08 13:53:18  000001bdfbe624c2 0000000000006d9c ffff8100cefb3988
>000000058002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800d46a9>] cache_reap+0x0/0x219
>2008-05-08 13:53:18  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 events/6      S 0000000000000000     0    32      1   
>        33    31 (L-TLB)
>2008-05-08 13:53:18  ffff8100ceef9e70 0000000000000046 0000000000000003
>ffff81030384f4c0
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff8103ffda17a0
>ffff81030395c100
>2008-05-08 13:53:18  000001bdfc321217 0000000000005571 ffff8103ffda1988
>000000068002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 events/7      S 0000000000000000     0    33      1   
>        34    32 (L-TLB)
>2008-05-08 13:53:18  ffff8103ffdb3e70 0000000000000046 0000000000000003
>ffff81030384f140
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff8102ffdf27a0
>ffff81010396d040
>2008-05-08 13:53:18  000001bdfc31b363 000000000000387b ffff8102ffdf2988
>000000078002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 khelper       S 0000000000000000     0    34      1   
>       157    33 (L-TLB)
>2008-05-08 13:53:18  ffff8102ffe13e70 0000000000000046 000000000000003c
>ffff8102ffe12000
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff8101ffdbb7e0
>ffff8103038b8080
>2008-05-08 13:53:18  0000000ea57a9c4f 00000000000069ab ffff8101ffdbb9c8
>000000028002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 kthread       S 0000000000000000     0   157      1  
>171    3328    34 (L-TLB)
>2008-05-08 13:53:18  ffff8102ffe65e70 0000000000000046 0000000000001a5d
>ffff8103ffc5bcf8
>2008-05-08 13:53:18  0000000300000000 000000000000000a ffff8101ffdc90c0
>ffffffff802e3ae0
>2008-05-08 13:53:18  000001455cd92b26 00000000000011c6 ffff8101ffdc92a8
>000000008002e254
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 kblockd/0     S ffffffff8009dbca     0   171    157   
>       172       (L-TLB)
>2008-05-08 13:53:18  ffff8101ffe07e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:18  ffffffffffffffff 0000000000000005 ffff81000cf550c0
>ffffffff802e3ae0
>2008-05-08 13:53:18  0000000701ff4bc5 0000000000000a88 ffff81000cf552a8
>000000000b4f6400
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 kblockd/1     S ffffffff8009dbca     0   172    157   
>       173   171 (L-TLB)
>2008-05-08 13:53:18  ffff8100ceef1e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:18  ffffffffffffffff 0000000000000004 ffff810303a407e0
>ffff8101038b4080
>2008-05-08 13:53:18  0000000701ffbf20 0000000000000d5b ffff810303a409c8
>000000010b4fe980
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 kblockd/2     S ffff8101ffdc90c0     0   173    157   
>       174   172 (L-TLB)
>2008-05-08 13:53:18  ffff8103ffe43e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:18  ffffffffffffffff 0000000000000004 ffff810203a870c0
>ffff8101ffdc90c0
>2008-05-08 13:53:18  0000000702003b0e 0000000000000bfc ffff810203a872a8
>0000000203841400
>2008-05-08 13:53:18 Call Trace:
>2008-05-08 13:53:18  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:18  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:18  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:18  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:18  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:18  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:18  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:18  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:18 
>2008-05-08 13:53:18 kblockd/3     S ffffffff8009dbca     0   174    157   
>       175   173 (L-TLB)
>2008-05-08 13:53:18  ffff8102ffe1fe70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000004 ffff810103a4e0c0
>ffff81010396a0c0
>2008-05-08 13:53:19  000000070200be72 0000000000000c72 ffff810103a4e2a8
>0000000303849980
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 kblockd/4     S ffffffff8009dbca     0   175    157   
>       176   174 (L-TLB)
>2008-05-08 13:53:19  ffff8101ffe45e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000004 ffff81000cf55820
>ffff8103038b90c0
>2008-05-08 13:53:19  0000000702012ff3 00000000000009e4 ffff81000cf55a08
>0000000403841400
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 kblockd/5     S ffffffff8009dbca     0   176    157   
>       177   175 (L-TLB)
>2008-05-08 13:53:19  ffff8100ceec3e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000004 ffff810303a3f0c0
>ffff81010396b100
>2008-05-08 13:53:19  000000070201afb3 0000000000000be3 ffff810303a3f2a8
>0000000503849980
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 kblockd/6     S ffffffff8009dbca     0   177    157   
>       178   176 (L-TLB)
>2008-05-08 13:53:19  ffff8103ffe47e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000004 ffff810203a87820
>ffff81030395c100
>2008-05-08 13:53:19  0000000702022cdc 0000000000000cc9 ffff810203a87a08
>0000000603841400
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 kblockd/7     S ffffffff8009dbca     0   178    157   
>       179   177 (L-TLB)
>2008-05-08 13:53:19  ffff8102ffe43e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000004 ffff810103a4e820
>ffff81010396d040
>2008-05-08 13:53:19  0000000702029e2c 0000000000000cab ffff810103a4ea08
>0000000703849980
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 kacpid        S ffffffff8009dbca     0   179    157   
>       336   178 (L-TLB)
>2008-05-08 13:53:19  ffff8101ffe47e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000004 ffff81000cf53100
>ffff8103038b90c0
>2008-05-08 13:53:19  000000070204699e 000000000000082c ffff81000cf532e8
>0000000403841400
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 cqueue/0      S ffffffff8009dbca     0   336    157   
>       337   179 (L-TLB)
>2008-05-08 13:53:19  ffff8100ceec5e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000007 ffff810303a180c0
>ffffffff802e3ae0
>2008-05-08 13:53:19  000000070f6ab2c5 00000000000010f4 ffff810303a182a8
>000000000b4f6400
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 cqueue/1      S ffffffff8009dbca     0   337    157   
>       338   336 (L-TLB)
>2008-05-08 13:53:19  ffff8103ffee3e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000005 ffff810203b5f820
>ffff8101038b4080
>2008-05-08 13:53:19  000000070f6b2189 0000000000000d58 ffff810203b5fa08
>000000010b4fe980
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 cqueue/2      S ffff8101ffdc90c0     0   338    157   
>       339   337 (L-TLB)
>2008-05-08 13:53:19  ffff8102ffeede70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000004 ffff810103a42820
>ffff8101ffdc90c0
>2008-05-08 13:53:19  000000070f6b99b5 0000000000000f8d ffff810103a42a08
>0000000203841400
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:19  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 cqueue/3      S ffffffff8009dbca     0   339    157   
>       340   338 (L-TLB)
>2008-05-08 13:53:19  ffff8101ffe1be70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000003 ffff81000cf2c100
>ffff81010396a0c0
>2008-05-08 13:53:19  000000070f6c15f4 0000000000000bf0 ffff81000cf2c2e8
>0000000303849980
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 cqueue/4      S ffffffff8009dbca     0   340    157   
>       341   339 (L-TLB)
>2008-05-08 13:53:19  ffff8100cec6de70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000003 ffff810303a18820
>ffff8103038b90c0
>2008-05-08 13:53:19  000000070f6c8a35 0000000000000ae1 ffff810303a18a08
>0000000403841400
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 cqueue/5      S ffffffff8009dbca     0   341    157   
>       342   340 (L-TLB)
>2008-05-08 13:53:19  ffff8103ffee7e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000003 ffff810203b5e100
>ffff81010396b100
>2008-05-08 13:53:19  000000070f6cffb5 0000000000000b59 ffff810203b5e2e8
>0000000503849980
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:19 
>2008-05-08 13:53:19 cqueue/6      S ffffffff8009dbca     0   342    157   
>       343   341 (L-TLB)
>2008-05-08 13:53:19  ffff8102ffec5e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:19  ffffffffffffffff 0000000000000003 ffff810103a420c0
>ffff81030395c100
>2008-05-08 13:53:19  000000070f6d72a3 0000000000000d2e ffff810103a422a8
>0000000603841400
>2008-05-08 13:53:19 Call Trace:
>2008-05-08 13:53:19  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:19  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:19  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:19  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:19  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:19  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 cqueue/7      S ffffffff8009dbca     0   343    157   
>       346   342 (L-TLB)
>2008-05-08 13:53:20  ffff8101ffed1e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:20  ffffffffffffffff 0000000000000003 ffff81000cf2c860
>ffff81010396d040
>2008-05-08 13:53:20  000000070f6de836 0000000000000d79 ffff81000cf2ca48
>0000000703849980
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:20  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:20  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 khubd         S ffff81010396d7a0     0   346    157   
>       348   343 (L-TLB)
>2008-05-08 13:53:20  ffff81000cfe7e10 0000000000000046 0000000000000001
>8000018000000000
>2008-05-08 13:53:20  ffff8100ce554000 000000000000000a ffff810303a16860
>ffff81010396d7a0
>2008-05-08 13:53:20  0000000e11457c4b 000000000002cca4 ffff810303a16a48
>00000000cec94ea0
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff801da9a9>] hub_port_status+0x59/0xcf
>2008-05-08 13:53:20  [<ffffffff801dd69f>] hub_thread+0xa92/0xb10
>2008-05-08 13:53:20  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:20  [<ffffffff801dcc0d>] hub_thread+0x0/0xb10
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 kseriod       S ffff810203b5e860     0   348    157   
>       474   346 (L-TLB)
>2008-05-08 13:53:20  ffff8103ffee9e90 0000000000000046 ffffffff80314740
>0000000000008080
>2008-05-08 13:53:20  ffffffff80314740 000000000000000a ffff810203b5e860
>ffff81000cf30080
>2008-05-08 13:53:20  0000000de944ced5 000000000000d3d7 ffff810203b5ea48
>00000000ffffffea
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff801af6b4>] driver_create_file+0x31/0x39
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff801f0fca>] serio_thread+0x29c/0x2e7
>2008-05-08 13:53:20  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:20  [<ffffffff801f0d2e>] serio_thread+0x0/0x2e7
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 pdflush       S ffffffff8009dbca     0   474    157   
>       475   348 (L-TLB)
>2008-05-08 13:53:20  ffff8102fff5de70 0000000000000046 ffff810103a53860
>ffff81000cd35d60
>2008-05-08 13:53:20  0000000000000282 0000000000000004 ffff810103a53860
>ffff8103038b90c0
>2008-05-08 13:53:20  000000071c5c4eef 0000000000001082 ffff810103a53a48
>000000048008a335
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff80056236>] pdflush+0x0/0x1fb
>2008-05-08 13:53:20  [<ffffffff80056323>] pdflush+0xed/0x1fb
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 pdflush       S ffffffff8009dbca     0   475    157   
>       476   474 (L-TLB)
>2008-05-08 13:53:20  ffff8101fff21e70 0000000000000046 ffffffff802f2020
>ffff810303984000
>2008-05-08 13:53:20  0000000000000286 000000000000000a ffff81000cf03040
>ffff81010396d040
>2008-05-08 13:53:20  000001be3630c37c 0000000000000dc6 ffff81000cf03228
>0000000700000282
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff800c30ca>] wb_kupdate+0x106/0x10d
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff80056236>] pdflush+0x0/0x1fb
>2008-05-08 13:53:20  [<ffffffff80056323>] pdflush+0xed/0x1fb
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 kswapd0       S ffffffff8009dbca     0   476    157   
>       477   475 (L-TLB)
>2008-05-08 13:53:20  ffff8100ceea5dd0 0000000000000046 0000000000200200
>ffff8100ceea5d40
>2008-05-08 13:53:20  0000000000000000 0000000000000002 ffff8103ffcf7860
>ffffffff802e3ae0
>2008-05-08 13:53:20  000000071c5d6527 0000000000000b6f ffff8103ffcf7a48
>0000000000000000
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800575fb>] kswapd+0x127/0x459
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:20  [<ffffffff800574d4>] kswapd+0x0/0x459
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 kswapd1       S ffffffff8009dbca     0   477    157   
>       478   476 (L-TLB)
>2008-05-08 13:53:20  ffff8103fff1fdd0 0000000000000046 0000000000200200
>ffff8103fff1fd40
>2008-05-08 13:53:20  0000000000000000 0000000000000003 ffff810203b3e040
>ffff8103038b8080
>2008-05-08 13:53:20  000000071c5e0e87 0000000000000d01 ffff810203b3e228
>0000000200000002
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800575fb>] kswapd+0x127/0x459
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:20  [<ffffffff800574d4>] kswapd+0x0/0x459
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 kswapd2       S ffffffff8009dbca     0   478    157   
>       479   477 (L-TLB)
>2008-05-08 13:53:20  ffff8102fff35dd0 0000000000000046 ffff810103a560c0
>ffff81000cd35d50
>2008-05-08 13:53:20  ffff810200000000 0000000000000002 ffff810103a560c0
>ffff8103038b90c0
>2008-05-08 13:53:20  000000071c5e462f 00000000000008c5 ffff810103a562a8
>0000000400000000
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800575fb>] kswapd+0x127/0x459
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:20  [<ffffffff800574d4>] kswapd+0x0/0x459
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 kswapd3       S ffffffff8009dbca     0   479    157   
>       480   478 (L-TLB)
>2008-05-08 13:53:20  ffff8101fff6ddd0 0000000000000046 0000000000200200
>ffff8101fff6dd40
>2008-05-08 13:53:20  0000000000000000 0000000000000003 ffff81000cf037a0
>ffff81030395c100
>2008-05-08 13:53:20  000000071c5ed5ec 0000000000000e12 ffff81000cf03988
>0000000600000006
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800575fb>] kswapd+0x127/0x459
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:20  [<ffffffff800574d4>] kswapd+0x0/0x459
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 aio/0         S ffffffff8009dbca     0   480    157   
>       481   479 (L-TLB)
>2008-05-08 13:53:20  ffff8100cee5fe70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:20  ffffffffffffffff 0000000000000002 ffff8103ffcf4040
>ffffffff802e3ae0
>2008-05-08 13:53:20  000000071c8fc84d 0000000000001418 ffff8103ffcf4228
>000000000b4f6400
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:20  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:20  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 aio/1         S ffffffff8009dbca     0   481    157   
>       482   480 (L-TLB)
>2008-05-08 13:53:20  ffff8103fffb3e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:20  ffffffffffffffff 0000000000000001 ffff810203b3e7a0
>ffff8101038b4080
>2008-05-08 13:53:20  000000071c904682 000000000000170f ffff810203b3e988
>000000010b4fe980
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:20  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:20  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 aio/2         S ffff8101ffdc90c0     0   482    157   
>       483   481 (L-TLB)
>2008-05-08 13:53:20  ffff8102fff91e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:20  ffffffffffffffff 0000000000000001 ffff810103a41860
>ffff8101ffdc90c0
>2008-05-08 13:53:20  000000071c90bac7 0000000000001481 ffff810103a41a48
>0000000200000280
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:20  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:20  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:20  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 aio/3         S ffffffff8009dbca     0   483    157   
>       484   482 (L-TLB)
>2008-05-08 13:53:20  ffff8101fff23e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:20  ffffffffffffffff 000000000000000a ffff81000cf01080
>ffff81010396a0c0
>2008-05-08 13:53:20  000000071c913e1b 0000000000001839 ffff81000cf01268
>0000000303849980
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:20  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:20  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:20 
>2008-05-08 13:53:20 aio/4         S ffffffff8009dbca     0   484    157   
>       485   483 (L-TLB)
>2008-05-08 13:53:20  ffff8100cee61e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:20  ffffffffffffffff 000000000000000a ffff8103ffcf47a0
>ffff8103038b90c0
>2008-05-08 13:53:20  000000071c91aac2 0000000000000c83 ffff8103ffcf4988
>0000000403841400
>2008-05-08 13:53:20 Call Trace:
>2008-05-08 13:53:20  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:20  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:20  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:20  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:20  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:20  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 aio/5         S ffffffff8009dbca     0   485    157   
>       486   484 (L-TLB)
>2008-05-08 13:53:21  ffff8103fff91e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:21  ffffffffffffffff 0000000000000008 ffff810203b3c080
>ffff81010396b100
>2008-05-08 13:53:21  000000071c9231b6 00000000000017de ffff810203b3c268
>0000000503849980
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 aio/6         S ffffffff8009dbca     0   486    157   
>       487   485 (L-TLB)
>2008-05-08 13:53:21  ffff8102fff93e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:21  ffffffffffffffff 0000000000000008 ffff810103a45040
>ffff81030395c100
>2008-05-08 13:53:21  000000071c929dad 0000000000001616 ffff810103a45228
>0000000603841400
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 aio/7         S ffffffff8009dbca     0   487    157   
>       633   486 (L-TLB)
>2008-05-08 13:53:21  ffff8101fff69e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:21  ffffffffffffffff 000000000000000a ffff81000cf017e0
>ffff81010396d040
>2008-05-08 13:53:21  000000073df56208 000000000000223d ffff81000cf019c8
>0000000703849980
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 kpsmoused     S ffffffff8009dbca     0   633    157   
>      1792   487 (L-TLB)
>2008-05-08 13:53:21  ffff8100ceca7e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:21  ffffffffffffffff 0000000000000008 ffff8103ffcd2040
>ffff8103038b90c0
>2008-05-08 13:53:21  00000007c29beadf 0000000000000def ffff8103ffcd2228
>0000000403841400
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 rpciod/0      S ffff81000cf440c0     0  1792    157   
>      1793   633 (L-TLB)
>2008-05-08 13:53:21  ffff8101ffa63e70 0000000000000046 ffff8100a6097c88
>ffff8100ceb78250
>2008-05-08 13:53:21  0000000300000000 000000000000000a ffff81000cf440c0
>ffff81000cf00820
>2008-05-08 13:53:21  00000023f691e3a7 0000000000002823 ffff81000cf442a8
>000000008002e254
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8802ec12>]
>:sunrpc:rpc_async_schedule+0x0/0x5
>2008-05-08 13:53:21  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 rpciod/1      S ffffffff8009dbca     0  1793    157   
>      1794  1792 (L-TLB)
>2008-05-08 13:53:21  ffff8100ce421e70 0000000000000046 ffff8101fffe6cc8
>ffff8100ceeba000
>2008-05-08 13:53:21  0000000300000000 000000000000000a ffff8103ffcff100
>ffff8101038b4080
>2008-05-08 13:53:21  000001455cc803a1 0000000000003bb7 ffff8103ffcff2e8
>000000018002e254
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 rpciod/2      S ffff810203b77820     0  1794    157   
>      1795  1793 (L-TLB)
>2008-05-08 13:53:21  ffff8103ff701e70 0000000000000046 ffff8101fe871088
>ffff8100ceb79030
>2008-05-08 13:53:21  0000000300000000 000000000000000a ffff810203b77820
>ffff8103ff1b9820
>2008-05-08 13:53:21  0000002491ea509b 0000000000004cd9 ffff810203b77a08
>000000028002e254
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8802ec12>]
>:sunrpc:rpc_async_schedule+0x0/0x5
>2008-05-08 13:53:21  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 rpciod/3      S ffff8101ff92c7a0     0  1795    157   
>      1796  1794 (L-TLB)
>2008-05-08 13:53:21  ffff810203b3be70 0000000000000046 0000000000000001
>0000000000000003
>2008-05-08 13:53:21  0000000300000000 000000000000000a ffff8101ff92c7a0
>ffff8102fe7277a0
>2008-05-08 13:53:21  0000002514de5b9d 00000000000009c0 ffff8101ff92c988
>000000038002e254
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8802ec12>]
>:sunrpc:rpc_async_schedule+0x0/0x5
>2008-05-08 13:53:21  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 rpciod/4      S ffff81000cf467e0     0  1796    157   
>      1797  1795 (L-TLB)
>2008-05-08 13:53:21  ffff8101ffadfe70 0000000000000046 0000000000000000
>0000000000000004
>2008-05-08 13:53:21  0000000300000000 0000000000000009 ffff81000cf467e0
>ffff8100cef11100
>2008-05-08 13:53:21  00000023f2f5aa28 00000000000008a9 ffff81000cf469c8
>000000048002e254
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8802ec12>]
>:sunrpc:rpc_async_schedule+0x0/0x5
>2008-05-08 13:53:21  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 rpciod/5      S ffff810303a157a0     0  1797    157   
>      1798  1796 (L-TLB)
>2008-05-08 13:53:21  ffff8100ce4b3e70 0000000000000046 ffff8101ffc95088
>ffff8103ff4d8940
>2008-05-08 13:53:21  0000000300000000 0000000000000009 ffff810303a157a0
>ffff81000cf2a080
>2008-05-08 13:53:21  0000001e53ca0ff1 0000000000003df3 ffff810303a15988
>000000058002e254
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8802ec12>]
>:sunrpc:rpc_async_schedule+0x0/0x5
>2008-05-08 13:53:21  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 rpciod/6      S ffff810203b770c0     0  1798    157   
>      1799  1797 (L-TLB)
>2008-05-08 13:53:21  ffff8103ff417e70 0000000000000046 ffff8101ffe799c8
>ffff8103ff4d8b90
>2008-05-08 13:53:21  0000000300000000 000000000000000a ffff810203b770c0
>ffff81000cf3d820
>2008-05-08 13:53:21  0000002736c0d5b9 0000000000002fb3 ffff810203b772a8
>000000068002e254
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8802ec12>]
>:sunrpc:rpc_async_schedule+0x0/0x5
>2008-05-08 13:53:21  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 rpciod/7      S ffffffff8009dbca     0  1799    157   
>      1847  1798 (L-TLB)
>2008-05-08 13:53:21  ffff810203b73e70 0000000000000046 ffff8100ce415800
>ffffffff8802ad70
>2008-05-08 13:53:21  0000000300000000 0000000000000009 ffff8101fffbd860
>ffff81010396d040
>2008-05-08 13:53:21  0000001de3b9bd06 0000000000038e04 ffff8101fffbda48
>000000078002e254
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8802ad70>]
>:sunrpc:xprt_end_transmit+0x2c/0x39
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:21  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:21 
>2008-05-08 13:53:21 kauditd       S ffffffff8009dbca     0  1847    157   
>      2203  1799 (L-TLB)
>2008-05-08 13:53:21  ffff8101ffcefe90 0000000000000046 0000000000000000
>ffff8103038b90c0
>2008-05-08 13:53:21  ffff81000cf647e0 0000000000000008 ffff81000cf647e0
>ffff8103038b90c0
>2008-05-08 13:53:21  0000000dd9c25364 0000000000000a6d ffff81000cf649c8
>0000000400000046
>2008-05-08 13:53:21 Call Trace:
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff800afe99>] kauditd_thread+0x144/0x17b
>2008-05-08 13:53:21  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:21  [<ffffffff800afd55>] kauditd_thread+0x0/0x17b
>2008-05-08 13:53:21  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:21  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:21  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:21  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 kedac         S ffffffff8009dbca     0  2203    157   
>      2389  1847 (L-TLB)
>2008-05-08 13:53:22  ffff810103a85e70 0000000000000046 0000000000000016
>ffffffff8020aac1
>2008-05-08 13:53:22  0000000000000246 000000000000000a ffff8100c4d84040
>ffff8103038b8080
>2008-05-08 13:53:22  000001beff392deb 0000000000010443 ffff8100c4d84228
>0000000200000006
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff8020aac1>] pci_conf1_read+0xb5/0xc0
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff80063803>] schedule_timeout+0x8a/0xad
>2008-05-08 13:53:22  [<ffffffff8009543e>] process_timeout+0x0/0x5
>2008-05-08 13:53:22  [<ffffffff880f3ad2>]
>:edac_mc:edac_kernel_thread+0xc3/0xeb
>2008-05-08 13:53:22  [<ffffffff880f3a0f>]
>:edac_mc:edac_kernel_thread+0x0/0xeb
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata/0         S ffff8101ffdc90c0     0  2389    157   
>      2390  2203 (L-TLB)
>2008-05-08 13:53:22  ffff8100c5635e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  0000000000000011 0000000000000006 ffff8103fec97100
>ffff8101ffdc90c0
>2008-05-08 13:53:22  0000000df1d7f414 000000000000145d ffff8103fec972e8
>00000000c514c6c0
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff80028c98>] do_sigaction+0x183/0x195
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata/1         S ffff8102ff6250c0     0  2390    157   
>      2391  2389 (L-TLB)
>2008-05-08 13:53:22  ffff8103fee01e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  ffffffffffffffff 0000000000000006 ffff8102ff6250c0
>ffff8103038a3040
>2008-05-08 13:53:22  0000000df1d8f15c 00000000000013bb ffff8102ff6252a8
>000000010b4fe980
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:22  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:22  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata/2         S ffff8101ff235040     0  2391    157   
>      2392  2390 (L-TLB)
>2008-05-08 13:53:22  ffff8102fe23de70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  ffffffffffffffff 0000000000000006 ffff8101ff235040
>ffff8101ff5ce080
>2008-05-08 13:53:22  0000000df1da1860 00000000000013f8 ffff8101ff235228
>0000000203841400
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:22  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:22  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata/3         S ffff8100ce42c860     0  2392    157   
>      2393  2391 (L-TLB)
>2008-05-08 13:53:22  ffff8101ff5e9e70 0000000000000046 ffff8101ff5e9dd0
>ffffffff8008a60e
>2008-05-08 13:53:22  0000000df1da5242 0000000000000006 ffff8100ce42c860
>ffff8101039b5860
>2008-05-08 13:53:22  0000000df1da85db 00000000000010ad ffff8100ce42ca48
>0000000303849980
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff8008a60e>] __activate_task+0x27/0x39
>2008-05-08 13:53:22  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:22  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:22  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata/4         S ffffffff8009dbca     0  2393    157   
>      2395  2392 (L-TLB)
>2008-05-08 13:53:22  ffff8100c50f1e70 0000000000000046 ffff8100c50f1dd0
>ffffffff8008a60e
>2008-05-08 13:53:22  0000000df1dab166 0000000000000006 ffff8103fec97860
>ffff8103038b90c0
>2008-05-08 13:53:22  0000000df1de7e51 00000000000016c2 ffff8103fec97a48
>0000000403841400
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff8008a60e>] __activate_task+0x27/0x39
>2008-05-08 13:53:22  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata/5         S ffff8102ff625820     0  2395    157   
>      2396  2393 (L-TLB)
>2008-05-08 13:53:22  ffff8103fee23e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  ffffffffffffffff 0000000000000006 ffff8102ff625820
>ffff8103ff3ea820
>2008-05-08 13:53:22  0000000df1e0df32 00000000000016a8 ffff8102ff625a08
>0000000503849980
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:22  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:22  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata/6         S ffff8101ff2357a0     0  2396    157   
>      2397  2395 (L-TLB)
>2008-05-08 13:53:22  ffff8102fe709e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  ffffffffffffffff 0000000000000005 ffff8101ff2357a0
>ffff8103ff3c7100
>2008-05-08 13:53:22  0000000df1dfbfff 0000000000001398 ffff8101ff235988
>0000000603841400
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:22  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:22  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata/7         S ffffffff8009dbca     0  2397    157   
>      2398  2396 (L-TLB)
>2008-05-08 13:53:22  ffff8101ff2ade70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  ffffffffffffffff 0000000000000005 ffff8100ce42c100
>ffff81010396d040
>2008-05-08 13:53:22  0000000df1e00eb6 0000000000000bbf ffff8100ce42c2e8
>0000000703849980
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 ata_aux       S ffffffff8009dbca     0  2398    157   
>      2661  2397 (L-TLB)
>2008-05-08 13:53:22  ffff81000ce87e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  ffffffffffffffff 0000000000000005 ffff8103fec99040
>ffff81010396d040
>2008-05-08 13:53:22  0000000df1e09532 00000000000007dc ffff8103fec99228
>0000000703849980
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:22  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:22  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 scsi_eh_0     S ffffffff8009dbca     0  2661    157   
>      2663  2398 (L-TLB)
>2008-05-08 13:53:22  ffff8100c55f9e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  0000000300000000 000000000000000a ffff8103ff44a0c0
>ffff8103038b8080
>2008-05-08 13:53:22  0000000e1f7fe2c8 00000000000064c0 ffff8103ff44a2a8
>000000028002e254
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff88143f72>]
>:scsi_mod:scsi_error_handler+0x6a/0x4ac
>2008-05-08 13:53:22  [<ffffffff88143f08>]
>:scsi_mod:scsi_error_handler+0x0/0x4ac
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:22 
>2008-05-08 13:53:22 scsi_eh_1     S ffff8102ff671040     0  2663    157   
>      2861  2661 (L-TLB)
>2008-05-08 13:53:22  ffff8103ff0dde70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:22  0000000300000000 0000000000000009 ffff8102ff671040
>ffff8101039b5860
>2008-05-08 13:53:22  0000000e1f7fe605 0000000000002caf ffff8102ff671228
>000000008002e254
>2008-05-08 13:53:22 Call Trace:
>2008-05-08 13:53:22  [<ffffffff88140260>]
>:scsi_mod:__scsi_iterate_devices+0x56/0x6f
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff88143f72>]
>:scsi_mod:scsi_error_handler+0x6a/0x4ac
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff88143f08>]
>:scsi_mod:scsi_error_handler+0x0/0x4ac
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:22  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:22  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:22  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 scsi_eh_2     S ffffffff8009dbca     0  2861    157   
>      2862  2663 (L-TLB)
>2008-05-08 13:53:23  ffff8102fdde1e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  0000000300000000 000000000000000a ffff8101ffaf3820
>ffff8103038b8080
>2008-05-08 13:53:23  0000000e44d55e55 00000000000061ad ffff8101ffaf3a08
>000000028002e254
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff88143f72>]
>:scsi_mod:scsi_error_handler+0x6a/0x4ac
>2008-05-08 13:53:23  [<ffffffff88143f08>]
>:scsi_mod:scsi_error_handler+0x0/0x4ac
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 scsi_eh_3     S ffffffff8009dbca     0  2862    157   
>      2892  2861 (L-TLB)
>2008-05-08 13:53:23  ffff8101ff04fe70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  0000000300000000 0000000000000009 ffff8100ce8ca7a0
>ffff8103038b90c0
>2008-05-08 13:53:23  0000000e44d55c61 00000000000036a2 ffff8100ce8ca988
>000000048002e254
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff88143f72>]
>:scsi_mod:scsi_error_handler+0x6a/0x4ac
>2008-05-08 13:53:23  [<ffffffff88143f08>]
>:scsi_mod:scsi_error_handler+0x0/0x4ac
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 scsi_eh_4     S ffffffff8009dbca     0  2892    157   
>      2893  2862 (L-TLB)
>2008-05-08 13:53:23  ffff8103fee65e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  ffffffffffffffff 0000000000000007 ffff8102039fa820
>ffff8103038b90c0
>2008-05-08 13:53:23  0000000e2646e7ce 00000000000008e9 ffff8102039faa08
>0000000403841400
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff88143f72>]
>:scsi_mod:scsi_error_handler+0x6a/0x4ac
>2008-05-08 13:53:23  [<ffffffff88143f08>]
>:scsi_mod:scsi_error_handler+0x0/0x4ac
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 usb-storage   S ffff8101038a7040     0  2893    157   
>      2946  2892 (L-TLB)
>2008-05-08 13:53:23  ffff8102fe311de0 0000000000000046 ffffffff8008ac03
>0000000000100100
>2008-05-08 13:53:23  0000000000200200 000000000000000a ffff8101fec33100
>ffff8101038a7040
>2008-05-08 13:53:23  0000000f6dac2169 0000000000000817 ffff8101fec332e8
>00000000881eaa55
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:23  [<ffffffff8008a5d2>] enqueue_task+0x41/0x56
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8006487d>] __down_interruptible+0xbf/0x112
>2008-05-08 13:53:23  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:23  [<ffffffff8006468b>]
>__down_failed_interruptible+0x35/0x3a
>2008-05-08 13:53:23  [<ffffffff881ec4da>]
>:usb_storage:.text.lock.usb+0xf/0x15
>2008-05-08 13:53:23  [<ffffffff881ec199>]
>:usb_storage:usb_stor_control_thread+0x0/0x1dc
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 scsi_eh_5     S ffffffff8009dbca     0  2946    157   
>      2947  2893 (L-TLB)
>2008-05-08 13:53:23  ffff8103ff0abe70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  0000000300000000 000000000000000a ffff8102fe33d080
>ffff8103038b8080
>2008-05-08 13:53:23  0000000e6a2ae8b0 00000000000055aa ffff8102fe33d268
>000000028002e254
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff88143f72>]
>:scsi_mod:scsi_error_handler+0x6a/0x4ac
>2008-05-08 13:53:23 BUG: soft lockup - CPU#3 stuck for 10s!
>[cp2k.popt:6792]
>2008-05-08 13:53:23 CPU 3:
>2008-05-08 13:53:23 Modules linked in: job(U) w83627hf hwmon_vid i2c_isa
>ib_ipoib rdma_ucm rdma_cm iw_cm ib_addr ib_ucm ib_uverbs ib_umad ib_mthca
>ib_cm ib_sa ib_mad ib_core ipv6 xfrm_nalgo crypto_api sd_mod sg dm_mirror
>dm_multipath dm_mod video sbs backlight i2c_ec button battery asus_acpi
>acpi_memhotplug ac parport_pc lp parport joydev usb_storage floppy sata_nv
>pcspkr libata ohci_hcd scsi_mod i2c_nforce2 i2c_core k8temp hwmon k8_edac
>edac_mc shpchp serio_raw nfs nfs_acl lockd fscache sunrpc e1000
>2008-05-08 13:53:23 Pid: 6792, comm: cp2k.popt Tainted: G     
>2.6.18-92.el5 #1
>2008-05-08 13:53:23 RIP: 0010:[<ffffffff8002e7ff>]  [<ffffffff8002e7ff>]
>prune_dcache+0x55/0x149
>2008-05-08 13:53:23 RSP: 0018:ffff8101ff5c7a38  EFLAGS: 00000206
>2008-05-08 13:53:23 RAX: 000000000000436a RBX: ffff8101e5b59660 RCX:
>0000000000000001
>2008-05-08 13:53:23 RDX: ffff8101e5b596a0 RSI: ffffffff802f4080 RDI:
>ffffffff803c5480
>2008-05-08 13:53:23 RBP: fffffffffffffeff R08: ffff8101ff5c6000 R09:
>0000000000000246
>2008-05-08 13:53:23 R10: 0000000000000246 R11: fffffffffffffeff R12:
>ffff8101e54bfdf8
>2008-05-08 13:53:23 R13: 0000000000000000 R14: ffff81010384b8e0 R15:
>ffff8101cda123d8
>2008-05-08 13:53:23 FS:  0000000040201940(0063) GS:ffff8101039697c0(0000)
>knlGS:0000000000000000
>2008-05-08 13:53:23 CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>2008-05-08 13:53:23 CR2: 00002aaaab56b0f4 CR3: 00000001fe4a3000 CR4:
>00000000000006e0
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff8002e7d7>] prune_dcache+0x2d/0x149
>2008-05-08 13:53:23  [<ffffffff8004cd59>] shrink_dcache_parent+0x68/0xe1
>2008-05-08 13:53:23  [<ffffffff8004cd0d>] shrink_dcache_parent+0x1c/0xe1
>2008-05-08 13:53:23  [<ffffffff8808f41b>]
>:nfs:nfs_lookup_revalidate+0x35c/0x416
>2008-05-08 13:53:23  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:23  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:23  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:23  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:23  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:23  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:23  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:23  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:23  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:23  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:23  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:23  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:23  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:23  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:23  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:23  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:23  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:23  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:23  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:23 
>2008-05-08 13:53:23  [<ffffffff88143f08>]
>:scsi_mod:scsi_error_handler+0x0/0x4ac
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 scsi_eh_6     S ffffffff8009dbca     0  2947    157   
>      3191  2946 (L-TLB)
>2008-05-08 13:53:23  ffff8102fd9d7e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  0000000300000000 0000000000000009 ffff8101fec33860
>ffff8103038b90c0
>2008-05-08 13:53:23  0000000e6a2ae01b 000000000000230d ffff8101fec33a48
>000000048002e254
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff88143f72>]
>:scsi_mod:scsi_error_handler+0x6a/0x4ac
>2008-05-08 13:53:23  [<ffffffff88143f08>]
>:scsi_mod:scsi_error_handler+0x0/0x4ac
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 kmpathd/0     S ffff8102ff4c6860     0  3191    157   
>      3192  2947 (L-TLB)
>2008-05-08 13:53:23  ffff810303a6de70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  ffffffffffffffff 0000000000000002 ffff8102ff4c6860
>ffff81000cf2a080
>2008-05-08 13:53:23  0000000e990efe2e 0000000000000d43 ffff8102ff4c6a48
>000000000b4f6400
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:23  [<ffffffff800974cc>]
>recalc_sigpending_and_wake+0x9/0x1a
>2008-05-08 13:53:23  [<ffffffff80028c5f>] do_sigaction+0x14a/0x195
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:23  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:23  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 kmpathd/1     S ffffffff8009dbca     0  3192    157   
>      3193  3191 (L-TLB)
>2008-05-08 13:53:23  ffff8102fde99e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  ffffffffffffffff 0000000000000001 ffff8101ff1117e0
>ffff8101038b4080
>2008-05-08 13:53:23  0000000e990f27a4 000000000000141e ffff8101ff1119c8
>000000010b4fe980
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:23  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:23  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 kmpathd/2     S ffffffff8009dbca     0  3193    157   
>      3194  3192 (L-TLB)
>2008-05-08 13:53:23  ffff8101ff7b7e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  ffffffffffffffff 0000000000000001 ffff8100c532c860
>ffff8103038b8080
>2008-05-08 13:53:23  0000000e9910255a 000000000000126b ffff8100c532ca48
>0000000203841400
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:23  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:23  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 kmpathd/3     S ffffffff8009dbca     0  3194    157   
>      3195  3193 (L-TLB)
>2008-05-08 13:53:23  ffff8100c50afe70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  ffffffffffffffff 0000000000000001 ffff8103ff72a820
>ffff81010396a0c0
>2008-05-08 13:53:23  0000000e990fe1ed 0000000000001460 ffff8103ff72aa08
>0000000303849980
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:23  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:23  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:23  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:23  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:23 
>2008-05-08 13:53:23 kmpathd/4     S ffffffff8009dbca     0  3195    157   
>      3196  3194 (L-TLB)
>2008-05-08 13:53:23  ffff8103ff415e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:23  ffffffffffffffff 0000000000000001 ffff8102fe714040
>ffff8103038b90c0
>2008-05-08 13:53:23  0000000e991032ee 0000000000000967 ffff8102fe714228
>0000000403841400
>2008-05-08 13:53:23 Call Trace:
>2008-05-08 13:53:23  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:23  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 kmpathd/5     S ffffffff8009dbca     0  3196    157   
>      3197  3195 (L-TLB)
>2008-05-08 13:53:24  ffff8102fdf0be70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:24  ffffffffffffffff 0000000000000001 ffff8101fedd40c0
>ffff81010396b100
>2008-05-08 13:53:24  0000000e9910adf8 0000000000001933 ffff8101fedd42a8
>0000000503849980
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 kmpathd/6     S ffffffff8009dbca     0  3197    157   
>      3198  3196 (L-TLB)
>2008-05-08 13:53:24  ffff8101feda5e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:24  ffffffffffffffff 0000000000000001 ffff81000cf42860
>ffff81030395c100
>2008-05-08 13:53:24  0000000e99155cc0 0000000000001486 ffff81000cf42a48
>0000000680066e26
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 kmpathd/7     S ffffffff8009dbca     0  3198    157   
>      5354  3197 (L-TLB)
>2008-05-08 13:53:24  ffff8100c5237e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:24  ffffffffffffffff 0000000000000001 ffff8103ff1b8100
>ffff81010396d040
>2008-05-08 13:53:24  0000000e99116651 0000000000001858 ffff8103ff1b82e8
>0000000703849980
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 cerebrod      S 00007fffffffe940     0  3328      1   
>      4182   157 (NOTLB)
>2008-05-08 13:53:24  ffff8101ff6adeb8 0000000000000082 ffff8103038434e0
>000000028fa6ae00
>2008-05-08 13:53:24  0000000000000000 000000000000000a ffff810103acc0c0
>ffff81030395c100
>2008-05-08 13:53:24  000001bd51e571b0 0000000000004ba7 ffff810103acc2a8
>00000006febcc5f7
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff8009fbe6>] enqueue_hrtimer+0x55/0x70
>2008-05-08 13:53:24  [<ffffffff80063c55>] do_nanosleep+0x3f/0x70
>2008-05-08 13:53:24  [<ffffffff8005a10a>] hrtimer_nanosleep+0x58/0x118
>2008-05-08 13:53:24  [<ffffffff8009fd51>] hrtimer_wakeup+0x0/0x22
>2008-05-08 13:53:24  [<ffffffff8001d6df>] sigprocmask+0xb7/0xdb
>2008-05-08 13:53:24  [<ffffffff8005445b>] sys_nanosleep+0x4c/0x62
>2008-05-08 13:53:24  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 udevd         S 0000000000000008     0  4182      1   
>      5621  3328 (NOTLB)
>2008-05-08 13:53:24  ffff8103fff25a18 0000000000000086 000000696dbdb8c7
>ffff8103fff25a80
>2008-05-08 13:53:24  ffffffff8007553f 0000000000000006 ffff8103ff1b90c0
>ffff81010396b100
>2008-05-08 13:53:24  000001455ce8b9ff 00000000000101d6 ffff8103ff1b92a8
>0000000500000040
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:24  [<ffffffff8004686e>] try_to_wake_up+0x407/0x418
>2008-05-08 13:53:24  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:24  [<ffffffff80063a5d>] mutex_lock+0xd/0x1d
>2008-05-08 13:53:24  [<ffffffff800eda2c>] inotify_poll+0x49/0x50
>2008-05-08 13:53:24  [<ffffffff8001155f>] do_select+0x3fe/0x462
>2008-05-08 13:53:24  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff800093b2>] __handle_mm_fault+0xd62/0xe23
>2008-05-08 13:53:24  [<ffffffff8802f98a>]
>:sunrpc:rpcauth_lookup_credcache+0x12e/0x24c
>2008-05-08 13:53:24  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:24  [<ffffffff8809008e>]
>:nfs:nfs_access_get_cached+0xab/0xfa
>2008-05-08 13:53:24  [<ffffffff8000d052>] dput+0x2c/0x114
>2008-05-08 13:53:24  [<ffffffff8001944e>] __follow_mount+0x26/0x7f
>2008-05-08 13:53:24  [<ffffffff8002b135>] flush_tlb_page+0xac/0xda
>2008-05-08 13:53:24  [<ffffffff80010d04>] do_wp_page+0x260/0x6bd
>2008-05-08 13:53:24  [<ffffffff800df607>] core_sys_select+0x1bc/0x265
>2008-05-08 13:53:24  [<ffffffff80021f44>] __up_read+0x19/0x7f
>2008-05-08 13:53:24  [<ffffffff80066852>] do_page_fault+0x4fe/0x830
>2008-05-08 13:53:24  [<ffffffff80016270>] sys_select+0xc1/0x17c
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 ib_mcast      S ffffffff8009dbca     0  5354    157   
>      5355  3198 (L-TLB)
>2008-05-08 13:53:24  ffff8102fd3f5e70 0000000000000046 ffffffff883b8d52
>ffff8100c4f94a00
>2008-05-08 13:53:24  0000000300000000 000000000000000a ffff8101ff6137a0
>ffffffff802e3ae0
>2008-05-08 13:53:24  0000001385b440e2 0000000000004c01 ffff8101ff613988
>000000008002e254
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff883b8d52>] :ib_sa:join_handler+0x0/0x107
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 ib_inform     S ffffffff8009dbca     0  5355    157   
>      5356  5354 (L-TLB)
>2008-05-08 13:53:24  ffff8101ff401e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:24  ffffffffffffffff 0000000000000002 ffff8100cec8d100
>ffff8103038b90c0
>2008-05-08 13:53:24  0000001049ecc217 00000000000008e8 ffff8100cec8d2e8
>0000000403841400
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 local_sa      S ffffffff8009dbca     0  5356    157   
>      5366  5355 (L-TLB)
>2008-05-08 13:53:24  ffff8100c4087e70 0000000000000046 ffff810303a6e340
>ffffffff800d34f9
>2008-05-08 13:53:24  0000000300000000 000000000000000a ffff8103ff2de100
>ffffffff802e3ae0
>2008-05-08 13:53:24  000000111d2914bd 000000000000051e ffff8103ff2de2e8
>000000008002e254
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff800d34f9>] __cache_alloc_node+0x9d/0xd2
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 ib_cm/0       S ffff8101fef0e100     0  5366    157   
>      5367  5356 (L-TLB)
>2008-05-08 13:53:24  ffff8102fd337e70 0000000000000046 ffff8103ffdab7c0
>ffffffff883cd29b
>2008-05-08 13:53:24  0000000300000000 000000000000000a ffff8101fef0e100
>ffff81000cf44820
>2008-05-08 13:53:24  000001b7ebb82059 00000000000027e8 ffff8101fef0e2e8
>000000008002e254
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff883cd29b>]
>:ib_cm:cm_rep_handler+0x39d/0x3dd
>2008-05-08 13:53:24  [<ffffffff883cdf28>]
>:ib_cm:cm_work_handler+0x0/0xc52
>2008-05-08 13:53:24  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 ib_cm/1       S ffffffff8009dbca     0  5367    157   
>      5368  5366 (L-TLB)
>2008-05-08 13:53:24  ffff8101ff64fe70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:24  ffffffffffffffff 0000000000000001 ffff81000cf3b100
>ffff8101038b4080
>2008-05-08 13:53:24  000000104a3c7b4f 00000000000011fc ffff81000cf3b2e8
>000000010b4fe980
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 ib_cm/2       S ffffffff8009dbca     0  5368    157   
>      5369  5367 (L-TLB)
>2008-05-08 13:53:24  ffff8100c4ef9e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:24  ffffffffffffffff 0000000000000001 ffff8103ff405080
>ffff8103038b8080
>2008-05-08 13:53:24  000000104a3fe85b 000000000000111c ffff8103ff405268
>0000000280066e26
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 ib_cm/3       S ffffffff8009dbca     0  5369    157   
>      5370  5368 (L-TLB)
>2008-05-08 13:53:24  ffff8103fe9a7e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:24  ffffffffffffffff 0000000000000001 ffff8102ff7be100
>ffff81010396a0c0
>2008-05-08 13:53:24  000000104a3d39be 00000000000013a9 ffff8102ff7be2e8
>0000000303849980
>2008-05-08 13:53:24 Call Trace:
>2008-05-08 13:53:24  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:24  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:24  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:24  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:24  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:24  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:24 
>2008-05-08 13:53:24 ib_cm/4       S ffffffff8009dbca     0  5370    157   
>      5371  5369 (L-TLB)
>2008-05-08 13:53:24  ffff8102fe3b3e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:25  ffffffffffffffff 0000000000000001 ffff8101fef0e860
>ffff8103038b90c0
>2008-05-08 13:53:25  000000104a3d852c 00000000000008fe ffff8101fef0ea48
>0000000403841400
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 ib_cm/5       S ffffffff8009dbca     0  5371    157   
>      5372  5370 (L-TLB)
>2008-05-08 13:53:25  ffff8101feeabe70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:25  ffffffffffffffff 0000000000000001 ffff8100c54287e0
>ffff81010396b100
>2008-05-08 13:53:25  000000104a3de138 000000000000124e ffff8100c54289c8
>0000000503849980
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 ib_cm/6       S ffff8103ff4057e0     0  5372    157   
>      5373  5371 (L-TLB)
>2008-05-08 13:53:25  ffff8100c57c1e70 0000000000000046 0000000000000000
>ffff81000cffee00
>2008-05-08 13:53:25  0000000300000000 000000000000000a ffff8103ff4057e0
>ffff8100c532c100
>2008-05-08 13:53:25  000000c3e1ab6ab2 000000000000383f ffff8103ff4059c8
>000000068002e254
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff883cdf28>]
>:ib_cm:cm_work_handler+0x0/0xc52
>2008-05-08 13:53:25  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 ib_cm/7       S ffffffff8009dbca     0  5373    157   
>      5393  5372 (L-TLB)
>2008-05-08 13:53:25  ffff8103fe97fe70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:25  ffffffffffffffff 0000000000000001 ffff8102ff7be860
>ffff81010396d040
>2008-05-08 13:53:25  000000104a3ea3b6 000000000000244f ffff8102ff7bea48
>0000000700000039
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 mthcacatas    S ffffffff8009dbca     0  5393    157   
>      5404  5373 (L-TLB)
>2008-05-08 13:53:25  ffff8101ff713e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:25  ffffffffffffffff 0000000000000001 ffff8100c50c57e0
>ffff8103038b90c0
>2008-05-08 13:53:25  000000104d32f1bf 00000000000008a8 ffff8100c50c59c8
>0000000403841400
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 ib_mad1       S ffff8103fff2f0c0     0  5404    157   
>      5405  5393 (L-TLB)
>2008-05-08 13:53:25  ffff8100c36b7e70 0000000000000046 00000128c0cf7118
>ffff8100c4f94000
>2008-05-08 13:53:25  0000000300000000 000000000000000a ffff8103fff2f0c0
>ffff81000cf44820
>2008-05-08 13:53:25  000001b7ebb83e66 0000000000000c97 ffff8103fff2f2a8
>000000008002e254
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff883a5b9e>]
>:ib_mad:ib_mad_completion_handler+0x0/0x5e0
>2008-05-08 13:53:25  [<ffffffff8004cecf>] run_workqueue+0xba/0xe4
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 ib_mad2       S ffffffff8009dbca     0  5405    157   
>      5462  5404 (L-TLB)
>2008-05-08 13:53:25  ffff8103ff7e9e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:25  ffffffffffffffff 0000000000000008 ffff8102fd83a820
>ffff8103038b8080
>2008-05-08 13:53:25  00000010a25df75c 0000000000000924 ffff8102fd83aa08
>0000000203841400
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 ib_addr       S ffffffff8009dbca     0  5462    157   
>      5472  5405 (L-TLB)
>2008-05-08 13:53:25  ffff8102fd6a7e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:25  0000000300000000 000000000000000a ffff8101ff3bb080
>ffff8103038b8080
>2008-05-08 13:53:25  000001b915a4294c 00000000000008b6 ffff8101ff3bb268
>000000028002e254
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 iw_cm_wq      S ffffffff8009dbca     0  5472    157   
>      5482  5462 (L-TLB)
>2008-05-08 13:53:25  ffff8100c32b3e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:25  ffffffffffffffff 0000000000000003 ffff8103fede37a0
>ffff8103038b8080
>2008-05-08 13:53:25  00000010a592d0fa 0000000000001741 ffff8103fede3988
>0000000203841400
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 rdma_cm       S ffffffff8009dbca     0  5482    157   
>      5505  5472 (L-TLB)
>2008-05-08 13:53:25  ffff8102fd3d1e70 0000000000000046 0000000000000000
>0000000000000000
>2008-05-08 13:53:25  ffffffffffffffff 0000000000000002 ffff8101fec460c0
>ffff8103038b8080
>2008-05-08 13:53:25  00000010a5f57d43 0000000000000799 ffff8101fec462a8
>0000000203841400
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 ipoib         S ffffffff8009dbca     0  5505    157   
>            5482 (L-TLB)
>2008-05-08 13:53:25  ffff8103ff6d5e70 0000000000000046 0000000000000000
>00000000000080fe
>2008-05-08 13:53:25  0000000300000000 000000000000000a ffff810203b6f100
>ffff81010396d040
>2008-05-08 13:53:25  000001bfb0a8cc85 00000000000003bb ffff810203b6f2e8
>000000078002e254
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff800497be>] worker_thread+0x0/0x122
>2008-05-08 13:53:25  [<ffffffff8004987e>] worker_thread+0xc0/0x122
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003253d>] kthread+0xfe/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:25  [<ffffffff8009dbca>] keventd_create_kthread+0x0/0xc4
>2008-05-08 13:53:25  [<ffffffff8003243f>] kthread+0x0/0x132
>2008-05-08 13:53:25  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 shutdown-hot  S 0000000000000000     0  5621      1   
>      5622  4182 (NOTLB)
>2008-05-08 13:53:25  ffff8100bfc31df8 0000000000000082 ffff8100bfc31e08
>0000000000000082
>2008-05-08 13:53:25  ffff81000cf3d0c0 0000000000000008 ffff81000cf3d0c0
>ffffffff802e3ae0
>2008-05-08 13:53:25  00000011b2d3a43a 0000000000000f41 ffff81000cf3d2a8
>000000000003af8a
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff800477cf>] pipe_wait+0x69/0x93
>2008-05-08 13:53:25  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:25  [<ffffffff80063a5d>] mutex_lock+0xd/0x1d
>2008-05-08 13:53:25  [<ffffffff8002ec10>] pipe_readv+0x31d/0x3a2
>2008-05-08 13:53:25  [<ffffffff800de208>] pipe_read+0x1a/0x1f
>2008-05-08 13:53:25  [<ffffffff8000b337>] vfs_read+0xcb/0x171
>2008-05-08 13:53:25  [<ffffffff80011715>] sys_read+0x45/0x6e
>2008-05-08 13:53:25  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:25 
>2008-05-08 13:53:25 syslog-ng     D ffff8100b55a2001     0  5622      1   
>      5633  5621 (NOTLB)
>2008-05-08 13:53:25  ffff8100bfcafb38 0000000000000082 0000000000000001
>ffff8100ceab29c0
>2008-05-08 13:53:25  ffff8100cec8eb70 000000000000000a ffff8100c416e7a0
>ffffffff802e3ae0
>2008-05-08 13:53:25  000001ba42014333 00000000000177bb ffff8100c416e988
>0000000000000000
>2008-05-08 13:53:25 Call Trace:
>2008-05-08 13:53:25  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:25  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8809018a>] :nfs:nfs_permission+0xad/0x1cb
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8000d5ab>] permission+0x81/0xc8
>2008-05-08 13:53:25  [<ffffffff800096e5>] __link_path_walk+0x173/0xf42
>2008-05-08 13:53:25  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:25  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:25  [<ffffffff8012ed6c>] cap_syslog+0x18/0x25
>2008-05-08 13:53:25  [<ffffffff8005176b>] unix_release_sock+0x1dc/0x1fa
>2008-05-08 13:53:25  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:25  [<ffffffff800122d3>] getname+0x15b/0x1c1
>2008-05-08 13:53:26  [<ffffffff800236c7>] __user_walk_fd+0x37/0x4c
>2008-05-08 13:53:26  [<ffffffff800285de>] vfs_stat_fd+0x1b/0x4a
>2008-05-08 13:53:26  [<ffffffff8012ed6c>] cap_syslog+0x18/0x25
>2008-05-08 13:53:26  [<ffffffff8005176b>] unix_release_sock+0x1dc/0x1fa
>2008-05-08 13:53:26  [<ffffffff800233f9>] sys_newstat+0x19/0x31
>2008-05-08 13:53:26  [<ffffffff8000b3a8>] vfs_read+0x13c/0x171
>2008-05-08 13:53:26  [<ffffffff8004bbc9>] sys_poll+0x2d/0x34
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 irqbalance    D ffff8103f1468001     0  5633      1   
>      5645  5622 (NOTLB)
>2008-05-08 13:53:26  ffff8102fe0cdb18 0000000000000086 ffff8100cefa1c80
>ffff8100ceab29c0
>2008-05-08 13:53:26  ffff8100cec83df8 000000000000000a ffff810203a9c0c0
>ffff81010396d040
>2008-05-08 13:53:26  000001b9893709df 000000000000519a ffff810203a9c2a8
>0000000700000010
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:26  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:26  [<ffffffff8809018a>] :nfs:nfs_permission+0xad/0x1cb
>2008-05-08 13:53:26  [<ffffffff8000f083>] __alloc_pages+0x65/0x2ce
>2008-05-08 13:53:26  [<ffffffff8000d5ab>] permission+0x81/0xc8
>2008-05-08 13:53:26  [<ffffffff800096e5>] __link_path_walk+0x173/0xf42
>2008-05-08 13:53:26  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:26  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:26  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:26  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:26  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:26  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:26  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:26  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:26  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 portmap       S ffff8103ff33dbc8     0  5645      1   
>      5665  5633 (NOTLB)
>2008-05-08 13:53:26  ffff8103ff33db38 0000000000000086 ffff8101039009e0
>ffff81000cddee80
>2008-05-08 13:53:26  ffff8101039009c0 0000000000000007 ffff8103ff6ad080
>ffffffff802e3ae0
>2008-05-08 13:53:26  000000180e4e5268 0000000000004023 ffff8103ff6ad268
>000000008023219a
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:26  [<ffffffff80013592>] tcp_poll+0x1c/0x12f
>2008-05-08 13:53:26  [<ffffffff8002f61c>] do_sys_poll+0x277/0x35e
>2008-05-08 13:53:26  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:26  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:26  [<ffffffff8000a82b>]
>get_page_from_freelist+0x377/0x3fa
>2008-05-08 13:53:26  [<ffffffff8020cfcf>] sys_sendmsg+0x217/0x28a
>2008-05-08 13:53:26  [<ffffffff8003329a>] lock_sock+0xa7/0xb2
>2008-05-08 13:53:26  [<ffffffff8004bbc9>] sys_poll+0x2d/0x34
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 rpc.statd     S 0000000000000008     0  5665      1   
>      5735  5645 (NOTLB)
>2008-05-08 13:53:26  ffff8100c481ba18 0000000000000086 0000000000000003
>ffffffff80142f55
>2008-05-08 13:53:26  ffff8101ff57ae80 0000000000000007 ffff8100ce3ac7a0
>ffff8103038b8080
>2008-05-08 13:53:26  00000011b6d37bb6 0000000000001dbd ffff8100ce3ac988
>000000028000cb46
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff80142f55>] __next_cpu+0x19/0x28
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:26  [<ffffffff80013592>] tcp_poll+0x1c/0x12f
>2008-05-08 13:53:26  [<ffffffff8001155f>] do_select+0x3fe/0x462
>2008-05-08 13:53:26  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:26  [<ffffffff80012abe>] sock_def_readable+0x34/0x5f
>2008-05-08 13:53:26  [<ffffffff80049f51>] unix_stream_sendmsg+0x25d/0x30e
>2008-05-08 13:53:26  [<ffffffff80054924>] sock_sendmsg+0xf3/0x110
>2008-05-08 13:53:26  [<ffffffff8000e7f9>] link_path_walk+0xd3/0xe5
>2008-05-08 13:53:26  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:26  [<ffffffff800df607>] core_sys_select+0x1bc/0x265
>2008-05-08 13:53:26  [<ffffffff8002cb15>] mntput_no_expire+0x19/0x89
>2008-05-08 13:53:26  [<ffffffff8020d4de>] sys_sendto+0x11c/0x14f
>2008-05-08 13:53:26  [<ffffffff80062efb>] thread_return+0x0/0xdf
>2008-05-08 13:53:26  [<ffffffff80016270>] sys_select+0xc1/0x17c
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 dbus-daemon   S ffff8100c09c7bc8     0  5735      1   
>      5854  5665 (NOTLB)
>2008-05-08 13:53:26  ffff8100c09c7b38 0000000000000082 f2f5966cbe366326
>ffff8100cec8a630
>2008-05-08 13:53:26  ffff8100cec8eb70 0000000000000002 ffff8100c52e00c0
>ffff8103038b8080
>2008-05-08 13:53:26  00000011ca7b2ef2 0000000000060251 ffff8100c52e02a8
>00000002f17d93f1
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:26  [<ffffffff8002f61c>] do_sys_poll+0x277/0x35e
>2008-05-08 13:53:26  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8002b135>] flush_tlb_page+0xac/0xda
>2008-05-08 13:53:26  [<ffffffff8000769e>] find_get_page+0x21/0x50
>2008-05-08 13:53:26  [<ffffffff80013325>] filemap_nopage+0x188/0x322
>2008-05-08 13:53:26  [<ffffffff80008b39>] __handle_mm_fault+0x4e9/0xe23
>2008-05-08 13:53:26  [<ffffffff80066852>] do_page_fault+0x4fe/0x830
>2008-05-08 13:53:26  [<ffffffff8003ac5e>] d_instantiate+0x4a/0x82
>2008-05-08 13:53:26  [<ffffffff80041922>] d_rehash+0x21/0x34
>2008-05-08 13:53:26  [<ffffffff8020d10f>] sock_attach_fd+0x8f/0xfd
>2008-05-08 13:53:26  [<ffffffff80028b87>] do_sigaction+0x72/0x195
>2008-05-08 13:53:26  [<ffffffff8004bbc9>] sys_poll+0x2d/0x34
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 munged        S ffff8101ff2bb7e0     0  5854      1   
>      5855  5735 (NOTLB)
>2008-05-08 13:53:26  ffff8101ffafdd98 0000000000000082 ffff8101ffafde49
>ffff8100c0649080
>2008-05-08 13:53:26  00000000ffffffff 000000000000000a ffff8101ff2bb7e0
>ffff81000cf44820
>2008-05-08 13:53:26  000001b7ebcff599 0000000000003f38 ffff8101ff2bb9c8
>00000000ffafde48
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff80046f03>] sprintf+0x51/0x59
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff8004773e>]
>prepare_to_wait_exclusive+0x38/0x60
>2008-05-08 13:53:26  [<ffffffff80054f76>] skb_recv_datagram+0x160/0x1e3
>2008-05-08 13:53:26  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:26  [<ffffffff80041922>] d_rehash+0x21/0x34
>2008-05-08 13:53:26  [<ffffffff802603fc>] unix_accept+0x54/0x103
>2008-05-08 13:53:26  [<ffffffff8020d976>] sys_accept+0x11c/0x1ea
>2008-05-08 13:53:26  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 munged        S ffff8100c4969860     0  5855      1   
>      5856  5854 (NOTLB)
>2008-05-08 13:53:26  ffff8100c0a49d48 0000000000000082 ffff8100cefa1980
>ffff8102ff5a1118
>2008-05-08 13:53:26  ffff8100c0a49e48 000000000000000a ffff8100c4969860
>ffff81000cf53860
>2008-05-08 13:53:26  000001b493fbc107 0000000000078d06 ffff8100c4969a48
>00000002039fe738
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff8003d671>] lock_timer_base+0x1b/0x3c
>2008-05-08 13:53:26  [<ffffffff8001c5ea>] __mod_timer+0xb0/0xbe
>2008-05-08 13:53:26  [<ffffffff80063803>] schedule_timeout+0x8a/0xad
>2008-05-08 13:53:26  [<ffffffff8009543e>] process_timeout+0x0/0x5
>2008-05-08 13:53:26  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:26  [<ffffffff8001a7b3>] cp_new_stat+0xe5/0xfd
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 munged        S ffff8101ffdc9858     0  5856      1   
>      5857  5855 (NOTLB)
>2008-05-08 13:53:26  ffff8100c0a4bd48 0000000000000082 0000000000000002
>0000000000000002
>2008-05-08 13:53:26  0000000000000036 000000000000000a ffff81000cf2b7a0
>ffff8101ffdc9820
>2008-05-08 13:53:26  000001b7ebd0f67a 000000000001105c ffff81000cf2b988
>0000000400000000
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff8002b135>] flush_tlb_page+0xac/0xda
>2008-05-08 13:53:26  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:26  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8002cb15>] mntput_no_expire+0x19/0x89
>2008-05-08 13:53:26  [<ffffffff80051758>] unix_release_sock+0x1c9/0x1fa
>2008-05-08 13:53:26  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:26  [<ffffffff800239d6>] filp_close+0x5c/0x64
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 munged        S ffff81000cf2a7e0     0  5857      1   
>      5895  5856 (NOTLB)
>2008-05-08 13:53:26  ffff8100c0a4dd48 0000000000000082 0000000000000002
>0000000000000002
>2008-05-08 13:53:26  0000000000000091 000000000000000a ffff81000cf2a7e0
>ffff81000cf2a080
>2008-05-08 13:53:26  000001b7ebc9f622 000000000000fea4 ffff81000cf2a9c8
>0000000700000000
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:26  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8002cb15>] mntput_no_expire+0x19/0x89
>2008-05-08 13:53:26  [<ffffffff80051758>] unix_release_sock+0x1c9/0x1fa
>2008-05-08 13:53:26  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:26  [<ffffffff800239d6>] filp_close+0x5c/0x64
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 munged        S ffff8102fdf860c0     0  5895      1   
>      5896  5857 (NOTLB)
>2008-05-08 13:53:26  ffff8102fd1e5d98 0000000000000082 ffff8102fd1e5e49
>ffff8101ff92a840
>2008-05-08 13:53:26  00000000ffffffff 0000000000000001 ffff8102fdf860c0
>ffff8101ff117820
>2008-05-08 13:53:26  00000011dc5e5266 000000000000cfd3 ffff8102fdf862a8
>00000002fd1e5e48
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff80046f03>] sprintf+0x51/0x59
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff8004773e>]
>prepare_to_wait_exclusive+0x38/0x60
>2008-05-08 13:53:26  [<ffffffff80054f76>] skb_recv_datagram+0x160/0x1e3
>2008-05-08 13:53:26  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:26  [<ffffffff80041922>] d_rehash+0x21/0x34
>2008-05-08 13:53:26  [<ffffffff802603fc>] unix_accept+0x54/0x103
>2008-05-08 13:53:26  [<ffffffff8020d976>] sys_accept+0x11c/0x1ea
>2008-05-08 13:53:26  [<ffffffff800164a4>] vfs_write+0x13f/0x174
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 munged        S ffff8101fffbd100     0  5896      1   
>      5897  5895 (NOTLB)
>2008-05-08 13:53:26  ffff8101ff1ddd48 0000000000000082 ffff8100cefa1980
>ffff8102ff5a1118
>2008-05-08 13:53:26  ffff8101ff1dde48 000000000000000a ffff8101fffbd100
>ffff81000cf46080
>2008-05-08 13:53:26  000001b49966e4b0 00000000000802fe ffff8101fffbd2e8
>00000004039fe738
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:26  [<ffffffff8003d671>] lock_timer_base+0x1b/0x3c
>2008-05-08 13:53:26  [<ffffffff8001c5ea>] __mod_timer+0xb0/0xbe
>2008-05-08 13:53:26  [<ffffffff80063803>] schedule_timeout+0x8a/0xad
>2008-05-08 13:53:26  [<ffffffff8009543e>] process_timeout+0x0/0x5
>2008-05-08 13:53:26  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff800d2e7f>] shmem_file_write+0x23f/0x251
>2008-05-08 13:53:26  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 munged        S ffff8101ff4ea7e0     0  5897      1   
>      5898  5896 (NOTLB)
>2008-05-08 13:53:26  ffff8101fef4fd48 0000000000000082 0000000000000000
>0000000000000000
>2008-05-08 13:53:26  0000000000000000 0000000000000001 ffff8101ff4ea7e0
>ffff81030395c100
>2008-05-08 13:53:26  00000011dc5e4612 0000000000007f73 ffff8101ff4ea9c8
>0000000600000000
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:26  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 munged        S ffff8101ff117820     0  5898      1   
>      5908  5897 (NOTLB)
>2008-05-08 13:53:26  ffff8101feed1d48 0000000000000082 0000000000000000
>0000000000000000
>2008-05-08 13:53:26  0000000000000000 0000000000000001 ffff8101ff117820
>ffff8103038b8080
>2008-05-08 13:53:26  00000011dc5e7c07 0000000000000a33 ffff8101ff117a08
>0000000200000000
>2008-05-08 13:53:26 Call Trace:
>2008-05-08 13:53:26  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:26  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:26  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:26  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:26  [<ffffffff8006258f>] __sched_text_start+0x17f/0xaeb
>2008-05-08 13:53:26  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:26  [<ffffffff80030123>] sys_rt_sigprocmask+0x50/0xd9
>2008-05-08 13:53:26  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:26 
>2008-05-08 13:53:26 xinetd        S 000000000000000c     0  5908      1   
>      5927  5898 (NOTLB)
>2008-05-08 13:53:26  ffff8100c0d1ba18 0000000000000082 0000000000000001
>0000000000000001
>2008-05-08 13:53:26  ffffffff803053c8 000000000000000a ffff8100c4969100
>ffff8101038b4080
>2008-05-08 13:53:27  000001455c9a3ea9 000000000000e24c ffff8100c49692e8
>00000001c4969100
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:27  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:27  [<ffffffff80013592>] tcp_poll+0x1c/0x12f
>2008-05-08 13:53:27  [<ffffffff8001155f>] do_select+0x3fe/0x462
>2008-05-08 13:53:27  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff80054924>] sock_sendmsg+0xf3/0x110
>2008-05-08 13:53:27  [<ffffffff8001a090>] vsnprintf+0x559/0x59e
>2008-05-08 13:53:27  [<ffffffff800df607>] core_sys_select+0x1bc/0x265
>2008-05-08 13:53:27  [<ffffffff8000d052>] dput+0x2c/0x114
>2008-05-08 13:53:27  [<ffffffff800fca01>] proc_flush_task+0xb9/0x1f6
>2008-05-08 13:53:27  [<ffffffff80016270>] sys_select+0xc1/0x17c
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff80011715>] sys_read+0x45/0x6e
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 ntpd          S 0000000000000019     0  5927      1   
>      5947  5908 (NOTLB)
>2008-05-08 13:53:27  ffff8102fdb6ba18 0000000000000082 ffff8102fdb6b9f8
>ffff8102fdb6b9e8
>2008-05-08 13:53:27  ffff8102fdb6b9f8 000000000000000a ffff8102fdc1d100
>ffff81030395c100
>2008-05-08 13:53:27  000001bffe6d3f71 0000000000001d42 ffff8102fdc1d2e8
>000000068006398e
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff8802b716>] :sunrpc:xprt_timer+0x0/0x7f
>2008-05-08 13:53:27  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:27  [<ffffffff8004fd85>] datagram_poll+0x18/0xc8
>2008-05-08 13:53:27  [<ffffffff8024261f>] udp_poll+0x15/0xf3
>2008-05-08 13:53:27  [<ffffffff8001155f>] do_select+0x3fe/0x462
>2008-05-08 13:53:27  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff800df607>] core_sys_select+0x1bc/0x265
>2008-05-08 13:53:27  [<ffffffff8006b8d1>] math_state_restore+0x23/0x4c
>2008-05-08 13:53:27  [<ffffffff8005dde9>] error_exit+0x0/0x84
>2008-05-08 13:53:27  [<ffffffff800433f8>] sys_rt_sigreturn+0x283/0x356
>2008-05-08 13:53:27  [<ffffffff80043498>] sys_rt_sigreturn+0x323/0x356
>2008-05-08 13:53:27  [<ffffffff80016270>] sys_select+0xc1/0x17c
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 crond         D ffff8103fa9b1001     0  5947      1   
>      5957  5927 (NOTLB)
>2008-05-08 13:53:27  ffff8102fd16fb38 0000000000000082 ffff8100ce8dc3c0
>ffff8100ceab29c0
>2008-05-08 13:53:27  ffff8100cec8eb70 0000000000000009 ffff810203b50100
>ffff81010396d040
>2008-05-08 13:53:27  000001bd03ffda3c 0000000001ed31ab ffff810203b502e8
>0000000780009523
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8802f98a>]
>:sunrpc:rpcauth_lookup_credcache+0x12e/0x24c
>2008-05-08 13:53:27  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:27  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:27  [<ffffffff8809018a>] :nfs:nfs_permission+0xad/0x1cb
>2008-05-08 13:53:27  [<ffffffff8000cb46>] do_lookup+0x65/0x1d4
>2008-05-08 13:53:27  [<ffffffff8000d5ab>] permission+0x81/0xc8
>2008-05-08 13:53:27  [<ffffffff800096e5>] __link_path_walk+0x173/0xf42
>2008-05-08 13:53:27  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:27  [<ffffffff8000df88>] current_fs_time+0x3b/0x40
>2008-05-08 13:53:27  [<ffffffff8000c31a>] _atomic_dec_and_lock+0x39/0x57
>2008-05-08 13:53:27  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:27  [<ffffffff800122d3>] getname+0x15b/0x1c1
>2008-05-08 13:53:27  [<ffffffff800236c7>] __user_walk_fd+0x37/0x4c
>2008-05-08 13:53:27  [<ffffffff800285de>] vfs_stat_fd+0x1b/0x4a
>2008-05-08 13:53:27  [<ffffffff8000df88>] current_fs_time+0x3b/0x40
>2008-05-08 13:53:27  [<ffffffff8000c31a>] _atomic_dec_and_lock+0x39/0x57
>2008-05-08 13:53:27  [<ffffffff800233f9>] sys_newstat+0x19/0x31
>2008-05-08 13:53:27  [<ffffffff800125f3>] __fput+0x16c/0x198
>2008-05-08 13:53:27  [<ffffffff8002cb15>] mntput_no_expire+0x19/0x89
>2008-05-08 13:53:27  [<ffffffff800239d6>] filp_close+0x5c/0x64
>2008-05-08 13:53:27  [<ffffffff8001d9e5>] sys_close+0x88/0xa2
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 atd           S ffff8100ce3ac040     0  5957      1   
>      6046  5947 (NOTLB)
>2008-05-08 13:53:27  ffff8100c0629eb8 0000000000000082 ffff8101038434e0
>00000045d964b800
>2008-05-08 13:53:27  0000000000000000 0000000000000007 ffff8100ce3ac040
>ffff81000cf53860
>2008-05-08 13:53:27  000001b58ef1261a 000000000001644b ffff8100ce3ac228
>000000028375f837
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff8009fbe6>] enqueue_hrtimer+0x55/0x70
>2008-05-08 13:53:27  [<ffffffff8003c17a>] hrtimer_start+0xbc/0xce
>2008-05-08 13:53:27  [<ffffffff8000df88>] current_fs_time+0x3b/0x40
>2008-05-08 13:53:27  [<ffffffff80063c55>] do_nanosleep+0x3f/0x70
>2008-05-08 13:53:27  [<ffffffff8005a10a>] hrtimer_nanosleep+0x58/0x118
>2008-05-08 13:53:27  [<ffffffff8000d052>] dput+0x2c/0x114
>2008-05-08 13:53:27  [<ffffffff8009fd51>] hrtimer_wakeup+0x0/0x22
>2008-05-08 13:53:27  [<ffffffff8001d6df>] sigprocmask+0xb7/0xdb
>2008-05-08 13:53:27  [<ffffffff8005445b>] sys_nanosleep+0x4c/0x62
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 mingetty      S ffff81000cf000c0     0  6046      1   
>      6047  5957 (NOTLB)
>2008-05-08 13:53:27  ffff8100c060fdc8 0000000000000082 ffff8103ff1b90c0
>ffffffff803053c8
>2008-05-08 13:53:27  0000000000000096 0000000000000008 ffff81000cf000c0
>ffff8100cef11860
>2008-05-08 13:53:27  000000130cab2bc5 000000000002906e ffff81000cf002a8
>000000010000000e
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:27  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:27  [<ffffffff800295f0>] read_chan+0x3b6/0x63b
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff800320e1>] tty_read+0x72/0xc7
>2008-05-08 13:53:27  [<ffffffff8000b337>] vfs_read+0xcb/0x171
>2008-05-08 13:53:27  [<ffffffff80011715>] sys_read+0x45/0x6e
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 mingetty      S ffff8100cef11860     0  6047      1   
>      6048  6046 (NOTLB)
>2008-05-08 13:53:27  ffff8100c4587dc8 0000000000000086 ffffffff8008a5d2
>ffff810203849980
>2008-05-08 13:53:27  ffff810203b4e7a0 0000000000000007 ffff8100cef11860
>ffff8102fe3bb040
>2008-05-08 13:53:27  000000130cb7223b 000000000003c44a ffff8100cef11a48
>000000010000000e
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff8008a5d2>] enqueue_task+0x41/0x56
>2008-05-08 13:53:27  [<ffffffff8019ba53>] do_con_write+0x1694/0x16c8
>2008-05-08 13:53:27  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:27  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:27  [<ffffffff800295f0>] read_chan+0x3b6/0x63b
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff800320e1>] tty_read+0x72/0xc7
>2008-05-08 13:53:27  [<ffffffff8000b337>] vfs_read+0xcb/0x171
>2008-05-08 13:53:27  [<ffffffff80011715>] sys_read+0x45/0x6e
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 agetty        S 0000000000000000     0  6048      1   
>      6092  6047 (NOTLB)
>2008-05-08 13:53:27  ffff8100c05dbdc8 0000000000000086 0000000300000000
>ffffffff8030b830
>2008-05-08 13:53:27  0000000000000000 000000000000000a ffff8100ce8ca040
>ffffffff802e3ae0
>2008-05-08 13:53:27  000000134ecdb8bb 000000000000b3fb ffff8100ce8ca228
>00000000c0cec550
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80013325>] filemap_nopage+0x188/0x322
>2008-05-08 13:53:27  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:27  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:27  [<ffffffff800295f0>] read_chan+0x3b6/0x63b
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff800320e1>] tty_read+0x72/0xc7
>2008-05-08 13:53:27  [<ffffffff8000b337>] vfs_read+0xcb/0x171
>2008-05-08 13:53:27  [<ffffffff80011715>] sys_read+0x45/0x6e
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 lockd         S 7fffffffffffffff     0  6092      1   
>      6206  6048 (L-TLB)
>2008-05-08 13:53:27  ffff8103ff00fe60 0000000000000046 0000000000000040
>ffff8101fee16e80
>2008-05-08 13:53:27  ffff810303a27c80 0000000000000007 ffff8103ffcf7100
>ffff8103038b8080
>2008-05-08 13:53:27  000000180e4fce84 000000000000be86 ffff8103ffcf72e8
>0000000280054ea7
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:27  [<ffffffff80064a81>] _spin_lock_bh+0x9/0x14
>2008-05-08 13:53:27  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:27  [<ffffffff88032db1>] :sunrpc:svc_recv+0x307/0x4be
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8806b072>] :lockd:lockd+0x0/0x272
>2008-05-08 13:53:27  [<ffffffff8806b072>] :lockd:lockd+0x0/0x272
>2008-05-08 13:53:27  [<ffffffff8806b1be>] :lockd:lockd+0x14c/0x272
>2008-05-08 13:53:27  [<ffffffff8005dfb1>] child_rip+0xa/0x11
>2008-05-08 13:53:27  [<ffffffff8806b072>] :lockd:lockd+0x0/0x272
>2008-05-08 13:53:27  [<ffffffff8806b072>] :lockd:lockd+0x0/0x272
>2008-05-08 13:53:27  [<ffffffff8005dfa7>] child_rip+0x0/0x11
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 slurmd        S 00007fffffffeb14     0  6206      1   
>      6769  6092 (NOTLB)
>2008-05-08 13:53:27  ffff8102fe313db8 0000000000000082 000001b7edc4cfb4
>000000000029f9f3
>2008-05-08 13:53:27  ffff8102fe727230 0000000000000009 ffff8102fe727040
>ffffffff802e3ae0
>2008-05-08 13:53:27  000001b7edc4d18e 00000000000001da ffff8102fe727228
>00000000c0649a80
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:27  [<ffffffff80064a81>] _spin_lock_bh+0x9/0x14
>2008-05-08 13:53:27  [<ffffffff80030a63>] release_sock+0x13/0xaa
>2008-05-08 13:53:27  [<ffffffff8023692b>] inet_csk_accept+0xae/0x233
>2008-05-08 13:53:27  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:27  [<ffffffff8020d10f>] sock_attach_fd+0x8f/0xfd
>2008-05-08 13:53:27  [<ffffffff80247752>] inet_accept+0x25/0xcb
>2008-05-08 13:53:27  [<ffffffff8020d976>] sys_accept+0x11c/0x1ea
>2008-05-08 13:53:27  [<ffffffff80030f73>] do_fork+0x10e/0x187
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 slurmd        D ffff8100c5428080     0  6799      1   
>      6801  6771 (NOTLB)
>2008-05-08 13:53:27  ffff8100b569bb38 0000000000000082 0000000000000003
>ffff8100ceab29c0
>2008-05-08 13:53:27  ffff8100cec8eb70 0000000000000009 ffff8100c5428080
>ffff8100c416e040
>2008-05-08 13:53:27  000001b7ebe1e4c0 0000000000012052 ffff8100c5428268
>0000000600000092
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:27  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff8802f98a>]
>:sunrpc:rpcauth_lookup_credcache+0x12e/0x24c
>2008-05-08 13:53:27  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:27  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:27  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:27  [<ffffffff8809018a>] :nfs:nfs_permission+0xad/0x1cb
>2008-05-08 13:53:27  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:27  [<ffffffff8000d5ab>] permission+0x81/0xc8
>2008-05-08 13:53:27  [<ffffffff800096e5>] __link_path_walk+0x173/0xf42
>2008-05-08 13:53:27  [<ffffffff8000f083>] __alloc_pages+0x65/0x2ce
>2008-05-08 13:53:27  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:27  [<ffffffff800d2e7f>] shmem_file_write+0x23f/0x251
>2008-05-08 13:53:27  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:27  [<ffffffff800122d3>] getname+0x15b/0x1c1
>2008-05-08 13:53:27  [<ffffffff800236c7>] __user_walk_fd+0x37/0x4c
>2008-05-08 13:53:27  [<ffffffff800285de>] vfs_stat_fd+0x1b/0x4a
>2008-05-08 13:53:27  [<ffffffff800d2e7f>] shmem_file_write+0x23f/0x251
>2008-05-08 13:53:27  [<ffffffff800233f9>] sys_newstat+0x19/0x31
>2008-05-08 13:53:27  [<ffffffff800164a4>] vfs_write+0x13f/0x174
>2008-05-08 13:53:27  [<ffffffff80016d1b>] sys_write+0x60/0x6e
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 slurmd        S ffff8100c532c100     0  6801      1   
>            6799 (NOTLB)
>2008-05-08 13:53:27  ffff8100b56dfd48 0000000000000082 ffff810203840200
>ffffffff80022e5c
>2008-05-08 13:53:27  0000000000000001 0000000000000009 ffff8100c532c100
>ffff8103038b90c0
>2008-05-08 13:53:27  000001b7ed9ba1fd 0000000000004719 ffff8100c532c2e8
>0000000440200ff8
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80022e5c>] flush_tlb_others+0x84/0xbc
>2008-05-08 13:53:27  [<ffffffff8002b156>] flush_tlb_page+0xcd/0xda
>2008-05-08 13:53:27  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:27  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:27  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:27  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:27  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:27 
>2008-05-08 13:53:27 slurmstepd    S 00007fffffffda30     0  6769      1 
>6772    6770  6206 (NOTLB)
>2008-05-08 13:53:27  ffff8101ec0b1ee8 0000000000000082 ffff81009e2793d8
>ffffffff80032e50
>2008-05-08 13:53:27  00007fe400000001 0000000000000007 ffff8101ff92c040
>ffff8101038b4080
>2008-05-08 13:53:27  00000171784b3479 000000000001b9a9 ffff8101ff92c228
>0000000180030a63
>2008-05-08 13:53:27 Call Trace:
>2008-05-08 13:53:27  [<ffffffff80032e50>]
>__tcp_push_pending_frames+0x7a0/0x87a
>2008-05-08 13:53:27  [<ffffffff80028046>] do_wait+0x936/0xa0a
>2008-05-08 13:53:27  [<ffffffff800125f3>] __fput+0x16c/0x198
>2008-05-08 13:53:27  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff800239d6>] filp_close+0x5c/0x64
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 slurmstepd    S ffff8100c52e0820     0  6770      1   
>      6771  6769 (NOTLB)
>2008-05-08 13:53:28  ffff8100a17adb38 0000000000000082 ffff810100003c10
>000200d200000000
>2008-05-08 13:53:28  0000000000000002 000000000000000a ffff8100c52e0820
>ffff81000cf53860
>2008-05-08 13:53:28  000001b7ebcd199f 000000000002ae1a ffff8100c52e0a08
>0000000200000000
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff8002b135>] flush_tlb_page+0xac/0xda
>2008-05-08 13:53:28  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:28  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:28  [<ffffffff8002db22>] pipe_poll+0x2d/0x90
>2008-05-08 13:53:28  [<ffffffff8002f61c>] do_sys_poll+0x277/0x35e
>2008-05-08 13:53:28  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:28  [<ffffffff8000a82b>]
>get_page_from_freelist+0x377/0x3fa
>2008-05-08 13:53:28  [<ffffffff800c159e>] __rmqueue+0x4c/0xe1
>2008-05-08 13:53:28  [<ffffffff80015869>] __bitmap_weight+0x6e/0x80
>2008-05-08 13:53:28  [<ffffffff8002d9ef>] sched_balance_self+0x276/0x2f0
>2008-05-08 13:53:28  [<ffffffff80142f55>] __next_cpu+0x19/0x28
>2008-05-08 13:53:28  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:28  [<ffffffff8008a409>] task_rq_lock+0x3d/0x6f
>2008-05-08 13:53:28  [<ffffffff80033aba>] wake_up_new_task+0x231/0x240
>2008-05-08 13:53:28  [<ffffffff80030f73>] do_fork+0x10e/0x187
>2008-05-08 13:53:28  [<ffffffff8004bbc9>] sys_poll+0x2d/0x34
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 slurmstepd    S ffff8100a1e71bc8     0  6771      1   
>      6799  6770 (NOTLB)
>2008-05-08 13:53:28  ffff8100a1e71b38 0000000000000082 ffff81000001bc00
>000200d000000000
>2008-05-08 13:53:28  0000000000000001 000000000000000a ffff8100cec8d860
>ffffffff802e3ae0
>2008-05-08 13:53:28  000001b7edcd9669 0000000000005e29 ffff8100cec8da48
>0000000000000000
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff8000f083>] __alloc_pages+0x65/0x2ce
>2008-05-08 13:53:28  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:28  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:28  [<ffffffff8002db22>] pipe_poll+0x2d/0x90
>2008-05-08 13:53:28  [<ffffffff8002f61c>] do_sys_poll+0x277/0x35e
>2008-05-08 13:53:28  [<ffffffff8001e476>] __pollwait+0x0/0xe2
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:28  [<ffffffff8000b34a>] vfs_read+0xde/0x171
>2008-05-08 13:53:28  [<ffffffff8004bbc9>] sys_poll+0x2d/0x34
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 cp2k.popt     X 00007fffffff8590     0  6772   6769   
>      6773       (L-TLB)
>2008-05-08 13:53:28  ffff8100a25e9f18 0000000000000046 0000000000000292
>0000000000000001
>2008-05-08 13:53:28  0000000000000000 0000000000000001 ffff81000cf44820
>ffffffff802e3ae0
>2008-05-08 13:53:28  000001b7ebe1333d 000000000001fc63 ffff81000cf44a08
>0000000000000202
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff800bb26f>] check_dead_utrace+0x111/0x172
>2008-05-08 13:53:28  [<ffffffff800157ef>] do_exit+0x8c4/0x8d0
>2008-05-08 13:53:28  [<ffffffff80048a1c>] cpuset_exit+0x0/0x6c
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 cp2k.popt     D ffff8100a1e71bc8     0  6788   6769   
>      6786  6785 (NOTLB)
>2008-05-08 13:53:28  ffff8100a40c3718 0000000000000082 0000000000000000
>0000000000000000
>2008-05-08 13:53:28  0000000000000000 0000000000000009 ffff8100a07a8820
>ffffffff802e3ae0
>2008-05-08 13:53:28  000001bd044f5061 0000000000000fc1 ffff8100a07a8a08
>00000000803053c8
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:28  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:28  [<ffffffff80064c5f>]
>.text.lock.kernel_lock+0x1d/0x1f
>2008-05-08 13:53:28  [<ffffffff80062fa7>] thread_return+0xac/0xdf
>2008-05-08 13:53:28  [<ffffffff80142f55>] __next_cpu+0x19/0x28
>2008-05-08 13:53:28  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:28  [<ffffffff8809373e>] :nfs:nfs_wait_schedule+0x0/0x28
>2008-05-08 13:53:28  [<ffffffff88093760>]
>:nfs:nfs_wait_schedule+0x22/0x28
>2008-05-08 13:53:28  [<ffffffff80063886>] __wait_on_bit_lock+0x36/0x66
>2008-05-08 13:53:28  [<ffffffff8809373e>] :nfs:nfs_wait_schedule+0x0/0x28
>2008-05-08 13:53:28  [<ffffffff80063922>]
>out_of_line_wait_on_bit_lock+0x6c/0x78
>2008-05-08 13:53:28  [<ffffffff8009de10>] wake_bit_function+0x0/0x23
>2008-05-08 13:53:28  [<ffffffff88093850>]
>:nfs:__nfs_revalidate_inode+0xea/0x27d
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff80064969>] __down+0x99/0xd8
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:28  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:28  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:28  [<ffffffff8808f2b1>]
>:nfs:nfs_lookup_revalidate+0x1f2/0x416
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:28  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:28  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:28  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:28  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:28  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:28  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:28  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:28  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:28  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:28  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:28  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:28  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:28  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:28  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:28  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 cp2k.popt     X 00007fffffff8590     0  6773   6769   
>      6774  6772 (L-TLB)
>2008-05-08 13:53:28  ffff8100a2173f18 0000000000000046 ffff81000b4fe980
>0000000000000001
>2008-05-08 13:53:28  0000000000000000 0000000000000001 ffff8100cef11100
>ffff8101038b4080
>2008-05-08 13:53:28  000001b7ebdf1700 00000000000098b2 ffff8100cef112e8
>0000000100000202
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff800bb26f>] check_dead_utrace+0x111/0x172
>2008-05-08 13:53:28  [<ffffffff800157ef>] do_exit+0x8c4/0x8d0
>2008-05-08 13:53:28  [<ffffffff80048a1c>] cpuset_exit+0x0/0x6c
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 cp2k.popt     D ffff8100a4337c98     0  6782   6769   
>      6783  6781 (NOTLB)
>2008-05-08 13:53:28  ffff8100a4337bc8 0000000000000082 0000000000000000
>ffff8100a4337b50
>2008-05-08 13:53:28  ffffffff80089241 0000000000000009 ffff8100c4d847a0
>ffff8101038b4080
>2008-05-08 13:53:28  000001bd044f4414 0000000000010a56 ffff8100c4d84988
>000000018802f98a
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:28  [<ffffffff80063bc7>] __mutex_lock_slowpath+0x60/0x9b
>2008-05-08 13:53:28  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:28  [<ffffffff80063c11>] .text.lock.mutex+0xf/0x14
>2008-05-08 13:53:28  [<ffffffff8000cb71>] do_lookup+0x90/0x1d4
>2008-05-08 13:53:28  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:28  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:28  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:28  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:28  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:28  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:28  [<ffffffff80066852>] do_page_fault+0x4fe/0x830
>2008-05-08 13:53:28  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:28  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:28  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 cp2k.popt     D ffff81000cf64080     0  6790   6769   
>      6791  6789 (NOTLB)
>2008-05-08 13:53:28  ffff8100a40d79c8 0000000000000082 0000000000000000
>0000000000000082
>2008-05-08 13:53:28  ffffffff8004686e 0000000000000008 ffff81000cf64080
>ffff8100c4d847a0
>2008-05-08 13:53:28  000001bd044d6cc9 0000000000465d43 ffff81000cf64268
>00000001803c5480
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff8004686e>] try_to_wake_up+0x407/0x418
>2008-05-08 13:53:28  [<ffffffff80039784>] generic_drop_inode+0x0/0x15a
>2008-05-08 13:53:28  [<ffffffff88090564>] :nfs:nfs_dentry_iput+0x0/0x4e
>2008-05-08 13:53:28  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:28  [<ffffffff8004cd59>] shrink_dcache_parent+0x68/0xe1
>2008-05-08 13:53:28  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:28  [<ffffffff8808f7bb>] :nfs:nfs_lookup+0x9e/0x1d8
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:28  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:28  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:28  [<ffffffff80022663>] d_alloc+0x174/0x1a9
>2008-05-08 13:53:28  [<ffffffff8000cbb4>] do_lookup+0xd3/0x1d4
>2008-05-08 13:53:28  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:28  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:28  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:28  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:28  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:28  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:28  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:28  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:28  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:28  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 cp2k.popt     X 00007fffffff8590     0  6774   6769   
>      6775  6773 (L-TLB)
>2008-05-08 13:53:28  ffff8100a6c0df18 0000000000000046 0000000000000292
>0000000000000001
>2008-05-08 13:53:28  0000000000000000 0000000000000001 ffff81000cf53860
>ffff8103038b8080
>2008-05-08 13:53:28  000001b7ebdfb268 0000000000008082 ffff81000cf53a48
>0000000200000202
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff800bb26f>] check_dead_utrace+0x111/0x172
>2008-05-08 13:53:28  [<ffffffff800157ef>] do_exit+0x8c4/0x8d0
>2008-05-08 13:53:28  [<ffffffff80048a1c>] cpuset_exit+0x0/0x6c
>2008-05-08 13:53:28  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:28 
>2008-05-08 13:53:28 cp2k.popt     D ffff8101f3d39c98     0  6781   6769   
>      6782  6779 (NOTLB)
>2008-05-08 13:53:28  ffff8101f3d399b8 0000000000000086 0000000000000000
>ffff8101fedd4820
>2008-05-08 13:53:28  ffff8101ffef8a80 0000000000000009 ffff8101ff1170c0
>ffff8103038b8080
>2008-05-08 13:53:28  000001b7f04fdb1e 000000000000549f ffff8101ff1172a8
>00000002f3d399c8
>2008-05-08 13:53:28 Call Trace:
>2008-05-08 13:53:28  [<ffffffff8802b716>] :sunrpc:xprt_timer+0x0/0x7f
>2008-05-08 13:53:28  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:28  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:28  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:28  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:28  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:28  [<ffffffff8004686e>] try_to_wake_up+0x407/0x418
>2008-05-08 13:53:28  [<ffffffff8808f109>]
>:nfs:nfs_lookup_revalidate+0x4a/0x416
>2008-05-08 13:53:28  [<ffffffff8809d931>]
>:nfs:nfs3_proc_access+0x12f/0x18e
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:28  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:28  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:28  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:28  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:28  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:28  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:28  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:28  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:28  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:28  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:28  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:28  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:29  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:29  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     D ffff8101f229800b     0  6789   6769   
>      6790  6787 (NOTLB)
>2008-05-08 13:53:29  ffff8101e96efb18 0000000000000086 0000000000000000
>ffff8100cec67c48
>2008-05-08 13:53:29  ffff8100c478da98 0000000000000009 ffff8101fedd4820
>ffff8103038b8080
>2008-05-08 13:53:29  000001bd044f5715 0000000000000674 ffff8101fedd4a08
>0000000203841400
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:29  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:29  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:29  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:29  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:29  [<ffffffff8004686e>] try_to_wake_up+0x407/0x418
>2008-05-08 13:53:29  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:29  [<ffffffff8809018a>] :nfs:nfs_permission+0xad/0x1cb
>2008-05-08 13:53:29  [<ffffffff8000cb46>] do_lookup+0x65/0x1d4
>2008-05-08 13:53:29  [<ffffffff8000d5ab>] permission+0x81/0xc8
>2008-05-08 13:53:29  [<ffffffff800096e5>] __link_path_walk+0x173/0xf42
>2008-05-08 13:53:29  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:29  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:29  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:29  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:29  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     X 00007fffffff8590     0  6775   6769   
>      6776  6774 (L-TLB)
>2008-05-08 13:53:29  ffff8100a1e77f18 0000000000000046 ffff810103849980
>0000000000000001
>2008-05-08 13:53:29  0000000000000000 0000000000000001 ffff81000cf00820
>ffff81010396a0c0
>2008-05-08 13:53:29  000001b7ebde0851 0000000000006569 ffff81000cf00a08
>0000000300000202
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff800bb26f>] check_dead_utrace+0x111/0x172
>2008-05-08 13:53:29  [<ffffffff800157ef>] do_exit+0x8c4/0x8d0
>2008-05-08 13:53:29  [<ffffffff80048a1c>] cpuset_exit+0x0/0x6c
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     D ffff8101ff3bb7e0     0  6784   6769   
>      6785  6783 (NOTLB)
>2008-05-08 13:53:29  ffff8101ed82dbc8 0000000000000086 0000000000000000
>ffff8101ed82db50
>2008-05-08 13:53:29  ffffffff80089241 0000000000000009 ffff8101ff3bb7e0
>ffff8101ff2bb080
>2008-05-08 13:53:29  000001bd044e3f05 000000000000fab9 ffff8101ff3bb9c8
>00000003ed82db90
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:29  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:29  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:29  [<ffffffff80063bc7>] __mutex_lock_slowpath+0x60/0x9b
>2008-05-08 13:53:29  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:29  [<ffffffff80063c11>] .text.lock.mutex+0xf/0x14
>2008-05-08 13:53:29  [<ffffffff8000cb71>] do_lookup+0x90/0x1d4
>2008-05-08 13:53:29  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:29  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:29  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:29  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:29  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:29  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     R  running task       0  6792   6769    
>     6794  6793 (NOTLB)
>2008-05-08 13:53:29 cp2k.popt     D ffff81009e6c1c98     0  6776   6769   
>      6777  6775 (NOTLB)
>2008-05-08 13:53:29  ffff81009e6c19b8 0000000000000082 0000000000000000
>0000000000000000
>2008-05-08 13:53:29  0000000000000000 0000000000000007 ffff81000cf46080
>ffff8103038b90c0
>2008-05-08 13:53:29  000001b7ebe134d4 00000000000043c9 ffff81000cf46268
>0000000480142f55
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff8008992e>] find_busiest_group+0x20d/0x621
>2008-05-08 13:53:29  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:29  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:29  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:29  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:29  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:29  [<ffffffff8004686e>] try_to_wake_up+0x407/0x418
>2008-05-08 13:53:29  [<ffffffff8808f109>]
>:nfs:nfs_lookup_revalidate+0x4a/0x416
>2008-05-08 13:53:29  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:29  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:29  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:29  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:29  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:29  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:29  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:29  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:29  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:29  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:29  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:29  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:29  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:29  [<ffffffff80066852>] do_page_fault+0x4fe/0x830
>2008-05-08 13:53:29  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:29  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     S ffff8102ff4c6100     0  6783   6769   
>      6784  6782 (NOTLB)
>2008-05-08 13:53:29  ffff8102fe22be88 0000000000000082 ffff8102e70cf5f0
>ffff8102e79c5380
>2008-05-08 13:53:29  0000000000000296 0000000000000009 ffff8102ff4c6100
>ffff81000cf46080
>2008-05-08 13:53:29  0000017262c15c8e 000000000001ef35 ffff8102ff4c62e8
>0000000400000078
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff8841598a>]
>:ib_uverbs:ib_uverbs_modify_qp+0x23a/0x250
>2008-05-08 13:53:29  [<ffffffff8841382e>]
>:ib_uverbs:ib_uverbs_event_read+0xbc/0x187
>2008-05-08 13:53:29  [<ffffffff8009dde2>]
>autoremove_wake_function+0x0/0x2e
>2008-05-08 13:53:29  [<ffffffff8000b337>] vfs_read+0xcb/0x171
>2008-05-08 13:53:29  [<ffffffff80011715>] sys_read+0x45/0x6e
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     S ffff810203a9c820     0  6791   6769   
>      6793  6790 (NOTLB)
>2008-05-08 13:53:29  ffff8102fd171d48 0000000000000082 60850000ba390bca
>400c00001fba390b
>2008-05-08 13:53:29  80000002845c0000 000000000000000a ffff810203a9c820
>ffff81000cf46080
>2008-05-08 13:53:29  000001726905d68c 000000000000399f ffff810203a9ca08
>000000041f62fd03
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:29  [<ffffffff8000a82b>]
>get_page_from_freelist+0x377/0x3fa
>2008-05-08 13:53:29  [<ffffffff800357a0>] find_extend_vma+0x16/0x59
>2008-05-08 13:53:29  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:29  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:29  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:29  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:29  [<ffffffff8003aa41>] hrtimer_try_to_cancel+0x4a/0x53
>2008-05-08 13:53:29  [<ffffffff8005a21d>] hrtimer_cancel+0xc/0x16
>2008-05-08 13:53:29  [<ffffffff80063c5d>] do_nanosleep+0x47/0x70
>2008-05-08 13:53:29  [<ffffffff8005a10a>] hrtimer_nanosleep+0x58/0x118
>2008-05-08 13:53:29  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     X 00007fffffff8590     0  6777   6769   
>      6778  6776 (L-TLB)
>2008-05-08 13:53:29  ffff8100c09fdf18 0000000000000046 ffff810203849980
>0000000000000001
>2008-05-08 13:53:29  0000000000000000 0000000000000001 ffff8100c50c5080
>ffff81010396b100
>2008-05-08 13:53:29  000001b7ebe114d8 0000000000006311 ffff8100c50c5268
>0000000500000202
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff800bb26f>] check_dead_utrace+0x111/0x172
>2008-05-08 13:53:29  [<ffffffff800157ef>] do_exit+0x8c4/0x8d0
>2008-05-08 13:53:29  [<ffffffff80048a1c>] cpuset_exit+0x0/0x6c
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     D ffff810203b3c7e0     0  6786   6769   
>      6787  6788 (NOTLB)
>2008-05-08 13:53:29  ffff8102fd7c99b8 0000000000000082 0000000000000000
>ffff8100c50c5080
>2008-05-08 13:53:29  ffff8101ffef8a80 0000000000000009 ffff810203b3c7e0
>ffff8102fe7147a0
>2008-05-08 13:53:29  000001b7f15a4f8a 00000000000064d3 ffff810203b3c9c8
>00000005fd7c99c8
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff8802e360>]
>:sunrpc:rpc_wait_bit_interruptible+0x0/0x28
>2008-05-08 13:53:29  [<ffffffff8006398e>] __wait_on_bit+0x60/0x6e
>2008-05-08 13:53:29  [<ffffffff8802b716>] :sunrpc:xprt_timer+0x0/0x7f
>2008-05-08 13:53:29  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:29  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:29  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:29  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:29  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:29  [<ffffffff80064c51>] .text.lock.kernel_lock+0xf/0x1f
>2008-05-08 13:53:29  [<ffffffff8004686e>] try_to_wake_up+0x407/0x418
>2008-05-08 13:53:29  [<ffffffff8808f109>]
>:nfs:nfs_lookup_revalidate+0x4a/0x416
>2008-05-08 13:53:29  [<ffffffff8809d931>]
>:nfs:nfs3_proc_access+0x12f/0x18e
>2008-05-08 13:53:29  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:29  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:29  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:29  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:29  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:29  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:29  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:29  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:29  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:29  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:29  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:29  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:29  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     D ffff8102fe3ed760     0  6794   6769   
>      6795  6792 (NOTLB)
>2008-05-08 13:53:29  0000000000000018 ffffffff800624fe 0000000000000000
>0000000000000000
>2008-05-08 13:53:29  0000000000000000 0000000000000001 ffff8102fe7147a0
>ffff8102fe7147a0
>2008-05-08 13:53:29  000001c0d986c2f6 00000000000000c6 ffff8102fe714990
>00000005803053c8
>2008-05-08 13:53:29 Call Trace:
>2008-05-08 13:53:29  [<ffffffff8006258f>] __sched_text_start+0x17f/0xaeb
>2008-05-08 13:53:29  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:29  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:29  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:29  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:29  [<ffffffff80039784>] generic_drop_inode+0x0/0x15a
>2008-05-08 13:53:29  [<ffffffff80064c5f>]
>.text.lock.kernel_lock+0x1d/0x1f
>2008-05-08 13:53:29  [<ffffffff8008c2ce>] __cond_resched+0x1c/0x44
>2008-05-08 13:53:29  [<ffffffff80062fa7>] thread_return+0xac/0xdf
>2008-05-08 13:53:29  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:29  [<ffffffff88090564>] :nfs:nfs_dentry_iput+0x0/0x4e
>2008-05-08 13:53:29  [<ffffffff8008c2ce>] __cond_resched+0x1c/0x44
>2008-05-08 13:53:29  [<ffffffff80063015>] cond_resched+0x3b/0x42
>2008-05-08 13:53:29  [<ffffffff8000d043>] dput+0x1d/0x114
>2008-05-08 13:53:29  [<ffffffff800e2014>] prune_one_dentry+0x66/0x76
>2008-05-08 13:53:29  [<ffffffff8002e88a>] prune_dcache+0xe0/0x149
>2008-05-08 13:53:29  [<ffffffff8004cd59>] shrink_dcache_parent+0x68/0xe1
>2008-05-08 13:53:29  [<ffffffff8004cd0d>] shrink_dcache_parent+0x1c/0xe1
>2008-05-08 13:53:29  [<ffffffff8808f41b>]
>:nfs:nfs_lookup_revalidate+0x35c/0x416
>2008-05-08 13:53:29  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:29  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:29  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:29  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:29  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:29  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:29  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:29  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:29  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:29  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:29  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:29  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:29  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:29  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:29  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:29  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:29  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:29 
>2008-05-08 13:53:29 cp2k.popt     D ffffffff803c8320     0  6778   6769   
>      6779  6777 (NOTLB)
>2008-05-08 13:53:29  ffff8100ad2437c8 0000000000000082 ffffffff8008a60e
>000001b7ed593acc
>2008-05-08 13:53:29  0000000000000006 0000000000000007 ffff8100c416e040
>ffff81030395c100
>2008-05-08 13:53:30  000001b7ed5a6642 00000000000006cb ffff8100c416e228
>0000000603849980
>2008-05-08 13:53:30 Call Trace:
>2008-05-08 13:53:30  [<ffffffff8008a60e>] __activate_task+0x27/0x39
>2008-05-08 13:53:30  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:30  [<ffffffff80064c5f>]
>.text.lock.kernel_lock+0x1d/0x1f
>2008-05-08 13:53:30  [<ffffffff80062fa7>] thread_return+0xac/0xdf
>2008-05-08 13:53:30  [<ffffffff8802e360>]
>:sunrpc:rpc_wait_bit_interruptible+0x0/0x28
>2008-05-08 13:53:30  [<ffffffff8802e382>]
>:sunrpc:rpc_wait_bit_interruptible+0x22/0x28
>2008-05-08 13:53:30  [<ffffffff8006396e>] __wait_on_bit+0x40/0x6e
>2008-05-08 13:53:30  [<ffffffff8802b716>] :sunrpc:xprt_timer+0x0/0x7f
>2008-05-08 13:53:30  [<ffffffff8802e360>]
>:sunrpc:rpc_wait_bit_interruptible+0x0/0x28
>2008-05-08 13:53:30  [<ffffffff80063a08>]
>out_of_line_wait_on_bit+0x6c/0x78
>2008-05-08 13:53:30  [<ffffffff8009de10>] wake_bit_function+0x0/0x23
>2008-05-08 13:53:30  [<ffffffff88029424>]
>:sunrpc:call_transmit+0x1f6/0x222
>2008-05-08 13:53:30  [<ffffffff8802ead4>]
>:sunrpc:__rpc_execute+0x110/0x24e
>2008-05-08 13:53:30  [<ffffffff88029aa7>] :sunrpc:rpc_call_sync+0x7e/0xa8
>2008-05-08 13:53:30  [<ffffffff88029a24>]
>:sunrpc:rpc_save_sigmask+0x2a/0x2f
>2008-05-08 13:53:30  [<ffffffff8809d315>] :nfs:nfs3_rpc_wrapper+0x29/0x6d
>2008-05-08 13:53:30  [<ffffffff8809d924>]
>:nfs:nfs3_proc_access+0x122/0x18e
>2008-05-08 13:53:30  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:30  [<ffffffff80064969>] __down+0x99/0xd8
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff8808fdf0>]
>:nfs:nfs_access_free_entry+0x15/0x1f
>2008-05-08 13:53:30  [<ffffffff8808ffd2>]
>:nfs:__nfs_access_zap_cache+0x6b/0x7c
>2008-05-08 13:53:30  [<ffffffff88090213>] :nfs:nfs_permission+0x136/0x1cb
>2008-05-08 13:53:30  [<ffffffff8000d5ab>] permission+0x81/0xc8
>2008-05-08 13:53:30  [<ffffffff800096e5>] __link_path_walk+0x173/0xf42
>2008-05-08 13:53:30  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:30  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:30  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:30  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:30  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:30  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:30 
>2008-05-08 13:53:30 cp2k.popt     D ffffffff803c8320     0  6785   6769   
>      6788  6784 (NOTLB)
>2008-05-08 13:53:30  ffff8103fe8e3638 0000000000000082 0000000000000000
>0000000000000000
>2008-05-08 13:53:30  0000000000000000 000000000000000a ffff8103ff2de860
>ffff81030395c100
>2008-05-08 13:53:30  000001b7ebe28d1b 00000000000007ef ffff8103ff2dea48
>0000000603841400
>2008-05-08 13:53:30 Call Trace:
>2008-05-08 13:53:30  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:30  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:30  [<ffffffff80064c5f>]
>.text.lock.kernel_lock+0x1d/0x1f
>2008-05-08 13:53:30  [<ffffffff80062fa7>] thread_return+0xac/0xdf
>2008-05-08 13:53:30  [<ffffffff8004686e>] try_to_wake_up+0x407/0x418
>2008-05-08 13:53:30  [<ffffffff8020dc02>] kernel_sendmsg+0x35/0x47
>2008-05-08 13:53:30  [<ffffffff8802c53e>]
>:sunrpc:xs_tcp_send_request+0x10a/0x2c8
>2008-05-08 13:53:30  [<ffffffff8802e360>]
>:sunrpc:rpc_wait_bit_interruptible+0x0/0x28
>2008-05-08 13:53:30  [<ffffffff8802e382>]
>:sunrpc:rpc_wait_bit_interruptible+0x22/0x28
>2008-05-08 13:53:30  [<ffffffff8006396e>] __wait_on_bit+0x40/0x6e
>2008-05-08 13:53:30  [<ffffffff8802b716>] :sunrpc:xprt_timer+0x0/0x7f
>2008-05-08 13:53:30  [<ffffffff8802e360>]
>:sunrpc:rpc_wait_bit_interruptible+0x0/0x28
>2008-05-08 13:53:30  [<ffffffff80063a08>]
>out_of_line_wait_on_bit+0x6c/0x78
>2008-05-08 13:53:30  [<ffffffff8009de10>] wake_bit_function+0x0/0x23
>2008-05-08 13:53:30  [<ffffffff88029424>]
>:sunrpc:call_transmit+0x1f6/0x222
>2008-05-08 13:53:30  [<ffffffff8802ead4>]
>:sunrpc:__rpc_execute+0x110/0x24e
>2008-05-08 13:53:30  [<ffffffff88029aa7>] :sunrpc:rpc_call_sync+0x7e/0xa8
>2008-05-08 13:53:30  [<ffffffff88029a24>]
>:sunrpc:rpc_save_sigmask+0x2a/0x2f
>2008-05-08 13:53:30  [<ffffffff8809d315>] :nfs:nfs3_rpc_wrapper+0x29/0x6d
>2008-05-08 13:53:30  [<ffffffff8809d662>]
>:nfs:nfs3_proc_getattr+0x61/0x85
>2008-05-08 13:53:30  [<ffffffff8809389b>]
>:nfs:__nfs_revalidate_inode+0x135/0x27d
>2008-05-08 13:53:30  [<ffffffff8006398e>] __wait_on_bit+0x60/0x6e
>2008-05-08 13:53:30  [<ffffffff8802b716>] :sunrpc:xprt_timer+0x0/0x7f
>2008-05-08 13:53:30  [<ffffffff8802f081>]
>:sunrpc:rpc_wake_up_next+0x165/0x171
>2008-05-08 13:53:30  [<ffffffff8802b703>]
>:sunrpc:xprt_release+0x121/0x134
>2008-05-08 13:53:30  [<ffffffff8802f4ae>]
>:sunrpc:rpcauth_unbindcred+0x46/0x52
>2008-05-08 13:53:30  [<ffffffff8001d6df>] sigprocmask+0xb7/0xdb
>2008-05-08 13:53:30  [<ffffffff88029ac7>] :sunrpc:rpc_call_sync+0x9e/0xa8
>2008-05-08 13:53:30  [<ffffffff8808f2b1>]
>:nfs:nfs_lookup_revalidate+0x1f2/0x416
>2008-05-08 13:53:30  [<ffffffff880935d9>]
>:nfs:nfs_refresh_inode+0x7e/0x182
>2008-05-08 13:53:30  [<ffffffff8809d931>]
>:nfs:nfs3_proc_access+0x12f/0x18e
>2008-05-08 13:53:30  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:30  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:30  [<ffffffff8808fec8>]
>:nfs:nfs_access_add_cache+0xce/0x16d
>2008-05-08 13:53:30  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:30  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:30  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:30  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:30  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:30  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:30  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:30  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:30  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:30 
>2008-05-08 13:53:30 cp2k.popt     S ffff8103fec997a0     0  6793   6769   
>      6792  6791 (NOTLB)
>2008-05-08 13:53:30  ffff8103ff197d48 0000000000000082 60850000f63b00fc
>002400001ff63b00
>2008-05-08 13:53:30  8000000204e50000 000000000000000a ffff8103fec997a0
>ffff8100c416e040
>2008-05-08 13:53:30  0000017269056831 0000000000003e17 ffff8103fec99988
>000000061f145200
>2008-05-08 13:53:30 Call Trace:
>2008-05-08 13:53:30  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:30  [<ffffffff8000a82b>]
>get_page_from_freelist+0x377/0x3fa
>2008-05-08 13:53:30  [<ffffffff800357a0>] find_extend_vma+0x16/0x59
>2008-05-08 13:53:30  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:30  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:30  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff8003aa41>] hrtimer_try_to_cancel+0x4a/0x53
>2008-05-08 13:53:30  [<ffffffff8005a21d>] hrtimer_cancel+0xc/0x16
>2008-05-08 13:53:30  [<ffffffff80063c5d>] do_nanosleep+0x47/0x70
>2008-05-08 13:53:30  [<ffffffff8005a10a>] hrtimer_nanosleep+0x58/0x118
>2008-05-08 13:53:30  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:30  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:30 
>2008-05-08 13:53:30 cp2k.popt     D ffffffff803c8340     0  6779   6769   
>      6781  6778 (NOTLB)
>2008-05-08 13:53:30  ffff8100cee73718 0000000000000082 ffff8100cee737b8
>0000000780062efb
>2008-05-08 13:53:30  ffff81030384afa0 0000000000000001 ffff81000cf2a080
>ffff81010396d040
>2008-05-08 13:53:30  000001b7ee584b6c 0000000000000835 ffff81000cf2a268
>0000000700000000
>2008-05-08 13:53:30 Call Trace:
>2008-05-08 13:53:30  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:30  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:30  [<ffffffff80064c5f>]
>.text.lock.kernel_lock+0x1d/0x1f
>2008-05-08 13:53:30  [<ffffffff80062fa7>] thread_return+0xac/0xdf
>2008-05-08 13:53:30  [<ffffffff80142f55>] __next_cpu+0x19/0x28
>2008-05-08 13:53:30  [<ffffffff8809373e>] :nfs:nfs_wait_schedule+0x0/0x28
>2008-05-08 13:53:30  [<ffffffff88093760>]
>:nfs:nfs_wait_schedule+0x22/0x28
>2008-05-08 13:53:30  [<ffffffff80063886>] __wait_on_bit_lock+0x36/0x66
>2008-05-08 13:53:30  [<ffffffff8809373e>] :nfs:nfs_wait_schedule+0x0/0x28
>2008-05-08 13:53:30  [<ffffffff80063922>]
>out_of_line_wait_on_bit_lock+0x6c/0x78
>2008-05-08 13:53:30  [<ffffffff8009de10>] wake_bit_function+0x0/0x23
>2008-05-08 13:53:30  [<ffffffff88093850>]
>:nfs:__nfs_revalidate_inode+0xea/0x27d
>2008-05-08 13:53:30  [<ffffffff8007553f>] smp_send_reschedule+0x4e/0x53
>2008-05-08 13:53:30  [<ffffffff8004686e>] try_to_wake_up+0x407/0x418
>2008-05-08 13:53:30  [<ffffffff8808f2b1>]
>:nfs:nfs_lookup_revalidate+0x1f2/0x416
>2008-05-08 13:53:30  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:30  [<ffffffff80064969>] __down+0x99/0xd8
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff8802f98a>]
>:sunrpc:rpcauth_lookup_credcache+0x12e/0x24c
>2008-05-08 13:53:30  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:30  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:30  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:30  [<ffffffff8809008e>]
>:nfs:nfs_access_get_cached+0xab/0xfa
>2008-05-08 13:53:30  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:30  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:30  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:30  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:30  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:30  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:30  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:30  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:30  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:30 
>2008-05-08 13:53:30 cp2k.popt     D ffffffff803c8340     0  6787   6769   
>      6789  6786 (NOTLB)
>2008-05-08 13:53:30  ffff8103ff57b718 0000000000000082 0000000000000000
>0000000000000000
>2008-05-08 13:53:30  0000000000000000 000000000000000a ffff8103ff44a820
>ffff81010396d040
>2008-05-08 13:53:30  000001b7ebe28759 00000000000007b5 ffff8103ff44aa08
>000000070b4fe980
>2008-05-08 13:53:30 Call Trace:
>2008-05-08 13:53:30  [<ffffffff80064993>] __down+0xc3/0xd8
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:30  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:30  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:30  [<ffffffff80064c5f>]
>.text.lock.kernel_lock+0x1d/0x1f
>2008-05-08 13:53:30  [<ffffffff80062fa7>] thread_return+0xac/0xdf
>2008-05-08 13:53:30  [<ffffffff8809373e>] :nfs:nfs_wait_schedule+0x0/0x28
>2008-05-08 13:53:30  [<ffffffff88093760>]
>:nfs:nfs_wait_schedule+0x22/0x28
>2008-05-08 13:53:30  [<ffffffff80063886>] __wait_on_bit_lock+0x36/0x66
>2008-05-08 13:53:30  [<ffffffff8809373e>] :nfs:nfs_wait_schedule+0x0/0x28
>2008-05-08 13:53:30  [<ffffffff80063922>]
>out_of_line_wait_on_bit_lock+0x6c/0x78
>2008-05-08 13:53:30  [<ffffffff8009de10>] wake_bit_function+0x0/0x23
>2008-05-08 13:53:30  [<ffffffff88093850>]
>:nfs:__nfs_revalidate_inode+0xea/0x27d
>2008-05-08 13:53:30  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:30  [<ffffffff80064969>] __down+0x99/0xd8
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:30  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:30  [<ffffffff8808f2b1>]
>:nfs:nfs_lookup_revalidate+0x1f2/0x416
>2008-05-08 13:53:30  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:30  [<ffffffff80064969>] __down+0x99/0xd8
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff8802f98a>]
>:sunrpc:rpcauth_lookup_credcache+0x12e/0x24c
>2008-05-08 13:53:30  [<ffffffff80064651>] __down_failed+0x35/0x3a
>2008-05-08 13:53:30  [<ffffffff8809008e>]
>:nfs:nfs_access_get_cached+0xab/0xfa
>2008-05-08 13:53:30  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:30  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:30  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:30  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:30  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:30  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:30  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:30  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:30  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:30  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:30  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:30 
>2008-05-08 13:53:30 cp2k.popt     S ffff8103ff1b9820     0  6795   6769   
>            6794 (NOTLB)
>2008-05-08 13:53:30  ffff8103ffddbd48 0000000000000082 0000000000000000
>6085b6091fc93e00
>2008-05-08 13:53:30  8000800a09180000 000000000000000a ffff8103ff1b9820
>ffff81000cf2a080
>2008-05-08 13:53:30  0000017268f5e8c8 000000000000403f ffff8103ff1b9a08
>000000071f2c4f00
>2008-05-08 13:53:30 Call Trace:
>2008-05-08 13:53:30  [<ffffffff800c572d>] zone_statistics+0x3e/0x6d
>2008-05-08 13:53:30  [<ffffffff8000a82b>]
>get_page_from_freelist+0x377/0x3fa
>2008-05-08 13:53:30  [<ffffffff800357a0>] find_extend_vma+0x16/0x59
>2008-05-08 13:53:30  [<ffffffff80063797>] schedule_timeout+0x1e/0xad
>2008-05-08 13:53:30  [<ffffffff800492a4>] add_wait_queue+0x24/0x34
>2008-05-08 13:53:30  [<ffffffff8003ddd7>] do_futex+0x1da/0xbc7
>2008-05-08 13:53:30  [<ffffffff8008ac03>] default_wake_function+0x0/0xe
>2008-05-08 13:53:30  [<ffffffff8003aa41>] hrtimer_try_to_cancel+0x4a/0x53
>2008-05-08 13:53:30  [<ffffffff8005a21d>] hrtimer_cancel+0xc/0x16
>2008-05-08 13:53:31  [<ffffffff80063c5d>] do_nanosleep+0x47/0x70
>2008-05-08 13:53:31  [<ffffffff8005a10a>] hrtimer_nanosleep+0x58/0x118
>2008-05-08 13:53:31  [<ffffffff800a12c7>] sys_futex+0x101/0x122
>2008-05-08 13:53:31  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:31 
>2008-05-08 13:53:41 BUG: soft lockup - CPU#3 stuck for 10s!
>[cp2k.popt:6792]
>2008-05-08 13:53:41 CPU 3:
>2008-05-08 13:53:41 Modules linked in: job(U) w83627hf hwmon_vid i2c_isa
>ib_ipoib rdma_ucm rdma_cm iw_cm ib_addr ib_ucm ib_uverbs ib_umad ib_mthca
>ib_cm ib_sa ib_mad ib_core ipv6 xfrm_nalgo crypto_api sd_mod sg dm_mirror
>dm_multipath dm_mod video sbs backlight i2c_ec button battery asus_acpi
>acpi_memhotplug ac parport_pc lp parport joydev usb_storage floppy sata_nv
>pcspkr libata ohci_hcd scsi_mod i2c_nforce2 i2c_core k8temp hwmon k8_edac
>edac_mc shpchp serio_raw nfs nfs_acl lockd fscache sunrpc e1000
>2008-05-08 13:53:41 Pid: 6792, comm: cp2k.popt Tainted: G     
>2.6.18-92.el5 #1
>2008-05-08 13:53:41 RIP: 0010:[<ffffffff8002e7ff>]  [<ffffffff8002e7ff>]
>prune_dcache+0x55/0x149
>2008-05-08 13:53:41 RSP: 0018:ffff8101ff5c7a38  EFLAGS: 00000206
>2008-05-08 13:53:41 RAX: 0000000000000529 RBX: ffff8101e6ac8810 RCX:
>0000000000000001
>2008-05-08 13:53:41 RDX: ffff8101e6ac8850 RSI: ffffffff802f4080 RDI:
>ffffffff803c5480
>2008-05-08 13:53:41 RBP: 0000000000000246 R08: ffff8101ff5c6000 R09:
>0000000000000246
>2008-05-08 13:53:41 R10: 0000000000000246 R11: fffffffffffffeff R12:
>0000000000000246
>2008-05-08 13:53:41 R13: fffffffffffffeff R14: ffff8101ff5c7a28 R15:
>ffff8101cda123d8
>2008-05-08 13:53:41 FS:  0000000040201940(0063) GS:ffff8101039697c0(0000)
>knlGS:0000000000000000
>2008-05-08 13:53:41 CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>2008-05-08 13:53:41 CR2: 00002aaaab56b0f4 CR3: 00000001fe4a3000 CR4:
>00000000000006e0
>2008-05-08 13:53:41 
>2008-05-08 13:53:41 Call Trace:
>2008-05-08 13:53:41  [<ffffffff8002e7d7>] prune_dcache+0x2d/0x149
>2008-05-08 13:53:41  [<ffffffff8004cd59>] shrink_dcache_parent+0x68/0xe1
>2008-05-08 13:53:41  [<ffffffff8004cd0d>] shrink_dcache_parent+0x1c/0xe1
>2008-05-08 13:53:41  [<ffffffff8808f41b>]
>:nfs:nfs_lookup_revalidate+0x35c/0x416
>2008-05-08 13:53:41  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:41  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:41  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:41  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:41  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:41  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:41  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:41  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:41  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:41  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:41  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:41  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:41  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:41  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:41  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:41  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:41  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:41  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:41  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:41 
>2008-05-08 13:53:51 BUG: soft lockup - CPU#3 stuck for 10s!
>[cp2k.popt:6792]
>2008-05-08 13:53:51 CPU 3:
>2008-05-08 13:53:51 Modules linked in: job(U) w83627hf hwmon_vid i2c_isa
>ib_ipoib rdma_ucm rdma_cm iw_cm ib_addr ib_ucm ib_uverbs ib_umad ib_mthca
>ib_cm ib_sa ib_mad ib_core ipv6 xfrm_nalgo crypto_api sd_mod sg dm_mirror
>dm_multipath dm_mod video sbs backlight i2c_ec button battery asus_acpi
>acpi_memhotplug ac parport_pc lp parport joydev usb_storage floppy sata_nv
>pcspkr libata ohci_hcd scsi_mod i2c_nforce2 i2c_core k8temp hwmon k8_edac
>edac_mc shpchp serio_raw nfs nfs_acl lockd fscache sunrpc e1000
>2008-05-08 13:53:51 Pid: 6792, comm: cp2k.popt Tainted: G     
>2.6.18-92.el5 #1
>2008-05-08 13:53:51 RIP: 0010:[<ffffffff8002e7ff>]  [<ffffffff8002e7ff>]
>prune_dcache+0x55/0x149
>2008-05-08 13:53:51 RSP: 0018:ffff8101ff5c7a38  EFLAGS: 00000206
>2008-05-08 13:53:51 RAX: 000000000000211c RBX: ffff8101e79ceb70 RCX:
>0000000000000001
>2008-05-08 13:53:51 RDX: ffff8101e79cebb0 RSI: ffffffff802f4080 RDI:
>ffffffff803c5480
>2008-05-08 13:53:51 RBP: 0000000000000246 R08: ffff8101ff5c6000 R09:
>0000000000000246
>2008-05-08 13:53:51 R10: 0000000000000246 R11: fffffffffffffeff R12:
>0000000000000246
>2008-05-08 13:53:51 R13: fffffffffffffeff R14: ffff8101ff5c7a28 R15:
>ffff8101cda123d8
>2008-05-08 13:53:51 FS:  0000000040201940(0063) GS:ffff8101039697c0(0000)
>knlGS:0000000000000000
>2008-05-08 13:53:51 CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>2008-05-08 13:53:51 CR2: 00002aaaab56b0f4 CR3: 00000001fe4a3000 CR4:
>00000000000006e0
>2008-05-08 13:53:51 
>2008-05-08 13:53:51 Call Trace:
>2008-05-08 13:53:51  [<ffffffff8002e7d7>] prune_dcache+0x2d/0x149
>2008-05-08 13:53:51  [<ffffffff8004cd59>] shrink_dcache_parent+0x68/0xe1
>2008-05-08 13:53:51  [<ffffffff8004cd0d>] shrink_dcache_parent+0x1c/0xe1
>2008-05-08 13:53:51  [<ffffffff8808f41b>]
>:nfs:nfs_lookup_revalidate+0x35c/0x416
>2008-05-08 13:53:51  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:51  [<ffffffff80089241>] __wake_up_common+0x3e/0x68
>2008-05-08 13:53:51  [<ffffffff8002e254>] __wake_up+0x38/0x4f
>2008-05-08 13:53:51  [<ffffffff800646ff>] __up_wakeup+0x35/0x67
>2008-05-08 13:53:51  [<ffffffff8002c525>] dummy_inode_permission+0x0/0x3
>2008-05-08 13:53:51  [<ffffffff80064c47>] .text.lock.kernel_lock+0x5/0x1f
>2008-05-08 13:53:51  [<ffffffff80009523>] __d_lookup+0xb0/0xff
>2008-05-08 13:53:51  [<ffffffff8000cc5e>] do_lookup+0x17d/0x1d4
>2008-05-08 13:53:51  [<ffffffff80009918>] __link_path_walk+0x3a6/0xf42
>2008-05-08 13:53:51  [<ffffffff8000e782>] link_path_walk+0x5c/0xe5
>2008-05-08 13:53:51  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:51  [<ffffffff8000c965>] do_path_lookup+0x270/0x2e8
>2008-05-08 13:53:51  [<ffffffff800234db>]
>__path_lookup_intent_open+0x56/0x97
>2008-05-08 13:53:51  [<ffffffff8001a954>] open_namei+0x73/0x6d5
>2008-05-08 13:53:51  [<ffffffff80017542>] cache_grow+0x356/0x395
>2008-05-08 13:53:51  [<ffffffff8002732a>] do_filp_open+0x1c/0x38
>2008-05-08 13:53:51  [<ffffffff8005be70>] cache_alloc_refill+0x106/0x186
>2008-05-08 13:53:51  [<ffffffff80019720>] do_sys_open+0x44/0xbe
>2008-05-08 13:53:51  [<ffffffff8005d116>] system_call+0x7e/0x83
>2008-05-08 13:53:51 
>
>
>
>
>
>This event sent from IssueTracker by streeter  [SEG - Kernel]
> issue 178773

Actions: View

Attachments on bug 450194: 308995 | 915143