Attachment 314497 Details for Bug 437674 – full kernel panic output

full kernel panic output

log.txt (text/plain), 117.89 KB, created by Joseph W. Breu on 2008-08-18 21:18:59 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Joseph W. Breu

Created: 2008-08-18 21:18:59 UTC

Size: 117.89 KB

patch

obsolete

>[...network console startup...]
>------------[ cut here ]------------
>kernel BUG at net/ipv4/tcp_output.c:943!
>invalid operand: 0000 [#1]
>SMP 
>Modules linked in: netconsole netdump nfs lockd nfs_acl sunrpc cpqci(U) mptctl mptbase sg ipmi_si(U) ipmi_devintf(U) ipmi_msghandler(U) i2c_dev i2c_core dm_mirror dm_mod joydev button battery ac uhci_hcd ohci_hcd ehci_hcd k8_edac edac_mc bnx2 ext3 jbd cciss sd_mod scsi_mod
>CPU:    0
>EIP:    0060:[<c02ad6e5>]    Tainted: P      VLI
>EFLAGS: 00010202   (2.6.9-67.0.15.ELsmp) 
>EIP is at tcp_retrans_try_collapse+0xbc/0x2a6
>eax: f7033180   ebx: f6353280   ecx: 0000050f   edx: e37f0b58
>esi: e37f0b58   edi: e37f0940   ebp: f5fbe880   esp: c03d6f60
>ds: 007b   es: 007b   ss: 0068
>Process swapper (pid: 0, threadinfo=c03d6000 task=c0327a80)
>Stack: 00000010 0000030f 00000200 e37f0b58 e37f0940 f6353280 e37f0b58 e37f0940 
>       fffffff5 c02adb8b 0000050f e37f0b58 e37f09b4 e37f0940 e37f0b58 c03d6fcc 
>       c02af88c e37f0940 e37f0b58 c363c860 c03d6fcc c02afa36 c02af9b7 e37f0940 
>Call Trace:
> [<c02adb8b>] tcp_retransmit_skb+0x176/0x2dd
> [<c02af88c>] tcp_retransmit_timer+0x25f/0x38a
> [<c02afa36>] tcp_write_timer+0x7f/0xb9
> [<c02af9b7>] tcp_write_timer+0x0/0xb9
> [<c02af9b7>] tcp_write_timer+0x0/0xb9
> [<c012a5d1>] run_timer_softirq+0x123/0x145
> [<c0126a40>] __do_softirq+0x4c/0xb1
> [<c010819f>] do_softirq+0x4f/0x56
> =======================
> [<c01174b6>] smp_apic_timer_interrupt+0x9a/0x9c
> [<c02d95ae>] apic_timer_interrupt+0x1a/0x20
> [<c0104018>] default_idle+0x0/0x2f
> [<c0104041>] default_idle+0x29/0x2f
> [<c01040a0>] cpu_idle+0x26/0x3b
> [<c039b786>] start_kernel+0x199/0x19d
>Code: 00 8b 44 24 08 03 44 24 04 39 c8 0f 8f fc 01 00 00 8b 83 ac 00 00 00 66 83 78 0a 01 75 0d 8b 85 ac 00 00 00 66 83 78 0a 01 74 08 <0f> 0b af 03 ff ea 30 c0 8b 45 08 ff 48 08 c7 45 08 00 00 00 00 
>
>Pid: 0, comm:              swapper
>EIP: 0060:[<c02ad6e5>] CPU: 0
>EIP is at tcp_retrans_try_collapse+0xbc/0x2a6
> EFLAGS: 00010202    Tainted: P       (2.6.9-67.0.15.ELsmp)
>EAX: f7033180 EBX: f6353280 ECX: 0000050f EDX: e37f0b58
>ESI: e37f0b58 EDI: e37f0940 EBP: f5fbe880 DS: 007b ES: 007b
>CR0: 8005003b CR2: b7f13000 CR3: 038f1680 CR4: 000006f0
> [<c02adb8b>] tcp_retransmit_skb+0x176/0x2dd
> [<c02af88c>] tcp_retransmit_timer+0x25f/0x38a
> [<c02afa36>] tcp_write_timer+0x7f/0xb9
> [<c02af9b7>] tcp_write_timer+0x0/0xb9
> [<c02af9b7>] tcp_write_timer+0x0/0xb9
> [<c012a5d1>] run_timer_softirq+0x123/0x145
> [<c0126a40>] __do_softirq+0x4c/0xb1
> [<c010819f>] do_softirq+0x4f/0x56
> =======================
> [<c01174b6>] smp_apic_timer_interrupt+0x9a/0x9c
> [<c02d95ae>] apic_timer_interrupt+0x1a/0x20
> [<c0104018>] default_idle+0x0/0x2f
> [<c0104041>] default_idle+0x29/0x2f
> [<c01040a0>] cpu_idle+0x26/0x3b
> [<c039b786>] start_kernel+0x199/0x19d
>
>                                               sibling
>  task             PC      pid father child younger older
>init          S 00000000   916     1      0     2               (NOTLB)
>f7f14ebc 00000086 c3b575a4 00000000 c01707a8 f7f14f0c 00000000 e04ea000 
>       c0168877 c032f580 c032f500 c3643de0 00000001 00000000 e7f4da40 000f7402 
>       c38510b0 c3851630 c385179c 00000000 00000246 0342eee9 f7f14ecc 00000000 
>Call Trace:
> [<c01707a8>] dput+0x34/0x1a7
> [<c0168877>] link_path_walk+0x94/0xbe
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c02d8b53>] syscall_call+0x7/0xb
>migration/0   S 00000000  3732     2      1             3       (L-TLB)
>f7f1cfb4 00000046 00000001 00000000 f6b8d970 f69f76b0 f6aa3d00 00000000 
>       00000000 00000000 c363c7c0 c363bde0 00000000 00000000 42f88640 000f7402 
>       f69f76b0 c3850030 c385019c 00000000 00000000 c363c724 c363bde0 f7f1c000 
>Call Trace:
> [<c011f72e>] migration_thread+0x8f/0x133
> [<c011f69f>] migration_thread+0x0/0x133
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>ksoftirqd/0   S C02D69C9  3748     3      1             4     2 (L-TLB)
>f7f1efc4 00000046 f7f1efcc c02d69c9 e01800b0 f6b76df0 c3851630 00000046 
>       c03f6ffc 00000000 c363c7c0 c363bde0 00000000 00000000 5fcfc840 000f73fe 
>       f6b76df0 c3853670 c38537dc 00000000 f7f1e000 f7f1e000 f7f14f80 00000000 
>Call Trace:
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c0126ecd>] ksoftirqd+0x0/0xab
> [<c0126f0e>] ksoftirqd+0x41/0xab
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>migration/1   S FFFFFFFF  3732     4      1             5     3 (L-TLB)
>f7f1ffb4 00000046 00000000 ffffffff f6b8d970 f69f76b0 f69f8080 00000000 
>       00000000 00000000 c36447c0 c3643de0 00000001 00000000 426f3200 000f7402 
>       f69f76b0 c38530f0 c385325c 00000000 00000000 c3644724 c3643de0 f7f1f000 
>Call Trace:
> [<c011f72e>] migration_thread+0x8f/0x133
> [<c011f69f>] migration_thread+0x0/0x133
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>ksoftirqd/1   S C02D69C9  3748     5      1             6     4 (L-TLB)
>c3869fc4 00000046 c3869fcc c02d69c9 e01800b0 f5bcf670 00000046 00000046 
>       c03f7ffc 00000000 c36447c0 c3643de0 00000001 00000000 51dd39c0 000f73fe 
>       f5bcf670 c3852b70 c3852cdc 00000000 c3869000 c3869000 f7f14f5c 00000001 
>Call Trace:
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c0126ecd>] ksoftirqd+0x0/0xab
> [<c0126f0e>] ksoftirqd+0x41/0xab
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>migration/2   S 00000000  3732     6      1             7     5 (L-TLB)
>c386bfb4 00000046 00000003 00000000 f68c2e30 f69f76b0 f6aa3200 00000000 
>       00000000 00000000 c364c7c0 c364bde0 00000002 00000000 32b2e000 000f7402 
>       f69f76b0 c38525f0 c385275c 00000000 00000000 c364c724 c364bde0 c386b000 
>Call Trace:
> [<c011f72e>] migration_thread+0x8f/0x133
> [<c011f69f>] migration_thread+0x0/0x133
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>ksoftirqd/2   S C02D69C9  3748     7      1             8     6 (L-TLB)
>c38a1fc4 00000046 c38a1fcc c02d69c9 f6b76df0 f6b778f0 00000246 00000046 
>       c03f8ffc 00000000 c364c7c0 c364bde0 00000002 00000000 3631a780 000f73f7 
>       f6b778f0 c3852070 c38521dc 00000000 c38a1000 c38a1000 f7f14f5c 00000002 
>Call Trace:
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c0126ecd>] ksoftirqd+0x0/0xab
> [<c0126f0e>] ksoftirqd+0x41/0xab
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>migration/3   S C3654644  3732     8      1             9     7 (L-TLB)
>c38a2fb4 00000046 00000073 c3654644 f6b8d970 f69f76b0 c3654294 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 3fa20840 000f7402 
>       f69f76b0 c38c56b0 c38c581c 00000000 00000000 c3654724 c3653de0 c38a2000 
>Call Trace:
> [<c011f72e>] migration_thread+0x8f/0x133
> [<c011f69f>] migration_thread+0x0/0x133
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>ksoftirqd/3   S 00000001  3748     9      1            10     8 (L-TLB)
>c38dbfc4 00000046 00000046 00000001 f6bb0970 f5c59270 c3b23a80 000000e1 
>       fffff000 00000000 c36547c0 c3653de0 00000003 00000000 ff731980 000f73e8 
>       f5c59270 c38c5130 c38c529c 00000000 c38db000 c38db000 f7f14f5c 00000003 
>Call Trace:
> [<c0126ecd>] ksoftirqd+0x0/0xab
> [<c0126f0e>] ksoftirqd+0x41/0xab
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>events/0      S 00000256  2996    10      1    14      11     9 (L-TLB)
>f7feff68 00000046 f7feff10 00000256 00000246 f69a05b0 c363da38 c0129ec9 
>       00000000 00000000 c363c7c0 c363bde0 00000000 00000000 6b06ee00 000f7403 
>       f69a05b0 c38c4bb0 c38c4d1c f7feffa0 f7e06018 c363da20 f7e06010 00000246 
>Call Trace:
> [<c0129ec9>] __mod_timer+0x101/0x10b
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c0148b2c>] cache_reap+0x0/0x1a1
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>events/1      S F4D9A200  3100    11      1            12    10 (L-TLB)
>f7feef68 00000046 00000086 f4d9a200 00000246 00000246 c3645a38 c0129ec9 
>       00000000 f7e060b0 00000003 c3643de0 00000001 00000000 a9d9b180 000f7403 
>       c38510b0 c38c4630 c38c479c f7feefa0 f7e06098 c3645a20 f7e06090 00000246 
>Call Trace:
> [<c0129ec9>] __mod_timer+0x101/0x10b
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c0148b2c>] cache_reap+0x0/0x1a1
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>events/2      S F4D9A580  3100    12      1            13    11 (L-TLB)
>f7fecf68 00000046 00000086 f4d9a580 00000246 e2c3cdf0 c364da38 c0129ec9 
>       00000000 f7e06130 00000003 c364bde0 00000002 00000000 a86b7b80 000f7403 
>       e2c3cdf0 c38c40b0 c38c421c f7fecfa0 f7e06118 c364da20 f7e06110 00000246 
>Call Trace:
> [<c0129ec9>] __mod_timer+0x101/0x10b
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c0148b2c>] cache_reap+0x0/0x1a1
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>events/3      S F7D1B010  3100    13      1  1120      72    12 (L-TLB)
>f7febf68 00000046 f7d1b010 f7d1b010 00000246 f6b8c370 c3655a38 c0129ec9 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 8719d1c0 000f7403 
>       f6b8c370 f7f4b6f0 f7f4b85c f7febfa0 f7e06198 c3655a20 f7e06190 00000246 
>Call Trace:
> [<c0129ec9>] __mod_timer+0x101/0x10b
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c0148b2c>] cache_reap+0x0/0x1a1
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>khelper       S C0130972  3388    14     10            15       (L-TLB)
>f7feaf68 00000046 00000000 c0130972 00000000 f5ae4f30 00000000 00000000 
>       00000000 00000000 c363c7c0 c363bde0 00000000 00000000 84c63a40 000f7402 
>       f5ae4f30 f7f4b170 f7f4b2dc f7feafa0 f7e0e018 dfd00e40 f7e0e010 00000202 
>Call Trace:
> [<c0130972>] wait_for_helper+0x0/0x78
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c01309ea>] __call_usermodehelper+0x0/0x41
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kacpid        S 00000000  3760    15     10            68    14 (L-TLB)
>f7f55f68 00000046 00000000 00000000 00000001 c3851630 418c4100 f7f55f40 
>       c011cddd 00000000 c041e7a0 c363bde0 00000000 00000000 418c4100 000f41fa 
>       c3851630 f7f4abf0 f7f4ad5c f7f55fa0 c3972018 f7f55000 f7f55f80 f7f55f94 
>Call Trace:
> [<c011cddd>] activate_task+0x88/0x95
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kblockd/0     S C014386C  3096    68     10            69    15 (L-TLB)
>c38f0f68 00000046 f7c90c80 c014386c c39bcce8 f6ad6c30 00000000 c022f31c 
>       00000001 00000000 c363c7c0 c363bde0 00000000 00000000 d9904980 000f73d5 
>       f6ad6c30 f7f4a670 f7f4a7dc c38f0fa0 c39b6018 f7d84e8c c39b6010 00000246 
>Call Trace:
> [<c014386c>] mempool_free+0x60/0x64
> [<c022f31c>] cfq_dispatch_requests+0x53/0x7e
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c0227cac>] blk_unplug_work+0x0/0x9
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kblockd/1     S C014386C  3096    69     10            70    68 (L-TLB)
>c3994f68 00000046 f7c90c80 c014386c c39bc368 f7c90c80 00000000 c022f31c 
>       00000002 c39b60b0 00000003 c3643de0 00000001 00000000 9a1cdfc0 000f7402 
>       c38510b0 f7f4a0f0 f7f4a25c c3994fa0 c39b6098 f7d84e8c c39b6090 00000246 
>Call Trace:
> [<c014386c>] mempool_free+0x60/0x64
> [<c022f31c>] cfq_dispatch_requests+0x53/0x7e
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c0227cac>] blk_unplug_work+0x0/0x9
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kblockd/2     S C014386C  3096    70     10            71    69 (L-TLB)
>c3996f68 00000046 f7c90c80 c014386c c39bcf68 f7c90c80 00000000 c022f31c 
>       00000002 c39b6130 00000003 c364bde0 00000002 00000000 77c05380 000f73f3 
>       c3850b30 c39b9730 c39b989c c3996fa0 c39b6118 f7d84e8c c39b6110 00000246 
>Call Trace:
> [<c014386c>] mempool_free+0x60/0x64
> [<c022f31c>] cfq_dispatch_requests+0x53/0x7e
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c0227cac>] blk_unplug_work+0x0/0x9
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kblockd/3     S C014386C  2988    71     10            89    70 (L-TLB)
>c3998f68 00000046 f7c90c80 c014386c c39bc368 f6b8eeb0 00000000 c022f31c 
>       00000003 00000000 c36547c0 c3653de0 00000003 00000000 550839c0 000f73e4 
>       f6b8eeb0 c39b91b0 c39b931c c3998fa0 c39b6198 f7d84e8c c39b6190 00000246 
>Call Trace:
> [<c014386c>] mempool_free+0x60/0x64
> [<c022f31c>] cfq_dispatch_requests+0x53/0x7e
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c0227cac>] blk_unplug_work+0x0/0x9
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>khubd         S C011E83F  2936    72      1            91    13 (L-TLB)
>c39bdfa4 00000046 c39bdf70 c011e83f 00000000 f695f4b0 00000282 00000003 
>       f6947400 00000000 c36547c0 c3653de0 00000003 00000000 7e127dc0 000f58f6 
>       f695f4b0 c39b8c30 c39b8d9c c034f178 c0120448 c025c604 00000000 c39bdfc0 
>Call Trace:
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c025c604>] hub_thread+0x0/0xe4
> [<c025c6a3>] hub_thread+0x9f/0xe4
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c025c604>] hub_thread+0x0/0xe4
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>pdflush       S C011D2FC  3764    89     10            90    71 (L-TLB)
>c39c5f98 00000046 c03c7e80 c011d2fc 00000000 c39b86b0 c38c4e00 c38c4bb0 
>       c363bde0 00000000 c041e7a0 c363bde0 00000000 00000000 4d874540 000f41fa 
>       c39b86b0 c39b8130 c39b829c 00000297 c363c294 c39c5000 c39c5fb0 c39c5fbc 
>Call Trace:
> [<c011d2fc>] try_to_wake_up+0x28e/0x299
> [<c0146324>] pdflush+0x0/0x1e
> [<c014622a>] __pdflush+0x86/0x180
> [<c014633e>] pdflush+0x1a/0x1e
> [<c0146324>] pdflush+0x0/0x1e
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>pdflush       S 00000000  2416    90     10            92    89 (L-TLB)
>c39c0f98 00000046 c0390900 00000000 00000000 c39c0f3c 000003f5 00000000 
>       00000000 00000000 00000000 c3643de0 00000001 00000000 99ef1900 000f7402 
>       c38510b0 c39b86b0 c39b881c 00000000 0000007b c39c0000 c39c0fb0 c39c0fbc 
>Call Trace:
> [<c0146324>] pdflush+0x0/0x1e
> [<c014622a>] __pdflush+0x86/0x180
> [<c014633e>] pdflush+0x1a/0x1e
> [<c0146324>] pdflush+0x0/0x1e
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>aio/0         S 00000000  3760    92     10            93    90 (L-TLB)
>f7c34f68 00000046 00000000 00000000 00000001 c39fac70 4d874540 f7c34f40 
>       c011cddd 00000000 c041e7a0 c363bde0 00000000 00000000 4d874540 000f41fa 
>       c39fac70 c39fb1f0 c39fb35c f7c34fa0 f7c5c018 f7c34000 f7c34f80 f7c34f94 
>Call Trace:
> [<c011cddd>] activate_task+0x88/0x95
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>aio/1         S 00000000  3760    93     10            94    92 (L-TLB)
>f7c35f68 00000046 00000000 00000000 00000001 00000001 4d874540 f7c35f40 
>       c011cddd c363bde0 c38c4bb0 c3643de0 00000001 00000000 4d874540 000f41fa 
>       c38510b0 c39fac70 c39faddc f7c35fa0 f7c5c098 f7c35000 f7c35f80 f7c35f94 
>Call Trace:
> [<c011cddd>] activate_task+0x88/0x95
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>aio/2         S 00000000  3760    94     10            95    93 (L-TLB)
>f7c37f68 00000046 00000000 00000000 00000001 00000001 4d874540 f7c37f40 
>       c011cddd c363bde0 c38c4bb0 c364bde0 00000002 00000000 4d874540 000f41fa 
>       c3850b30 c39fa6f0 c39fa85c f7c37fa0 f7c5c118 f7c37000 f7c37f80 f7c37f94 
>Call Trace:
> [<c011cddd>] activate_task+0x88/0x95
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>aio/3         S 00000000  3760    95     10                  94 (L-TLB)
>f7c38f68 00000046 00000000 00000000 00000001 00000001 4d874540 f7c38f40 
>       c011cddd c363bde0 c38c4bb0 c3653de0 00000003 00000000 4d874540 000f41fa 
>       c38505b0 c39fa170 c39fa2dc f7c38fa0 f7c5c198 f7c38000 f7c38f80 f7c38f94 
>Call Trace:
> [<c011cddd>] activate_task+0x88/0x95
> [<c0130dd8>] worker_thread+0xc9/0x1d5
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0130d0f>] worker_thread+0x0/0x1d5
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kswapd0       S C39D9F50  3692    91      1           239    72 (L-TLB)
>c39d9f94 00000046 00000286 c39d9f50 c011f5ec c3853670 c39fb770 0000000f 
>       00000286 00000000 c041e7a0 c363bde0 00000000 00000000 4da5c9c0 000f41fa 
>       c3853670 c39fb770 c39fb8dc c0331d50 c0120448 c39d9fc0 c0331d50 c39d9fb4 
>Call Trace:
> [<c011f5ec>] set_cpus_allowed+0x11a/0x125
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c014b96f>] kswapd+0xb8/0xcc
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d8a6e>] ret_from_fork+0x6/0x14
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c014b8b7>] kswapd+0x0/0xcc
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kseriod       S 00000000  3792   239      1           492    91 (L-TLB)
>f7c6bfa0 00000046 00000000 00000000 00000000 c3853670 c013177f c032cfc0 
>       00000086 00000000 c041e7a0 c363bde0 00000000 00000000 591779c0 000f41fa 
>       c3853670 f7c8f7b0 f7c8f91c c034671c c0120448 00000000 00000000 f7c6bfbc 
>Call Trace:
> [<c013177f>] attach_pid+0x1f/0xa1
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c021b28d>] serio_thread+0xbe/0x131
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d8a6e>] ret_from_fork+0x6/0x14
> [<c021b1cf>] serio_thread+0x0/0x131
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c021b1cf>] serio_thread+0x0/0x131
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kjournald     S E176CE18  2132   492      1          1673   239 (L-TLB)
>f7d7ff64 00000046 e176ce4c e176ce18 f626eb0c e2c3c2f0 f626e800 f626ebdc 
>       f626e55c 00000000 c36547c0 c3653de0 00000003 00000000 5310e580 000f7403 
>       e2c3c2f0 c3b37270 c3b373dc c382d684 c0120448 c382d614 c382d600 00000001 
>Call Trace:
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<f887905b>] kjournald+0x1a5/0x219 [jbd]
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<f8878eb0>] commit_timeout+0x0/0x5 [jbd]
> [<f8878eb6>] kjournald+0x0/0x219 [jbd]
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kauditd       S C3653DE0  3764  1120     13          1771       (L-TLB)
>f6a63f80 00000046 c011cddd c3653de0 f7f4b6f0 f68e4370 c03c7e80 00000096 
>       c03c7e80 00000000 c36547c0 c3653de0 00000003 00000000 c7c78bc0 000f41fb 
>       f68e4370 f692b9f0 f692bb5c f6a63fa8 c032ded0 f6a63000 f698ac9c f6a63fa8 
>Call Trace:
> [<c011cddd>] activate_task+0x88/0x95
> [<c013b8f4>] kauditd_thread+0x0/0x16a
> [<c013ba45>] kauditd_thread+0x151/0x16a
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>udevd         S 00000000  2980  1673      1          2416   492 (NOTLB)
>f7d72ebc 00000086 0000007b 00000000 00000000 0804ae24 bfe6d41c 00000006 
>       00000000 c032f580 c032f500 c3643de0 00000001 00000000 bd41ce40 000f58f8 
>       c38510b0 f69f6630 f69f679c c0331d00 c01447cc f7d72000 7fffffff 00000000 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0281849>] datagram_poll+0x25/0xcc
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c02d8b53>] syscall_call+0x7/0xb
>kedac         S 00000004  3684  1771     13                1120 (L-TLB)
>f69d2f84 00000046 0000004c 00000004 00000246 00000000 c01c88f1 00000004 
>       f69d2f4c 000000cb 00000000 c3643de0 00000001 00000000 ad6d3880 000f7403 
>       c38510b0 f6adccf0 f6adce5c 00000000 00000246 0342ec3a f69d2f94 00000000 
>Call Trace:
> [<c01c88f1>] pci_bus_read_config_dword+0x57/0x62
> [<f8836838>] edac_kernel_thread+0x0/0x2c [edac_mc]
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<f883665e>] check_mc_devices+0x4b/0x61 [edac_mc]
> [<f8836858>] edac_kernel_thread+0x20/0x2c [edac_mc]
> [<c0134495>] kthread+0x73/0x9b
> [<c0134422>] kthread+0x0/0x9b
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kjournald     S C041F09F  2604  2416      1          2417  1673 (L-TLB)
>f6902f64 00000046 00000002 c041f09f c3850b30 f70b58b0 c01227eb 00004be7 
>       00000246 f7f38a6c 00000003 c364bde0 00000002 00000000 f8976240 000f4c5d 
>       c3850b30 f6ad8c70 f6ad8ddc f7f38a84 c0120448 f7f38a14 f7f38a00 00000001 
>Call Trace:
> [<c01227eb>] call_console_drivers+0xb6/0xd8
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<f887905b>] kjournald+0x1a5/0x219 [jbd]
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<f8878eb0>] commit_timeout+0x0/0x5 [jbd]
> [<f8878eb6>] kjournald+0x0/0x219 [jbd]
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>kjournald     S F7D9C000  2240  2417      1          3127  2416 (L-TLB)
>f7d9cf64 00000046 c038f000 f7d9c000 c38510b0 e15a1970 c032ba40 00000000 
>       f7f3a214 f7f3a26c 00000003 c3653de0 00000003 00000000 74238740 000f73ff 
>       c38505b0 f70b5330 f70b549c f7f3a284 c0120448 f7f3a214 f7f3a200 00000001 
>Call Trace:
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<f887905b>] kjournald+0x1a5/0x219 [jbd]
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<f8878eb0>] commit_timeout+0x0/0x5 [jbd]
> [<f8878eb6>] kjournald+0x0/0x219 [jbd]
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>syslogd       S 00000000  2008  3127      1          3131  2417 (NOTLB)
>f6995ebc 00000082 00000040 00000000 f6995ef8 f5be2630 c032f600 c032f500 
>       00000246 00000000 c364c7c0 c364bde0 00000002 00000000 d0d2f200 000f73ff 
>       f5be2630 f6ad6c30 f6ad6d9c 00000000 f6ad6c30 f6995000 7fffffff 00000000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0281849>] datagram_poll+0x25/0xcc
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c015d37f>] sys_fsync+0xc0/0xc8
> [<c02d8b53>] syscall_call+0x7/0xb
>klogd         S 00000000  2720  3131      1          3149  3127 (NOTLB)
>f70a5f20 00000082 bfef334b 00000000 f70a5ef8 f6ad6c30 f69e3e8c c03518c0 
>       00000000 f70a5ef8 f70a5fac c364bde0 00000002 00000000 06fc5a80 000f7061 
>       c3850b30 f6a5f170 f6a5f2dc c032bb94 c0120448 f70a5000 00000000 f70a5f4c 
>Call Trace:
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c01223aa>] do_syslog+0x10e/0x3bf
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>portmap       S 000000D0  2876  3149      1          3285  3131 (NOTLB)
>f6b15f20 00000082 c16c5460 000000d0 00000000 f5af6030 00000000 000000d0 
>       c0331d00 00000000 c36547c0 c3653de0 00000003 00000000 eda55e40 000f4204 
>       f5af6030 f6b77370 f6b774dc f6321b40 00000246 f6b15000 7fffffff f6b15fa0 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027c12d>] sock_poll+0x12/0x14
> [<c016d2bb>] do_pollfd+0x59/0x81
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c015b732>] sys_close+0x5b/0x92
> [<c02d8b53>] syscall_call+0x7/0xb
>sshd          S C032F500  2720  3285      1  6168    3318  3149 (NOTLB)
>f6911ebc 00000082 c032f580 c032f500 00000246 c01446f0 c13f97e0 000000d0 
>       00000000 c032f500 00000000 c3643de0 00000001 00000000 e3d30180 000f73f8 
>       c38510b0 f69099b0 f6909b1c ffffffff 00000000 f6911000 7fffffff 00000000 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c02a18bd>] tcp_poll+0x31/0x146
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c02d8b53>] syscall_call+0x7/0xb
>ntpd          S 00000000  2548  3318      1          3329  3285 (NOTLB)
>f7df4ebc 00000082 0000007b 00000000 00000000 bff00788 c032f680 c032f500 
>       00000246 c01446f0 c140c4a0 c3653de0 00000003 00000000 af64c2c0 000f7403 
>       c38505b0 f70e8df0 f70e8f5c 00000000 f70e8df0 f7df4000 7fffffff 00000000 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0281849>] datagram_poll+0x25/0xcc
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c02d8b53>] syscall_call+0x7/0xb
>memcached     S C3654860  3360  3329      1          3330  3318 (NOTLB)
>f6a24f20 00000086 00000000 c3654860 f6ad6130 f70212f0 f6a24f30 f6a24f3c 
>       00000200 00000000 c364c7c0 c363bde0 00000000 00000000 9b6d1100 000f7403 
>       c0327a80 c3bd8d30 c3bd8e9c 00000000 00000246 0342eb0c f6a24f30 00000246 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c017ec13>] ep_poll+0xd3/0x147
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c017e00f>] sys_epoll_wait+0x73/0x86
> [<c02d8b53>] syscall_call+0x7/0xb
>memcached     S C02D954E  3568  3330      1          3331  3329 (NOTLB)
>f6a33f20 00000086 00000246 c02d954e f6adacb0 f6ada730 00000200 00000000 
>       c3644860 00000000 c36447c0 c363bde0 00000000 00000000 9585f280 000f7402 
>       c0327a80 f6adb230 f6adb39c 00000000 00000246 0342e982 f6a33f30 00000246 
>Call Trace:
> [<c02d954e>] reschedule_interrupt+0x1a/0x20
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c017ec13>] ep_poll+0xd3/0x147
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c017e00f>] sys_epoll_wait+0x73/0x86
> [<c02d8b53>] syscall_call+0x7/0xb
>memcached     S C02D952C  3584  3331      1          3332  3330 (NOTLB)
>f6b21f20 00000086 0290c2e6 c02d952c c0327a80 f6adb230 00000200 00000000 
>       c3654860 00000000 c363c7c0 c363bde0 00000000 00000000 9585f280 000f7402 
>       f6adb230 f6adacb0 f6adae1c 00000000 00000246 0342e982 f6b21f30 00000246 
>Call Trace:
> [<c02d952c>] common_interrupt+0x18/0x20
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c017ec13>] ep_poll+0xd3/0x147
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c017e00f>] sys_epoll_wait+0x73/0x86
> [<c02d8b53>] syscall_call+0x7/0xb
>memcached     S 00000000  3584  3332      1          3396  3331 (NOTLB)
>f70b8f20 00000086 00000000 00000000 c0327a80 f6b8c370 00000000 00000000 
>       00000000 00000000 c36547c0 c363bde0 00000000 00000000 b6f620c0 000f7402 
>       c0327a80 f68c3930 f68c3a9c 00000000 00000246 0342ebb3 f70b8f30 00000246 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c017ec13>] ep_poll+0xd3/0x147
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c017e00f>] sys_epoll_wait+0x73/0x86
> [<c02d8b53>] syscall_call+0x7/0xb
>master        S C0359AE0  2436  3396      1  3405    3584  3332 (NOTLB)
>f68c6ebc 00000086 00000002 c0359ae0 00000000 e0180630 f68c6eac c027baeb 
>       0000000c 00000000 c364c7c0 c364bde0 00000002 00000000 92888340 000f73fd 
>       e0180630 f6a5e0f0 f6a5e25c 00000000 00000246 03436c45 f68c6ecc 00000000 
>Call Trace:
> [<c027baeb>] sock_aio_read+0x10d/0x11b
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>qmgr          S F6D29AA4  1876  3405   3396         19044       (NOTLB)
>f70efebc 00000086 f8875f01 f6d29aa4 e0180630 e0180630 f68ba44c c032f580 
>       c032f500 00000000 c36447c0 c3643de0 00000001 00000000 9a22a6c0 000f73ef 
>       c38510b0 f68e4e70 f68e4fdc 00000000 00000246 03431e22 f70efecc 00000000 
>Call Trace:
> [<f8875f01>] __journal_file_buffer+0x147/0x221 [jbd]
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c0166d45>] pipe_ioctl+0x2d/0x5d
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S C0107A87  2516  3584      1  3585    3626  3396 (NOTLB)
>c3b11ebc 00000086 00000000 c0107a87 f5cad2f0 f5cad2f0 031f4219 c3b11ecc 
>       c3b24480 00000000 c363c7c0 c363bde0 00000000 00000000 8498f340 000f7403 
>       f5cad2f0 f69083b0 f690851c 00000000 00000246 0342e98d c3b11ecc c3b24480 
>Call Trace:
> [<c0107a87>] do_IRQ+0x175/0x1ae
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c0125c92>] sys_waitpid+0x13/0x17
> [<c02d8b53>] syscall_call+0x7/0xb
>rotatelogs    S C3BC2EBC  2976  3585   3584          3587       (NOTLB)
>c3bc2ee8 00000082 00000001 c3bc2ebc 00007700 00000000 f59c25f8 c3bc2ef8 
>       f59c2588 f6a838c0 c014315f c3643de0 00000001 00000000 4da9c7c0 000f4202 
>       c38510b0 f6adc770 f6adc8dc f7cafb80 c0120448 f7000568 c3bc2f10 c3bc2f04 
>Call Trace:
> [<c014315f>] generic_file_aio_write+0x72/0xc6
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c01666db>] pipe_wait+0x6b/0xa2
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c0166937>] pipe_readv+0x225/0x29e
> [<c01669cc>] pipe_read+0x1c/0x20
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>rotatelogs    S 00000000  2976  3587   3584          3596  3585 (NOTLB)
>f7106ee8 00000086 80000000 00000000 00000000 00000000 f61bc638 0804a000 
>       f68cabcc f69fb400 00000001 c3653de0 00000003 00000000 487a4400 000f4202 
>       c38505b0 f6bb0ef0 f6bb105c f7cb3f80 c0120448 f64692b8 f7106f10 f7106f04 
>Call Trace:
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c01666db>] pipe_wait+0x6b/0xa2
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c0166937>] pipe_readv+0x225/0x29e
> [<c015b2d1>] filp_open+0x51/0x65
> [<c01669cc>] pipe_read+0x1c/0x20
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  2980  3596   3584          3598  3587 (NOTLB)
>f7d9eee8 00000082 80000000 00000000 00000000 f69083b0 f6187e98 b7eae774 
>       c3b49cd4 00000000 c36547c0 c3653de0 00000003 000f4240 4da9c7c0 000f4202 
>       f69083b0 f6b7a8b0 f6b7aa1c f7cb4e00 c0120448 f6119930 f7d9ef10 f7d9ef04 
>Call Trace:
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c01666db>] pipe_wait+0x6b/0xa2
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c0166937>] pipe_readv+0x225/0x29e
> [<c01669cc>] pipe_read+0x1c/0x20
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000001  3568  3598   3584          3599  3596 (NOTLB)
>f68feec8 00000082 2c42c025 00000001 fff696e8 f6a5ebf0 ffffffff ffffffff 
>       2c42c025 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6a5ebf0 f6b8e930 f6b8ea9c 00000000 fff696e8 f68fe000 7fffffff f68fe000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3599   3584          3600  3598 (NOTLB)
>f68ccec8 00000082 00000000 00000000 00000000 f692b470 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f692b470 f6a5ebf0 f6a5ed5c 00000000 00000000 f68cc000 7fffffff f68cc000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3600   3584          3601  3599 (NOTLB)
>f6b1dec8 00000082 00000000 00000000 00000000 f69e4b70 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f69e4b70 f692b470 f692b5dc 00000000 00000000 f6b1d000 7fffffff f6b1d000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3576  3601   3584          3602  3600 (NOTLB)
>c3b9dec8 00000082 00000000 00000000 00000000 c38c5130 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       c38c5130 f69e4b70 f69e4cdc 00000000 00000000 c3b9d000 7fffffff c3b9d000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3602   3584          3603  3601 (NOTLB)
>f7d70ec8 00000082 00000000 00000000 00000000 f68e4370 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f68e4370 f692a970 f692aadc 00000000 00000000 f7d70000 7fffffff f7d70000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3603   3584          3604  3602 (NOTLB)
>f6a13ec8 00000082 00000000 00000000 00000000 f70207f0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f70207f0 f68e4370 f68e44dc 00000000 00000000 f6a13000 7fffffff f6a13000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3604   3584          3605  3603 (NOTLB)
>f6ab7ec8 00000082 00000000 00000000 00000000 f7020270 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f7020270 f70207f0 f702095c 00000000 00000000 f6ab7000 7fffffff f6ab7000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3605   3584          3606  3604 (NOTLB)
>f69bdec8 00000082 00000000 00000000 00000000 f6ad86f0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6ad86f0 f7020270 f70203dc 00000000 00000000 f69bd000 7fffffff f69bd000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3606   3584          3607  3605 (NOTLB)
>f696eec8 00000082 00000000 00000000 00000000 c3bd9830 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       c3bd9830 f6ad86f0 f6ad885c 00000000 00000000 f696e000 7fffffff f696e000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3607   3584          3608  3606 (NOTLB)
>f6b4cec8 00000082 00000000 00000000 00000000 f68e48f0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f68e48f0 c3bd9830 c3bd999c 00000000 00000000 f6b4c000 7fffffff f6b4c000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3608   3584          3609  3607 (NOTLB)
>f7de4ec8 00000082 00000000 00000000 00000000 f68e53f0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f68e53f0 f68e48f0 f68e4a5c 00000000 00000000 f7de4000 7fffffff f7de4000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3609   3584          3610  3608 (NOTLB)
>f6b0bec8 00000082 00000000 00000000 00000000 f6ad66b0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6ad66b0 f6aeed30 f6aeee9c 00000000 00000000 f6b0b000 7fffffff f6b0b000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3496  3610   3584          3611  3609 (NOTLB)
>f6a39ec8 00000082 00000000 00000000 00000000 00000000 00000000 00000000 
>       00000000 00000000 00000000 c3643de0 00000001 00000000 4db90a00 000f4202 
>       c38510b0 f6af12f0 f6af145c 00000000 00000000 f6a39000 7fffffff f6a39000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c02d956e>] invalidate_interrupt+0x1a/0x20
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3611   3584          3612  3610 (NOTLB)
>f6966ec8 00000082 00000000 00000000 00000000 f70b4db0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f70b4db0 f6ad66b0 f6ad681c 00000000 00000000 f6966000 7fffffff f6966000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3612   3584          3613  3611 (NOTLB)
>f6a81ec8 00000082 00000000 00000000 00000000 f6af1870 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6af1870 f70b4db0 f70b4f1c 00000000 00000000 f6a81000 7fffffff f6a81000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3613   3584          3614  3612 (NOTLB)
>f7100ec8 00000082 00000000 00000000 00000000 f68c2330 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f68c2330 f6af1870 f6af19dc 00000000 00000000 f7100000 7fffffff f7100000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3614   3584          3615  3613 (NOTLB)
>f69c1ec8 00000082 00000000 00000000 00000000 f6bb1470 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6bb1470 f68c2330 f68c249c 00000000 00000000 f69c1000 7fffffff f69c1000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3615   3584          3616  3614 (NOTLB)
>f6a1eec8 00000082 00000000 00000000 00000000 f68e53f0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f68e53f0 f6bb1470 f6bb15dc 00000000 00000000 f6a1e000 7fffffff f6a1e000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3616   3584          3617  3615 (NOTLB)
>f7d8dec8 00000082 00000000 00000000 00000000 f6add270 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6add270 f68e5970 f68e5adc 00000000 00000000 f7d8d000 7fffffff f7d8d000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3617   3584          3618  3616 (NOTLB)
>f6b4eec8 00000082 00000000 00000000 00000000 f6b762f0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6b762f0 f6add270 f6add3dc 00000000 00000000 f6b4e000 7fffffff f6b4e000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3618   3584          3619  3617 (NOTLB)
>f6a86ec8 00000082 00000000 00000000 00000000 f6aee7b0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6aee7b0 f6b762f0 f6b7645c 00000000 00000000 f6a86000 7fffffff f6a86000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3619   3584          3620  3618 (NOTLB)
>f6a35ec8 00000082 00000000 00000000 00000000 f6adb7b0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6adb7b0 f6aee7b0 f6aee91c 00000000 00000000 f6a35000 7fffffff f6a35000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3620   3584          3621  3619 (NOTLB)
>f61cbec8 00000082 00000000 00000000 00000000 f6b44db0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6b44db0 f6adb7b0 f6adb91c 00000000 00000000 f61cb000 7fffffff f61cb000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3621   3584          3622  3620 (NOTLB)
>f61ccec8 00000082 00000000 00000000 00000000 f6909430 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f6909430 f6b44db0 f6b44f1c 00000000 00000000 f61cc000 7fffffff f61cc000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 00000000  3600  3622   3584          3623  3621 (NOTLB)
>f61cdec8 00000082 00000000 00000000 00000000 f68e53f0 00000000 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 4db90a00 000f4202 
>       f68e53f0 f6909430 f690959c 00000000 00000000 f61cd000 7fffffff f61cd000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c011d6a2>] schedule_tail+0x31/0xae
> [<c02d8b53>] syscall_call+0x7/0xb
>hpsmhd        S 000000D0  3360  3623   3584                3622 (NOTLB)
>f61cef20 00000082 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       f70e8870 00000010 00000000 c3653de0 00000003 000f4240 4dc84c40 000f4202 
>       c38505b0 f70e8870 f70e89dc f6b99240 00000246 f61ce000 7fffffff f61cefa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027c12d>] sock_poll+0x12/0x14
> [<c016d2bb>] do_pollfd+0x59/0x81
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S E364AFD8  1952  3626      1 23018    3635  3584 (NOTLB)
>f520febc 00000086 e364adc0 e364afd8 c38510b0 f7020d70 00000028 c02ab9a5 
>       00000000 00000000 c36447c0 c3643de0 00000001 00000000 aca6db40 000f7403 
>       c38510b0 f68e53f0 f68e555c 00000000 00000246 0342ec2d f520fecc f4d8cf20 
>Call Trace:
> [<c02ab9a5>] tcp_rcv_state_process+0xe2/0x8d1
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c0125c92>] sys_waitpid+0x13/0x17
> [<c02d8b53>] syscall_call+0x7/0xb
>crond         S C0125285  2532  3635      1          3662  3626 (NOTLB)
>f521cf54 00000086 0000782e c0125285 f521cfc4 009c274f 00000000 00000282 
>       f521cf70 f521cf7c c0120411 c364bde0 00000002 00000000 d32609c0 000f73ff 
>       c3850b30 f6b7a330 f6b7a49c 00000000 00000246 0343921a f521cf64 0000ea6b 
>Call Trace:
> [<c0125285>] wait_task_zombie+0x51d/0x533
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c012a894>] sys_nanosleep+0x103/0x1a1
> [<c02d8b53>] syscall_call+0x7/0xb
>xfs           S C354D360  2372  3662      1          4159  3635 (NOTLB)
>f52d8ebc 00000086 fff69000 c354d360 f6aef830 f6aef830 00000001 c032f600 
>       c032f500 00000000 c364c7c0 c364bde0 00000002 00000000 644c8c80 000f73ab 
>       f6aef830 f7c8ecb0 f7c8ee1c 00000000 00000246 034646e2 f52d8ecc 00000000 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c015191a>] do_munmap+0x108/0x116
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>cmathreshd    S F7DFAEF0  2680  4159      1          4165  3662 (NOTLB)
>f7dfaf28 00000082 00000003 f7dfaef0 c0357ac0 f5cad2f0 00000010 f7dfaef0 
>       c027c722 00000000 c364c7c0 c364bde0 00000002 00000000 ff524c40 000f7402 
>       f5cad2f0 f69a10b0 f69a121c e002350c c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<c027c722>] sys_bind+0x70/0x7e
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmahostd      S C01C5822  2092  4165      1          4172  4159 (NOTLB)
>f6b16f28 00000082 e0202000 c01c5822 00000000 00000004 bffff6f0 00018801 
>       fffffff0 f6b16f58 f6b16000 c363bde0 00000000 00000000 f2906b00 000f7401 
>       c0327a80 f7c8f230 f7c8f39c c01692a7 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<c01c5822>] direct_strncpy_from_user+0x3e/0x5d
> [<c01692a7>] open_namei+0xaa/0x5c1
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmapeerd      S F6B19000  1952  4172      1          4218  4165 (NOTLB)
>f6b19f28 00000086 0000000e f6b19000 f6b19f08 0000000e c012b025 f6b19000 
>       c0105b64 f6b19fc4 f69e4564 c3643de0 00000001 00000000 38a940c0 000f7403 
>       c38510b0 f69e4070 f69e41dc bfffe930 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<c012b025>] recalc_sigpending+0xf/0x1b
> [<c0105b64>] handle_signal+0xb8/0xd3
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmapeerd      S F69B0810  2832  4218      1          4224  4172 (NOTLB)
>f6979cb4 00000086 c38c9480 f69b0810 f4cefa40 f5c2d730 f5320dc0 c029fb52 
>       00004034 00000000 c364c7c0 c364bde0 00000002 00000000 a03e13c0 000f4c74 
>       f5c2d730 f7c8e730 f7c8e89c c02b8642 f5320dc0 f6979000 7fffffff f6979d1c 
>Call Trace:
> [<c029fb52>] ip_push_pending_frames+0x2ec/0x3e2
> [<c02b8642>] udp_push_pending_frames+0x1c8/0x1e4
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c0120494>] prepare_to_wait_exclusive+0x12/0x4b
> [<c02810aa>] wait_for_packet+0xca/0x114
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c0281176>] skb_recv_datagram+0x82/0x9b
> [<c02b8eb3>] udp_recvmsg+0x5f/0x279
> [<c027ecd7>] sock_common_recvmsg+0x30/0x46
> [<c027b988>] sock_recvmsg+0xef/0x10c
> [<c0173836>] update_atime+0x3f/0x93
> [<c01415ee>] do_generic_mapping_read+0x43d/0x445
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c015cb9c>] fget+0x3b/0x42
> [<c027cbf4>] sys_recvfrom+0xa5/0xf5
> [<c0169035>] may_open+0x56/0x21e
> [<c015cc54>] file_move+0x14/0x39
> [<c027d35b>] sys_socketcall+0x197/0x1fb
> [<c015b732>] sys_close+0x5b/0x92
> [<c02d8b53>] syscall_call+0x7/0xb
>cmastdeqd     S F69F60B0  1952  4224      1          4241  4218 (NOTLB)
>f52f3f28 00003086 c364b1c0 f69f60b0 00003286 f6b8c370 b7ff3000 c3bd6e00 
>       c364b1c0 00000000 c364c7c0 c364bde0 00000002 00000000 91689780 000f7401 
>       f6b8c370 f7021870 f70219dc f52f3f74 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmastdeqd     S 00000001  3500  6327      1          6328  6325 (NOTLB)
>f5c3cf28 00000086 80000001 00000001 f5cc1330 e2c3c2f0 f70b6ec0 f70b6ef0 
>       f53f6c24 00000000 c36547c0 c3653de0 00000003 00000000 9083b5c0 000f7401 
>       e2c3c2f0 f5cc0830 f5cc099c 00000246 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmahealthd    S F88A9D9E  2104  4241      1          4256  4224 (NOTLB)
>c3b14f28 00000082 c3b14fac f88a9d9e f5af6b30 f5af6b30 f88c3a40 00000000 
>       c3b14ef8 00000000 c36447c0 c3643de0 00000001 00000000 451dd740 000f7402 
>       f5af6b30 f69f76b0 f69f781c 00000000 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<f88a9d9e>] ext3_file_write+0x19/0x8b [ext3]
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmahealthd    S C3B23A80  3592  6328      1          6346  6327 (NOTLB)
>f5b17f28 00000082 c0107ab4 c3b23a80 f5af6b30 f5af6b30 c02eca1f 08ca5354 
>       f5b17f2c 00000000 c36447c0 c3643de0 00000001 00000000 451dd740 000f7402 
>       f5af6b30 f695fa30 f695fb9c 00000246 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c0107ab4>] do_IRQ+0x1a2/0x1ae
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmahealthd    S 00000000  3588  6346      1          6354  6328 (NOTLB)
>f532cf28 00000082 c01174b6 00000000 f5af6b30 f5af6b30 c03f9000 c0396080 
>       f532c000 00000000 c36447c0 c3643de0 00000001 00000000 451dd740 000f7402 
>       f5af6b30 f5bce5f0 f5bce75c 00000246 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c01174b6>] smp_apic_timer_interrupt+0x9a/0x9c
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c0107ab4>] do_IRQ+0x1a2/0x1ae
> [<c02d8b53>] syscall_call+0x7/0xb
>cmahealthd    S 00000282  3592  6354      1          6366  6346 (NOTLB)
>f4f63f28 00000082 c38d5010 00000282 f5af6b30 f5af6b30 00001030 c01174b6 
>       c38c9808 00000000 c36447c0 c3643de0 00000001 00000000 451dd740 000f7402 
>       f5af6b30 f6ad7730 f6ad789c 00000246 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c01174b6>] smp_apic_timer_interrupt+0x9a/0x9c
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c0107a87>] do_IRQ+0x175/0x1ae
> [<c02d8b53>] syscall_call+0x7/0xb
>cmahealthd    S F7DEFC18  3592  6366      1          6376  6354 (NOTLB)
>f5309f28 00000082 00000022 f7defc18 f5af6b30 f5af6b30 00000234 00000000 
>       0000007b 00000000 c36447c0 c3643de0 00000001 00000000 451dd740 000f7402 
>       f5af6b30 f69a0b30 f69a0c9c 00000246 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c0107a87>] do_IRQ+0x175/0x1ae
> [<c02d8b53>] syscall_call+0x7/0xb
>cmahealthd    S E0889F98  3592  6376      1          6383  6366 (NOTLB)
>c3b13f28 00000082 00000000 e0889f98 f5af6b30 f5af6b30 00000046 c03f8ffc 
>       c02e2a41 00000000 c36447c0 c3643de0 00000001 00000000 451dd740 000f7402 
>       f5af6b30 f70e82f0 f70e845c 00000246 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c0107ab4>] do_IRQ+0x1a2/0x1ae
> [<c02d8b53>] syscall_call+0x7/0xb
>cmahealthd    S 00000286  3592  6383      1         26910  6376 (NOTLB)
>f5c5df28 00000082 c02d6a0b 00000286 f5af6b30 f5af6b30 f69e50f0 c01174b6 
>       f7fff440 00000000 c36447c0 c3643de0 00000001 00000000 451dd740 000f7402 
>       f5af6b30 f69e50f0 f69e525c 00000246 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c02d6a0b>] schedule+0x8c7/0x8f3
> [<c01174b6>] smp_apic_timer_interrupt+0x9a/0x9c
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c0107ab4>] do_IRQ+0x1a2/0x1ae
> [<c02d8b53>] syscall_call+0x7/0xb
>cmaperfd      S F88A9D9E  2436  4256      1          4309  4241 (NOTLB)
>c3b03f28 00000082 c3b03fac f88a9d9e 00000000 00000000 f88c3a40 00000000 
>       c3b03ef8 c015beb8 00000000 c3643de0 00000001 000bde31 92c60c00 000f73fe 
>       c38510b0 f695e9b0 f695eb1c 00000000 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<f88a9d9e>] ext3_file_write+0x19/0x8b [ext3]
> [<c015beb8>] do_sync_write+0x9e/0xcb
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmaeventd     S 0342F866  1952  4309      1          4320  4256 (NOTLB)
>f6a9ffb8 00003086 f6a9f000 0342f866 00000000 00000000 c012607f ffffffff 
>       000001ff 0342f866 f6a9ffa0 c3653de0 00000003 00000000 2482c8c0 000f7401 
>       c38505b0 f6adc1f0 f6adc35c 00000000 00000000 bffff630 bffffd64 00004002 
>Call Trace:
> [<c012607f>] do_setitimer+0x16c/0x1c5
> [<c012de3b>] sys_pause+0x14/0x1d
> [<c02d8b53>] syscall_call+0x7/0xb
>cmaidad       S C022A7FB  1952  4320      1          4337  4309 (NOTLB)
>f5334f28 00003082 c0224b71 c022a7fb 0000000f 00000000 00000000 0000a00a 
>       00000026 02110000 00000000 c3643de0 00000001 00000000 df0408c0 000f7402 
>       c38510b0 f68c28b0 f68c2a1c 00000000 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<c0224b71>] kobj_lookup+0x132/0x192
> [<c022a7fb>] exact_match+0x0/0x7
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmafcad       S C022A7FB  2720  4337      1          4339  4320 (NOTLB)
>f6ac2f28 00003082 c0224b71 c022a7fb 0000000f 00003246 00000000 f6ac2000 
>       f7f00040 f6ac2ef4 f6ac2000 c364bde0 00000002 00000000 233416c0 000f7403 
>       c3850b30 f6b7b3b0 f6b7b51c f7f00040 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<c0224b71>] kobj_lookup+0x132/0x192
> [<c022a7fb>] exact_match+0x0/0x7
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmaided       S F88A9D9E  2720  4339      1          4354  4337 (NOTLB)
>f531ef28 00000086 f531efac f88a9d9e 00000000 00000000 f88c3a40 00000000 
>       f531eef8 c015beb8 00000000 c363bde0 00000000 00000000 9e3a3ac0 000f7403 
>       c0327a80 f69e5670 f69e57dc 00000000 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<f88a9d9e>] ext3_file_write+0x19/0x8b [ext3]
> [<c015beb8>] do_sync_write+0x9e/0xcb
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmascsid      S F52F1000  2720  4354      1          4538  4339 (NOTLB)
>f52f1f28 00000086 0000000e f52f1000 f52f1f08 0000000e c012b025 f52f1000 
>       c0105b64 f52f1fc4 f5ae4ea4 c3653de0 00000003 00000000 9c336e40 000f7403 
>       c38505b0 f5ae49b0 f5ae4b1c bfe4ca40 c01a03f8 00000000 f7f8ced4 f7f8ce88 
>Call Trace:
> [<c012b025>] recalc_sigpending+0xf/0x1b
> [<c0105b64>] handle_signal+0xb8/0xd3
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>cmanicd       S 0000000A  1876  4538      1          5003  4354 (NOTLB)
>f7d6ffb8 00000086 007d0f00 0000000a 00000000 f6ad9770 0000000b c027d32e 
>       00000003 00000000 c36547c0 c3653de0 00000003 00000000 2a9e9c40 000f4204 
>       f6ad9770 f5ae54b0 f5ae561c 00000010 0855cba0 009e7ff4 bffed0f4 bffed080 
>Call Trace:
> [<c027d32e>] sys_socketcall+0x16a/0x1fb
> [<c012de3b>] sys_pause+0x14/0x1d
> [<c02d8b53>] syscall_call+0x7/0xb
>cmanicd       S 00000000  2516  5003      1          5004  4538 (NOTLB)
>f5324f54 00000086 00000000 00000000 001bc101 e2c3c2f0 00000001 00000000 
>       00000000 00000000 c364c7c0 c364bde0 00000002 00000000 5f76b980 000f7403 
>       e2c3c2f0 f70212f0 f702145c 00000000 00000246 03430a49 f5324f64 00002713 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c012a894>] sys_nanosleep+0x103/0x1a1
> [<c02d8b53>] syscall_call+0x7/0xb
>cmanicd       S F6346810  2800  5004      1          5222  5003 (NOTLB)
>f5adccb4 00000086 c38c9480 f6346810 e2f55080 f5c2d730 f5092040 c029fb52 
>       00004034 00000000 c364c7c0 c364bde0 00000002 00000000 f17dc280 000f7401 
>       f5c2d730 c3b377f0 c3b3795c c02b8642 f5092040 f5adc000 7fffffff f5adcd1c 
>Call Trace:
> [<c029fb52>] ip_push_pending_frames+0x2ec/0x3e2
> [<c02b8642>] udp_push_pending_frames+0x1c8/0x1e4
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c0120494>] prepare_to_wait_exclusive+0x12/0x4b
> [<c02810aa>] wait_for_packet+0xca/0x114
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c0281176>] skb_recv_datagram+0x82/0x9b
> [<c02b8eb3>] udp_recvmsg+0x5f/0x279
> [<c027ecd7>] sock_common_recvmsg+0x30/0x46
> [<c027b988>] sock_recvmsg+0xef/0x10c
> [<c01c5620>] atomic_dec_and_lock+0x20/0x40
> [<c0167803>] path_release+0xa/0x2d
> [<c014e972>] do_wp_page+0x358/0x371
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c015cb9c>] fget+0x3b/0x42
> [<c027cbf4>] sys_recvfrom+0xa5/0xf5
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c027d35b>] sys_socketcall+0x197/0x1fb
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>dbus-daemon-1 S C169C940  2980  5222      1          5232  5004 (NOTLB)
>f5a46f20 00000082 c01446f0 c169c940 000000d0 f6af0270 c032f500 00000000 
>       000000d0 00000000 c364c7c0 c364bde0 00000002 00000000 83da9800 000f58f6 
>       f6af0270 f5be3130 f5be329c f5a46fa0 00000246 f5a46000 7fffffff f5a46fa0 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027c12d>] sock_poll+0x12/0x14
> [<c016d2bb>] do_pollfd+0x59/0x81
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>rhnsd         S C0125285  2720  5232      1          5241  5222 (NOTLB)
>f530df54 00000086 00000f80 c0125285 c016ce01 00000000 00000000 00000282 
>       f530df70 f530df7c c0120411 c363bde0 00000000 000f4240 cb32c100 000f6eef 
>       c0327a80 f6b45330 f6b4549c 00000000 00000246 03c9768a f530df64 00dbbea6 
>Call Trace:
> [<c0125285>] wait_task_zombie+0x51d/0x533
> [<c016ce01>] do_select+0x2b2/0x2c6
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c012a894>] sys_nanosleep+0x103/0x1a1
> [<c02d8b53>] syscall_call+0x7/0xb
>hald          S 00000246  2532  5241      1          5304  5232 (NOTLB)
>f5b28f20 00000082 c032f500 00000246 c01446f0 c1406f00 000000d0 00000000 
>       c032f500 00000000 000000d0 c3643de0 00000001 00000000 6459f200 000f7403 
>       c38510b0 f6af0270 f6af03dc 00000000 00000246 0342eb59 f5b28f30 f5b28fa0 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>nrpe          S C032F500  2964  5304      1          5441  5241 (NOTLB)
>f5232ebc 00000086 c032f580 c032f500 00000246 e15a08f0 c1405440 000000d0 
>       00000000 00000000 c36447c0 c3643de0 00000001 00000000 b8094900 000f7403 
>       e15a08f0 f6aef2b0 f6aef41c 00000000 00000246 0342eaf8 f5232ecc 00000000 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c02d8b53>] syscall_call+0x7/0xb
>vcagentd      S 00129000  1960  5441      1          5442  5304 (NOTLB)
>f5bb0cbc 00000086 fff8b948 00129000 c014f179 f70e9370 00000001 00129000 
>       00000246 00000000 c364c7c0 c364bde0 00000002 000f4240 d32e7740 000f4204 
>       f70e9370 f5ae5a30 f5ae5b9c f61c141c f8874cdb f5bb0000 7fffffff f5bb0d24 
>Call Trace:
> [<c014f179>] do_no_page+0x6f/0x2f9
> [<f8874cdb>] do_get_write_access+0x516/0x532 [jbd]
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c015e1b7>] __getblk+0x2b/0x49
> [<c0120494>] prepare_to_wait_exclusive+0x12/0x4b
> [<c02810aa>] wait_for_packet+0xca/0x114
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c0281176>] skb_recv_datagram+0x82/0x9b
> [<c02d2cf5>] unix_dgram_recvmsg+0x7f/0x1da
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c015e1b7>] __getblk+0x2b/0x49
> [<c027b988>] sock_recvmsg+0xef/0x10c
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c015e1b7>] __getblk+0x2b/0x49
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c015cb9c>] fget+0x3b/0x42
> [<c027cbf4>] sys_recvfrom+0xa5/0xf5
> [<c014f5b9>] handle_mm_fault+0xdc/0x193
> [<c011b023>] do_page_fault+0x1ae/0x5c6
> [<c01707a8>] dput+0x34/0x1a7
> [<c015b0f1>] sys_chmod+0xc9/0xd6
> [<c027d35b>] sys_socketcall+0x197/0x1fb
> [<c02d8b53>] syscall_call+0x7/0xb
>vcagentd      S 00000001  3496  5442      1          5485  5441 (NOTLB)
>f5b73ec8 00000086 2ec59025 00000001 fffcf108 c014f3e4 ffffffff ffffffff 
>       2ec59025 00000001 80000000 c363bde0 00000000 00000000 ca4ce800 000f4204 
>       c0327a80 f6bb19f0 f6bb1b5c 00000000 fffcf108 f5b73000 7fffffff f5b73000 
>Call Trace:
> [<c014f3e4>] do_no_page+0x2da/0x2f9
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c02d8b53>] syscall_call+0x7/0xb
>vcagentd      S 00000000  3496  5485      1          5748  5442 (NOTLB)
>f691aec8 00000086 00000000 00000000 00000000 00000000 ffffffff ffffffff 
>       ffffffff 00000163 80000000 c364bde0 00000002 00000000 d32e7740 000f4204 
>       c3850b30 f70e9370 f70e94dc fff8b0f0 f53f3208 f691a000 7fffffff f691a000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c02d8b53>] syscall_call+0x7/0xb
>rpciod        S C3B23A80  2572  5748      1          5749  5485 (L-TLB)
>f5a53f9c 00000046 f6bb0970 c3b23a80 c38510b0 f5cad870 00000000 c36447c0 
>       c3643de0 00000000 c36547c0 c3643de0 00000001 00000000 6a3e25c0 000f73c1 
>       c38510b0 f68c33b0 f68c351c f8b1efec c0120448 f5a53000 00000000 f5a53fb8 
>Call Trace:
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<f8b05a01>] rpciod+0x18e/0x251 [sunrpc]
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d8a6e>] ret_from_fork+0x6/0x14
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<f8b05873>] rpciod+0x0/0x251 [sunrpc]
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>lockd         S 00000000  3396  5749      1          5754  5748 (L-TLB)
>f5336f2c 00000046 00000000 00000000 00000000 00000000 00000000 f5af6030 
>       f5336f14 c011cd4a 00000000 c3653de0 00000003 00000000 edc3e2c0 000f4204 
>       c38505b0 f6b7ae30 f6b7af9c c011cddd 00000246 f5336000 7fffffff c389a560 
>Call Trace:
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c011cddd>] activate_task+0x88/0x95
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<f8b08f32>] svc_recv+0x2b0/0x439 [sunrpc]
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c012af4f>] switch_uid+0x32/0x3f
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c02d7082>] __cond_resched+0x14/0x39
> [<f8a4df68>] lockd+0x123/0x270 [lockd]
> [<f8a4de45>] lockd+0x0/0x270 [lockd]
> [<c01041f5>] kernel_thread_helper+0x5/0xb
>nimbus        S 00000001  2436  5754      1  5756    5765  5749 (NOTLB)
>f6990f54 00000086 00000000 00000001 e15a0e70 e15a0e70 f6990000 00000282 
>       f6990f70 00000000 c36447c0 c3643de0 00000001 00000000 9e58bf40 000f7403 
>       e15a0e70 f6a5f6f0 f6a5f85c 00000000 00000246 0342ef27 f6990f64 000007d2 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c012a894>] sys_nanosleep+0x103/0x1a1
> [<c02d8b53>] syscall_call+0x7/0xb
>controller    S C032F500  1876  5756   5754  6394               (NOTLB)
>f5bbeebc 00000082 c032f580 c032f500 00000246 f4ffa670 c13fbba0 000000d0 
>       00000000 00000000 c36447c0 c3643de0 00000001 00000000 a3b609c0 000f7403 
>       f4ffa670 f5af6030 f5af619c 00000000 00000246 0342eb97 f5bbeecc 00000000 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>miniserv.pl   S C032F500  2092  5765      1          5770  5754 (NOTLB)
>f5bc0ebc 00000082 c032f500 c032f500 00000246 f6b76870 c13fad00 000000d0 
>       00000000 00000000 c363c7c0 c363bde0 00000000 00000000 21c5e0c0 000f7403 
>       f6b76870 c3b361f0 c3b3635c 00000000 00000246 0343063b f5bc0ecc 00000000 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c0125c92>] sys_waitpid+0x13/0x17
> [<c02d8b53>] syscall_call+0x7/0xb
>mingetty      S C020EAA0  2980  5770      1          5771  5765 (NOTLB)
>f5a7fe88 00000086 00000020 c020eaa0 00000013 f5af7630 000001ff 00000800 
>       f6a152a6 00000000 c36547c0 c3653de0 00000003 00000000 32033300 000f4205 
>       f5af7630 f6b8f430 f6b8f59c 00000013 c020efdd f5a7f000 7fffffff f5b16c04 
>Call Trace:
> [<c020eaa0>] do_con_write+0x698/0x6f8
> [<c020efdd>] con_write+0x16/0x1c
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0204cb7>] read_chan+0x31b/0x759
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c01ffaed>] tty_ldisc_deref+0x50/0x5f
> [<c02005dc>] tty_read+0xcf/0x127
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>mingetty      S C020EAA0  2980  5771      1          5772  5770 (NOTLB)
>f5af3e88 00000086 00000020 c020eaa0 00000013 c3b361f0 000001ff 00000800 
>       f6af72a6 00000000 c36547c0 c3653de0 00000003 000f4240 3230f9c0 000f4205 
>       c3b361f0 f5af7630 f5af779c 00000013 c020efdd f5af3000 7fffffff f4fbfc04 
>Call Trace:
> [<c020eaa0>] do_con_write+0x698/0x6f8
> [<c020efdd>] con_write+0x16/0x1c
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0204cb7>] read_chan+0x31b/0x759
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c01ffaed>] tty_ldisc_deref+0x50/0x5f
> [<c02005dc>] tty_read+0xcf/0x127
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>mingetty      S C020EAA0  2720  5772      1          5773  5771 (NOTLB)
>f5b15e88 00000082 00000020 c020eaa0 00000013 f6af0270 000001ff 00000800 
>       f6a382a6 00000246 00000000 c3643de0 00000001 00000000 2d8aca40 000f4205 
>       f6af0270 c3bd92b0 c3bd941c 00000013 c020efdd f5b15000 7fffffff f6a1fc04 
>Call Trace:
> [<c020eaa0>] do_con_write+0x698/0x6f8
> [<c020efdd>] con_write+0x16/0x1c
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0204cb7>] read_chan+0x31b/0x759
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c01ffaed>] tty_ldisc_deref+0x50/0x5f
> [<c02005dc>] tty_read+0xcf/0x127
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>mingetty      S C020EAA0  2980  5773      1          5774  5772 (NOTLB)
>f5bb2e88 00000086 00000020 c020eaa0 00000013 f5bb2e94 000001ff 00000800 
>       f69122a6 00000246 00000000 c364bde0 00000002 00000000 358777c0 000f4205 
>       c3850b30 f6908930 f6908a9c 00000013 c020efdd f5bb2000 7fffffff f52ffc04 
>Call Trace:
> [<c020eaa0>] do_con_write+0x698/0x6f8
> [<c020efdd>] con_write+0x16/0x1c
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0204cb7>] read_chan+0x31b/0x759
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c01ffaed>] tty_ldisc_deref+0x50/0x5f
> [<c02005dc>] tty_read+0xcf/0x127
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>mingetty      S C020EAA0  2980  5774      1          6317  5773 (NOTLB)
>f6a22e88 00000082 00000020 c020eaa0 00000013 f5bceb70 000001ff 00000800 
>       f6a172a6 00000000 c363c7c0 c363bde0 00000000 00000000 34a29600 000f4205 
>       f5bceb70 f6af07f0 f6af095c 00000013 c020efdd f6a22000 7fffffff f5b0ac04 
>Call Trace:
> [<c020eaa0>] do_con_write+0x698/0x6f8
> [<c020efdd>] con_write+0x16/0x1c
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0204cb7>] read_chan+0x31b/0x759
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c01ffaed>] tty_ldisc_deref+0x50/0x5f
> [<c02005dc>] tty_read+0xcf/0x127
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S C01446F0  2980  6317      1          6318  5774 (NOTLB)
>c3bb9f20 00003086 00003246 c01446f0 c13f9320 000000d0 00000000 c032f500 
>       00000000 000000d0 c0331d00 c3643de0 00000001 00000000 694eb580 000f73e9 
>       c38510b0 f5af70b0 f5af721c 00000000 00003246 03430467 c3bb9f30 c3bb9fa0 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S C011CD4A  3264  6318      1          6319  6317 (NOTLB)
>f533ff28 00003086 f533fef8 c011cd4a 0000000a f69f76b0 f69f8600 dfd25a40 
>       f6a0d180 00000000 c36547c0 c3653de0 00000003 00000000 3fa20840 000f7402 
>       f69f76b0 f70e98f0 f70e9a5c c03c7e80 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S C011CD4A  3592  6319      1          6320  6318 (NOTLB)
>f52f9f28 00003086 f52f9ef8 c011cd4a 00000009 f69f76b0 f69f8600 f70b79c0 
>       f6a0d180 00000000 c36547c0 c3653de0 00000003 00000000 2ae3f940 000f7402 
>       f69f76b0 f5af65b0 f5af671c c03c7e80 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S C011CD4A  3592  6320      1          6321  6319 (NOTLB)
>f5b10f28 00003086 f5b10ef8 c011cd4a 00000009 ffffffff c364bde0 f69f8600 
>       f6a0d180 00000000 00000000 c364bde0 00000002 00000000 958de040 000f4206 
>       c3850b30 f5c58cf0 f5c58e5c c03c7e80 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S C011CD4A  3396  6321      1          6322  6320 (NOTLB)
>f530ff28 00003086 f530fef8 c011cd4a 00000009 f6aef830 f69f8600 f6b033c0 
>       f6a0d180 00000000 c36547c0 c3653de0 00000003 00000000 2f1f5900 000f7402 
>       f6aef830 f695ef30 f695f09c c03c7e80 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S C011CD4A  3264  6322      1          6323  6321 (NOTLB)
>f52e7f28 00003086 f52e7ef8 c011cd4a 0000000a f6b76870 c018690b 00000000 
>       f6a0d180 00000000 c36447c0 c3643de0 00000001 00000000 451dd740 000f7402 
>       f6b76870 f5af6b30 f5af6c9c c03c7e80 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c018690b>] v2_write_file_info+0x9d/0xc2
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S C011CD4A  3320  6323      1          6324  6322 (NOTLB)
>f5bbcf28 00003086 f5bbcef8 c011cd4a f69f76b0 f69f76b0 f69f8600 f70b7180 
>       f6a0d180 00000000 c36447c0 c3643de0 00000001 00000000 44ff52c0 000f7402 
>       f69f76b0 f5cc1330 f5cc149c c03c7e80 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S C011CD4A  2980  6324      1          6325  6323 (NOTLB)
>f4f68f28 00003086 f4f68ef8 c011cd4a e01800b0 e01800b0 f69f8600 e3e23700 
>       dfd25d00 00000000 c363c7c0 c363bde0 00000000 00000000 6cce32c0 000f73fe 
>       e01800b0 f5cc18b0 f5cc1a1c 00003246 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>hpasmxld      S 00000000  3592  6325      1          6327  6324 (NOTLB)
>f5c39f28 00003086 00000000 00000000 00000000 00000000 00000000 00000000 
>       00000000 00000000 00000000 c3653de0 00000003 00000000 8d35a540 000f4206 
>       c38505b0 f6b8d3f0 f6b8d55c 00000000 c01a03f8 00018002 c38c9854 c38c9808 
>Call Trace:
> [<c01a03f8>] ipcperms+0x7e/0x87
> [<c01a17a3>] do_msgrcv+0x20c/0x2c1
> [<c01a187b>] sys_msgrcv+0x23/0x70
> [<c010ba04>] sys_ipc+0x124/0x201
> [<c02d8b53>] syscall_call+0x7/0xb
>spooler       S C032F500  2232  6394   5756          6399       (NOTLB)
>f5caaebc 00000082 c032f580 c032f500 00000246 c01446f0 c1403bc0 000000d0 
>       00000000 c032f500 00000000 c3643de0 00000001 00000000 a3b609c0 000f7403 
>       c38510b0 f5bceb70 f5bcecdc 00000000 00000246 0342eb97 f5caaecc 00000000 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>spooler       S 00000000  2720  6399   5756          6416  6394 (NOTLB)
>f4f66f54 00000082 00000060 00000000 c3850b30 f6ad6130 f63534c0 e309c940 
>       e309cb58 00000000 c36547c0 c364bde0 00000002 00000000 94eddbc0 000f7403 
>       c3850b30 f69e45f0 f69e475c 00000000 00000246 0342eaa1 f4f66f64 000003ea 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c012a894>] sys_nanosleep+0x103/0x1a1
> [<c02d8b53>] syscall_call+0x7/0xb
>hdb           S C032F500  2436  6416   5756          6497  6399 (NOTLB)
>f5b2debc 00000082 c032f580 c032f500 00000246 f5bceb70 c1407020 000000d0 
>       00000000 00000000 c36447c0 c3643de0 00000001 00000000 a3b609c0 000f7403 
>       f5bceb70 f4ffa670 f4ffa7dc 00000000 00000246 0342eb97 f5b2decc 00000000 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>cdm           S C032F500  2232  6497   5756          6504  6416 (NOTLB)
>f5cbaebc 00000086 c032f680 c032f500 00000246 c01446f0 c1408280 000000d0 
>       00000000 c032f500 00000000 c3653de0 00000003 00000000 9bb95c40 000f7403 
>       c38505b0 f5c2c130 f5c2c29c 00000000 00000246 0342eb11 f5cbaecc 00000000 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>processes     S C032F500  2232  6504   5756          6534  6497 (NOTLB)
>f5235ebc 00000086 c032f500 c032f500 00000246 c01446f0 c1405ac0 000000d0 
>       00000000 c032f500 00000000 c363bde0 00000000 00000000 a153afc0 000f7403 
>       c0327a80 f7c8e1b0 f7c8e31c 00000000 00000246 0342eb6f f5235ecc 00000000 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>snmptd        S C032F500  1960  6534   5756          6537  6504 (NOTLB)
>c3badebc 00000086 c032f580 c032f500 00000246 f69a0030 c140da60 000000d0 
>       00000000 00000000 c36447c0 c3643de0 00000001 00000000 9f2e5ec0 000f7403 
>       f69a0030 f5ce4e30 f5ce4f9c 00000000 00000246 0342eb4b c3badecc 00000000 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>snmptd        S 00000001  2944  6537   5756          6538  6534 (NOTLB)
>f5315ebc 00000086 f5315ef8 00000001 0000007f f6ad9770 c032f580 c032f500 
>       00000246 00000000 c36447c0 c3643de0 00000001 00000000 434b6d00 000f4c49 
>       f6ad9770 f5cc02b0 f5cc041c 00000000 f5cc02b0 f5315000 7fffffff 00000000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0281849>] datagram_poll+0x25/0xcc
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c015c083>] sys_write+0x5a/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>logmon        S C032F500  1876  6538   5756          6545  6537 (NOTLB)
>f5cbdebc 00000082 c032f580 c032f500 00000246 c01446f0 c13f8e20 000000d0 
>       00000000 c032f500 00000000 c3643de0 00000001 00000000 9f2e5ec0 000f7403 
>       c38510b0 f69a0030 f69a019c 00000000 00000246 0342eb4b f5cbdecc 00000000 
>Call Trace:
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>logmon        S C383AF80  2916  6545   5756          6546  6538 (NOTLB)
>f52edec8 00000082 e075e011 c383af80 f329c04c f695e430 00000008 c3b575a4 
>       00000000 00000000 c363c7c0 c363bde0 00000000 00000000 588637c0 000f73f6 
>       f695e430 f5c581f0 f5c5835c 00000101 00000001 f52ed000 7fffffff f52ed000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c016449b>] sys_fstat64+0x1e/0x23
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>logmon        S C383AF80  2932  6546   5756          6547  6545 (NOTLB)
>f5b77ec8 00000082 e075e011 c383af80 f329c04c f6ad91f0 00000008 c3b575a4 
>       00000000 00000000 c363c7c0 c363bde0 00000000 00000000 58a4bc40 000f73f6 
>       f6ad91f0 f5cac270 f5cac3dc 00000101 00000001 f5b77000 7fffffff f5b77000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c016449b>] sys_fstat64+0x1e/0x23
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>logmon        S C383AF80  2880  6547   5756          6548  6546 (NOTLB)
>f5cb3ec8 00000082 e075e011 c383af80 f329c04c f6ad8170 00000008 c3b575a4 
>       00000000 00000000 c363c7c0 c363bde0 00000000 00000000 58957a00 000f73f6 
>       f6ad8170 f5cac7f0 f5cac95c 00000101 00000001 f5cb3000 7fffffff f5cb3000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c016449b>] sys_fstat64+0x1e/0x23
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>logmon        S C383AF80  2944  6548   5756                6547 (NOTLB)
>f5cb0ec8 00000082 e075e00e c383af80 f5d3063c f695f4b0 00000005 c3b575a4 
>       fffffffe 00000000 c363c7c0 c363bde0 00000000 00000000 588637c0 000f73f6 
>       f695f4b0 f5cacd70 f5cacedc 00000101 00000001 f5cb0000 7fffffff f5cb0000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01514d9>] find_extend_vma+0x12/0x4f
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c01354ee>] futex_wait+0x1a0/0x1fa
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0135798>] do_futex+0x29/0x5a
> [<c01358ca>] sys_futex+0x101/0x10c
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>snmpd         S F6A31EC8  2012 26910      1         26941  6383 (NOTLB)
>f6a31ebc 00000082 c02d6999 f6a31ec8 c02d69c9 00000000 c383af80 f5c2d730 
>       f6ad9770 c032f600 c032f500 c364bde0 00000002 00000000 f17dc280 000f7401 
>       c3850b30 f6ad9770 f6ad98dc c0331d00 c01447cc f6a31000 7fffffff 00000000 
>Call Trace:
> [<c02d6999>] schedule+0x855/0x8f3
> [<c02d69c9>] schedule+0x885/0x8f3
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0281849>] datagram_poll+0x25/0xcc
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>snmpd         S C3850CA0  2720 26941      1         31092 26910 (NOTLB)
>f3375cb4 00000082 f6b03940 c3850ca0 c3b377f0 f6ad9770 f3375ccc 00000001 
>       00000000 00000000 c364c7c0 c364bde0 00000002 00000000 f17dc280 000f7401 
>       f6ad9770 f5c2d730 f5c2d89c 00000001 f5092dc0 f3375000 7fffffff f3375d1c 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c02d95ae>] apic_timer_interrupt+0x1a/0x20
> [<c0120494>] prepare_to_wait_exclusive+0x12/0x4b
> [<c02810aa>] wait_for_packet+0xca/0x114
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c0281176>] skb_recv_datagram+0x82/0x9b
> [<c02b8eb3>] udp_recvmsg+0x5f/0x279
> [<c027ecd7>] sock_common_recvmsg+0x30/0x46
> [<c027b988>] sock_recvmsg+0xef/0x10c
> [<c01716b8>] __d_lookup+0xed/0x109
> [<c0167b27>] do_lookup+0x23/0xba
> [<c01174b6>] smp_apic_timer_interrupt+0x9a/0x9c
> [<c02d95ae>] apic_timer_interrupt+0x1a/0x20
> [<c011cd4a>] recalc_task_prio+0x128/0x133
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c015cb9c>] fget+0x3b/0x42
> [<c027cbf4>] sys_recvfrom+0xa5/0xf5
> [<c011e7fb>] __wake_up_common+0x36/0x51
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c027d35b>] sys_socketcall+0x197/0x1fb
> [<c02d8b53>] syscall_call+0x7/0xb
>mingetty      S C020EAA0  2980 31092      1               26941 (NOTLB)
>f690ee88 00000082 00000020 c020eaa0 00000013 f690ee94 000001ff c020b9f3 
>       00000202 00000202 c374b000 c364bde0 00000002 00000000 1f6ad1c0 000f5bf1 
>       c3850b30 f692aef0 f692b05c 00000013 c020efdd f690e000 7fffffff f7cd1c04 
>Call Trace:
> [<c020eaa0>] do_con_write+0x698/0x6f8
> [<c020b9f3>] complement_pos+0x12/0x132
> [<c020efdd>] con_write+0x16/0x1c
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0204cb7>] read_chan+0x31b/0x759
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c01ffaed>] tty_ldisc_deref+0x50/0x5f
> [<c02005dc>] tty_read+0xcf/0x127
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>sshd          S E317AD70  2708  6168   3285  6172               (NOTLB)
>e317ad80 00000082 c3bd4dc0 e317ad70 f5ae4430 f5ae4430 00001818 00000000 
>       00000000 00000000 c36547c0 c3653de0 00000003 00000000 bb61dfc0 000f58ad 
>       f5ae4430 f5ce48b0 f5ce4a1c 00000001 f5ae4430 e317a000 7fffffff e317ade0 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c02d2efd>] unix_stream_data_wait+0xad/0xe5
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d30ae>] unix_stream_recvmsg+0x179/0x3d6
> [<c027baeb>] sock_aio_read+0x10d/0x11b
> [<c01707a8>] dput+0x34/0x1a7
> [<c01c5822>] direct_strncpy_from_user+0x3e/0x5d
> [<c015bd0c>] do_sync_read+0x9e/0xca
> [<c01c2de7>] kobject_get+0xf/0x13
> [<c015b2d1>] filp_open+0x51/0x65
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c015bdfe>] vfs_read+0xc6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>sshd          S C032F500  2804  6172   6168  6173               (NOTLB)
>e2df2ebc 00000082 c032f500 c032f500 00000246 f6aef830 c140c0e0 000000d0 
>       00000000 c032f500 00000246 c363bde0 00000000 00000000 cc6b4ac0 000f7402 
>       f6aef830 f5ae4430 f5ae459c 00000000 00000001 e2df2000 7fffffff 00000000 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01ffaed>] tty_ldisc_deref+0x50/0x5f
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c02d8b53>] syscall_call+0x7/0xb
>bash          S 00000001  2980  6173   6172  6199               (NOTLB)
>e2dc3f28 00000082 80000001 00000001 f4f1ab74 e2c3d370 c3b05980 c3b059b0 
>       f4f1ab74 00000000 c36447c0 c3643de0 00000001 00000000 bd8730c0 000f58ad 
>       e2c3d370 f5cc0db0 f5cc0f1c e2c3d41c e2c3d370 f5cc0e54 fffffe00 f5cc0db0 
>Call Trace:
> [<c0125a0e>] do_wait+0x26e/0x449
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0125c7c>] sys_wait4+0x27/0x2a
> [<c0125c92>] sys_waitpid+0x13/0x17
> [<c02d8b53>] syscall_call+0x7/0xb
>su            S 00000001  2764  6199   6173  6200               (NOTLB)
>e37cff28 00000086 80000001 00000001 f4fb99bc f6a0c3c0 f6a0c3c0 f6a0c3f0 
>       f4fb99bc e2c3d370 c011b023 c3643de0 00000001 00000000 c5190e80 000f58ad 
>       c38510b0 e2c3d370 e2c3d4dc e37cff70 e2c3d478 e2c3d414 fffffe00 e2c3d370 
>Call Trace:
> [<c011b023>] do_page_fault+0x1ae/0x5c6
> [<c0125a0e>] do_wait+0x26e/0x449
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c0125c7c>] sys_wait4+0x27/0x2a
> [<c0125c92>] sys_waitpid+0x13/0x17
> [<c02d8b53>] syscall_call+0x7/0xb
>bash          S C02D6A24  2396  6200   6199                     (NOTLB)
>e33a1e88 00000082 e33a1000 c02d6a24 00000246 00000000 f5ae4430 f5ae4430 
>       e33a1e50 c381b200 e2c74000 c363bde0 00000000 00000000 b33febc0 000f722f 
>       c0327a80 f4ffb170 f4ffb2dc e2c74000 c381b200 e33a1000 7fffffff e2c74c04 
>Call Trace:
> [<c02d6a24>] schedule+0x8e0/0x8f3
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c01203b5>] add_wait_queue+0x12/0x30
> [<c0204cb7>] read_chan+0x31b/0x759
> [<c0120411>] remove_wait_queue+0xf/0x34
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c011e83f>] __wake_up+0x29/0x3c
> [<c011e7b9>] default_wake_function+0x0/0xc
> [<c02005dc>] tty_read+0xcf/0x127
> [<c015bdee>] vfs_read+0xb6/0xe2
> [<c015c003>] sys_read+0x3c/0x62
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  1848 23018   3626         31728       (NOTLB)
>e0136f20 00000086 c1403380 000000d0 c38505b0 c032f500 00000000 000000d0 
>       c0331d00 c01447cc 00000001 c3653de0 00000003 00000000 b827cd80 000f7403 
>       c38505b0 e2c3c2f0 e2c3c45c 00000000 00000246 0342fc8f e0136f30 e0136fa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  1804 31728   3626           505 23018 (NOTLB)
>e0046f20 00000086 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       f70b42b0 00000010 00000000 c363bde0 00000000 000bde31 a758d300 000f7403 
>       c0327a80 f70b42b0 f70b441c 00000000 00000246 0342efbd e0046f30 e0046fa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2624   505   3626          3450 31728 (NOTLB)
>e0176f20 00000082 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       e2c3cdf0 00000010 00000000 c363bde0 00000000 00000000 b6b99780 000f7403 
>       c0327a80 e2c3cdf0 e2c3cf5c 00000000 00000246 0344bdaf e0176f30 e0176fa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2424  3450   3626          4542   505 (NOTLB)
>e009df20 00000086 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       f6a5e670 00000010 00000000 c3643de0 00000001 00000000 4984fec0 000f73fe 
>       c38510b0 f6a5e670 f6a5e7dc 00000000 00000246 034462a4 e009df30 e009dfa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c015c7ee>] sys_sendfile+0x68/0xb4
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2024  4542   3626          6786  3450 (NOTLB)
>e0771f20 00000082 00000000 000000d0 c38510b0 c01447cc 00000001 00000000 
>       e01816b0 00000010 00000000 c3643de0 00000001 00000000 e1381c40 000f7401 
>       c38510b0 e01816b0 e018181c 00000000 00000246 03441df8 e0771f30 e0771fa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c015c7ee>] sys_sendfile+0x68/0xb4
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 00000001  2628  6786   3626          8070  4542 (NOTLB)
>e0900e1c 00000082 f4f94580 00000001 e0900ef8 f6b8c8f0 00000103 e0900ebc 
>       37900ee8 00000000 c36547c0 c3653de0 00000003 00000000 a73a4e80 000f7403 
>       f6b8c8f0 f5cad2f0 f5cad45c e12f6dc0 c027ebaa e0900000 7fffffff e0900e7c 
>Call Trace:
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2032  8070   3626         10627  6786 (NOTLB)
>e0355f20 00000086 00000000 000000d0 c0331d00 e15a0e70 00000001 00000000 
>       e2c3d8f0 00000000 c36547c0 c3653de0 00000003 00000000 83e1d840 000f7403 
>       e15a0e70 e2c3d8f0 e2c3da5c 00000000 00000246 0342ed6a e0355f30 e0355fa0 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         R running  2088 10627   3626         10995  8070 (NOTLB)
>httpd         S 000000D0  2664 10995   3626         11011 10627 (NOTLB)
>e016bf20 00000086 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       f7020d70 00000010 00000000 c3643de0 00000001 00000000 b33552c0 000f7403 
>       c38510b0 f7020d70 f7020edc 00000000 00000246 0342ec9c e016bf30 e016bfa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 00000001  2104 11011   3626         11603 10995 (NOTLB)
>e0ec4e1c 00000086 f4f94580 00000001 e0ec4ef8 00000000 00000192 e0ec4ebc 
>       32c2d1b0 00000000 00000000 c363bde0 00000000 00000000 9b7c5340 000f7403 
>       c0327a80 f5c2d1b0 f5c2d31c f61d96c0 c027ebaa e0ec4000 7fffffff e0ec4e7c 
>Call Trace:
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2628 14557   3626         16166 12621 (NOTLB)
>e01a7f20 00000086 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       f5cad870 00000010 00000000 c364bde0 00000002 00000000 b7adbb80 000f7403 
>       c3850b30 f5cad870 f5cad9dc 00000000 00000246 0344bdbf e01a7f30 e01a7fa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S F6BD3440  1488 16166   3626         19039 14557 (NOTLB)
>e1075e1c 00000086 e10a1280 f6bd3440 f6bd3440 f6b8c8f0 c0291ebd f7f05d40 
>       f6bd3440 00000000 c36547c0 c3653de0 00000003 00000000 a1be7f80 000f7403 
>       f6b8c8f0 f5be36b0 f5be381c e309d6c0 c027ebaa e1075000 7fffffff e1075e7c 
>Call Trace:
> [<c0291ebd>] qdisc_restart+0x12/0x1b9
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S C0169121  1464 19039   3626         19725 16166 (NOTLB)
>e0939f50 00000086 00000006 c0169121 e02f204c 00000246 00000000 000000d0 
>       00000000 e0939f1c c02d7082 c364bde0 00000002 00145855 7b3d5200 000f7403 
>       c3850b30 e2c3c870 e2c3c9dc e08c7808 c0120448 e08c77ec 00000000 e0939f6c 
>Call Trace:
> [<c0169121>] may_open+0x142/0x21e
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c0120448>] prepare_to_wait+0x12/0x4c
> [<c016f3ba>] flock_lock_file_wait+0xae/0xdc
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c016f48a>] sys_flock+0xa2/0x120
> [<c02d8b53>] syscall_call+0x7/0xb
>pickup        S F6D29AA4  2980 19044   3396                3405 (NOTLB)
>e067cebc 00000082 f8875f01 f6d29aa4 f6a5e0f0 c0359ae0 e067ceac c032f600 
>       c032f500 00000246 c01446f0 c364bde0 00000002 00000000 92888340 000f73fd 
>       c3850b30 e0180630 e018079c 00000000 00000246 03440884 e067cecc 00000000 
>Call Trace:
> [<f8875f01>] __journal_file_buffer+0x147/0x221 [jbd]
> [<c01446f0>] buffered_rmqueue+0x17d/0x1a5
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016cde0>] do_select+0x291/0x2c6
> [<c016ca15>] __pollwait+0x0/0x95
> [<c016d108>] sys_select+0x2e0/0x43a
> [<c01261d7>] sys_time+0xf/0x58
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 00000001  2112 19725   3626         21678 19039 (NOTLB)
>e02d7e1c 00000082 f4f94580 00000001 e02d7ef8 f6ad6130 000000a7 e02d7ebc 
>       372d7ee8 00000000 00000000 c363bde0 00000000 00000000 9b6d1100 000f7403 
>       f6ad6130 f69a05b0 f69a071c e142cdc0 c027ebaa e02d7000 7fffffff e02d7e7c 
>Call Trace:
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 00000001  2632 21678   3626         22323 19725 (NOTLB)
>dfd00e1c 00000086 f4f94580 00000001 dfd00ef8 00000000 00000149 dfd00ebc 
>       32000000 00000000 00000000 c3643de0 00000001 00000000 9f992e80 000f7403 
>       c38510b0 c3b36cf0 c3b36e5c f61d8040 c027ebaa dfd00000 7fffffff dfd00e7c 
>Call Trace:
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         R running  2640 22323   3626         22967 21678 (NOTLB)
>httpd         S 00000001  2648 22967   3626         24604 22323 (NOTLB)
>e0354e1c 00000086 f4f94580 00000001 e0354ef8 00000000 000001de e0354ebc 
>       37aef830 00000000 00000000 c364bde0 00000002 00000000 9a3be400 000f7403 
>       c3850b30 f6aef830 f6aef99c f53e44c0 c027ebaa e0354000 7fffffff e0354e7c 
>Call Trace:
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2712 24604   3626         24924 22967 (NOTLB)
>e043ff20 00000086 00000000 000000d0 e15a08f0 e15a08f0 00000001 00000000 
>       f70b4830 00000000 c36547c0 c3653de0 00000003 00000000 b2d9c540 000f7403 
>       e15a08f0 f70b4830 f70b499c 00000000 00000246 0342ef5b e043ff30 e043ffa0 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S F6BD3440  2680 24924   3626         25567 24604 (NOTLB)
>e03f6e1c 00000082 f4fa6480 f6bd3440 f6bd3440 f6bd3440 c0291ebd f7f05d40 
>       f6bd3440 f7f05d40 00000246 c3643de0 00000001 00000000 93cbf100 000f7403 
>       c38510b0 f6bb03f0 f6bb055c f7f8d100 c39a72b8 e03f6000 7fffffff e03f6e7c 
>Call Trace:
> [<c0291ebd>] qdisc_restart+0x12/0x1b9
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c0129fc8>] del_timer+0x5d/0x65
> [<c027e9b8>] sk_stop_timer+0x10/0x1a
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2672 25567   3626         25596 24924 (NOTLB)
>dfd72f20 00000086 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       c3bd8230 00000010 00000000 c3653de0 00000003 00000000 9c14e9c0 000f7403 
>       c38505b0 c3bd8230 c3bd839c 00000000 00000246 0344bbf0 dfd72f30 dfd72fa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c015c7ee>] sys_sendfile+0x68/0xb4
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S F6BD3440  2672 25596   3626         25883 25567 (NOTLB)
>e23ffe1c 00000086 e290b940 f6bd3440 f6bd3440 f6bd3440 c0291ebd f7f05d40 
>       f6bd3440 f7f05d40 00000246 c364bde0 00000002 00000000 99e05680 000f7403 
>       c3850b30 f6b8c370 f6b8c4dc f61ea040 c027ebaa e23ff000 7fffffff e23ffe7c 
>Call Trace:
> [<c0291ebd>] qdisc_restart+0x12/0x1b9
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2712 25883   3626         26865 25596 (NOTLB)
>dfd62f20 00000082 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       f6b76870 00000010 00000000 c3643de0 00000001 00000000 9f3da100 000f7403 
>       c38510b0 f6b76870 f6b769dc 00000000 00000246 0342eb4d dfd62f30 dfd62fa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         R running  2712 26865   3626         26904 25883 (NOTLB)
>httpd         S F6BD3440  2712 26904   3626         27233 26865 (NOTLB)
>e03ece1c 00000082 e290ba00 f6bd3440 f6bd3440 f6bd3440 c0291ebd f7f05d40 
>       f6bd3440 f7f05d40 00000246 c3643de0 00000001 00000000 abe07e00 000f7403 
>       c38510b0 f6b8c8f0 f6b8ca5c e3a76040 c027ebaa e03ec000 7fffffff e03ece7c 
>Call Trace:
> [<c0291ebd>] qdisc_restart+0x12/0x1b9
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  1828 27233   3626         27555 26904 (NOTLB)
>e0655f20 00000082 00000000 000000d0 c38505b0 c01447cc 00000001 00000000 
>       e15a1970 00000010 00000000 c3653de0 00000003 00000000 1af761c0 000f73fd 
>       c38505b0 e15a1970 e15a1adc 00000000 00000246 0343a92c e0655f30 e0655fa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c015c7ee>] sys_sendfile+0x68/0xb4
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2692 27555   3626         28497 27233 (NOTLB)
>e02a0f20 00000086 00000000 000000d0 c0331d00 e15a0e70 00000001 00000000 
>       f692a3f0 00000000 c36447c0 c3643de0 00000001 00000000 910e0980 000f7403 
>       e15a0e70 f692a3f0 f692a55c 00000000 00000246 0344bb37 e02a0f30 e02a0fa0 
>Call Trace:
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c015c7ee>] sys_sendfile+0x68/0xb4
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S F6BD3440  2676 28497   3626         29181 27555 (NOTLB)
>dfdd0e1c 00000082 f5a9a7c0 f6bd3440 f6bd3440 f6bd3440 c0291ebd f7f05d40 
>       f6bd3440 f7f05d40 00000246 c363bde0 00000000 00000000 b733a980 000f7403 
>       c0327a80 e15a0e70 e15a0fdc e2a21240 c027ebaa dfdd0000 7fffffff dfdd0e7c 
>Call Trace:
> [<c0291ebd>] qdisc_restart+0x12/0x1b9
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 00000001  2688 29181   3626         29473 28497 (NOTLB)
>dfdc2e1c 00000086 f4f94580 00000001 dfdc2ef8 00000000 00000108 dfdc2ebc 
>       32dc2ee8 00000000 00000000 c3653de0 00000003 00000000 975f7800 000f7403 
>       c38505b0 f4ffa0f0 f4ffa25c dfdc2e2c f32a9770 dfdc2000 7fffffff dfdc2e7c 
>Call Trace:
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c0142f0e>] __generic_file_aio_write_nolock+0x389/0x3b7
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c0129fc8>] del_timer+0x5d/0x65
> [<c027e9b8>] sk_stop_timer+0x10/0x1a
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 000000D0  2712 29473   3626         30114 29181 (NOTLB)
>e037df20 00000082 00000000 000000d0 c0331d00 c01447cc 00000001 00000000 
>       f6ada730 00000010 00000000 c3643de0 00000001 00000000 b049a480 000f7403 
>       c38510b0 f6ada730 f6ada89c 00000000 00000246 0342f053 e037df30 e037dfa0 
>Call Trace:
> [<c01447cc>] __alloc_pages+0xb4/0x2a6
> [<c02d72a1>] schedule_timeout+0x135/0x159
> [<c012a76e>] process_timeout+0x0/0x13
> [<c016d371>] do_poll+0x8e/0xac
> [<c016d551>] sys_poll+0x1c2/0x279
> [<c016ca15>] __pollwait+0x0/0x95
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S 00000001  2712 30114   3626         30117 29473 (NOTLB)
>dfc63e1c 00000082 f4f94580 00000001 dfc63ef8 f6ad6130 000000da dfc63ebc 
>       37c63ee8 00000000 c36547c0 c3653de0 00000003 00000000 98351780 000f7403 
>       f6ad6130 f69f7130 f69f729c f539f240 c027ebaa dfc63000 7fffffff dfc63e7c 
>Call Trace:
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>httpd         S F6BD3440  2712 30117   3626               30114 (NOTLB)
>dfd81e1c 00000086 f6473500 f6bd3440 f6bd3440 f6bd3440 c0291ebd f7f05d40 
>       f6bd3440 f7f05d40 00000246 c3643de0 00000001 00000000 ae8f2340 000f7403 
>       c38510b0 c3b36770 c3b368dc e309d6c0 c027ebaa dfd81000 7fffffff dfd81e7c 
>Call Trace:
> [<c0291ebd>] qdisc_restart+0x12/0x1b9
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02d7230>] schedule_timeout+0xc4/0x159
> [<c027ebaa>] release_sock+0xf/0x4f
> [<c02a4e04>] wait_for_connect+0x73/0xd7
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c012051d>] autoremove_wake_function+0x0/0x2d
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c02a4eb9>] tcp_accept+0x51/0xd2
> [<c02beb1e>] inet_accept+0x1d/0x92
> [<c027c82d>] sys_accept+0xa8/0x13f
> [<c02d7082>] __cond_resched+0x14/0x39
> [<c016678a>] pipe_readv+0x78/0x29e
> [<c027d2d0>] sys_socketcall+0x10c/0x1fb
> [<c01262b1>] sys_gettimeofday+0x53/0xac
> [<c02d8b53>] syscall_call+0x7/0xb
>Mem-info:
>DMA per-cpu:
>cpu 0 hot: low 2, high 6, batch 1
>cpu 0 cold: low 0, high 2, batch 1
>cpu 1 hot: low 2, high 6, batch 1
>cpu 1 cold: low 0, high 2, batch 1
>cpu 2 hot: low 2, high 6, batch 1
>cpu 2 cold: low 0, high 2, batch 1
>cpu 3 hot: low 2, high 6, batch 1
>cpu 3 cold: low 0, high 2, batch 1
>Normal per-cpu:
>cpu 0 hot: low 32, high 96, batch 16
>cpu 0 cold: low 0, high 32, batch 16
>cpu 1 hot: low 32, high 96, batch 16
>cpu 1 cold: low 0, high 32, batch 16
>cpu 2 hot: low 32, high 96, batch 16
>cpu 2 cold: low 0, high 32, batch 16
>cpu 3 hot: low 32, high 96, batch 16
>cpu 3 cold: low 0, high 32, batch 16
>HighMem per-cpu:
>cpu 0 hot: low 32, high 96, batch 16
>cpu 0 cold: low 0, high 32, batch 16
>cpu 1 hot: low 32, high 96, batch 16
>cpu 1 cold: low 0, high 32, batch 16
>cpu 2 hot: low 32, high 96, batch 16
>cpu 2 cold: low 0, high 32, batch 16
>cpu 3 hot: low 32, high 96, batch 16
>cpu 3 cold: low 0, high 32, batch 16
>
>Free pages:     2476428kB (2003392kB HighMem)
>Active:187246 inactive:171187 dirty:354 writeback:0 unstable:0 free:619107 slab:54088 mapped:84700 pagetables:1521
>DMA free:12396kB min:64kB low:128kB high:192kB active:0kB inactive:0kB present:16384kB pages_scanned:0 all_unreclaimable? no
>protections[]: 0 0 0
>Normal free:460640kB min:3728kB low:7456kB high:11184kB active:74000kB inactive:97724kB present:901120kB pages_scanned:0 all_unreclaimable? no
>protections[]: 0 0 0
>HighMem free:2003392kB min:512kB low:1024kB high:1536kB active:674984kB inactive:587024kB present:4063228kB pages_scanned:0 all_unreclaimable? no
>protections[]: 0 0 0
>DMA: 5*4kB 3*8kB 4*16kB 2*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 1*2048kB 2*4096kB = 12396kB
>Normal: 38*4kB 9*8kB 6*16kB 3*32kB 1*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 112*4096kB = 460640kB
>HighMem: 3470*4kB 315*8kB 1169*16kB 359*32kB 153*64kB 155*128kB 58*256kB 33*512kB 13*1024kB 1*2048kB 459*4096kB = 2003392kB
>Swap cache: add 0, delete 0, find 0/0, race 0+0
>0 bounce buffer pages
>Free swap:       1052216kB
>1245183 pages of RAM
>818767 pages of HIGHMEM
>208274 reserved pages
>195578 pages shared
>0 pages swap cached

Actions: View

Attachments on bug 437674: 298178 | 314488 | 314497