Attachment 160264 Details for Bug 250155 – vmstat 1, sysrq commands outputs -- around 100% sys cpu util

vmstat 1, sysrq commands outputs -- around 100% sys cpu util

RH5 outputs.txt (text/plain), 31.22 KB, created by Vijay Trehan on 2007-07-30 19:12:05 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Vijay Trehan

Created: 2007-07-30 19:12:05 UTC

Size: 31.22 KB

patch

obsolete

>
>
>
>
>
>1) vmstat 1
>
>
>
>procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------
> r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
> 8  0  21780  85176   6120 828080    0    0   168  2092 4836 37928 41  7 48  4  0
>22  3  21780  86048   6260 820944    0    0   552  1668 4008 50418 48 11 37  4  0
> 0  0  21780  85316   6340 817608    0    0   376   884 3436 56149 31 11 55  3  0
> 1  0  21780  84820   6404 817928    0    0    40   744 3203 43254 19  8 72  2  0
> 3  1  21780  86432   6616 814020    0    0    68  2416 3332 44955 28  9 58  5  0
> 0  1  21780  83024   6884 814240    0    0    96  3120 3567 53970 39 12 41  8  0
>22  4  21780  85396   7092 803456    0    0   664  2404 3828 74495 42 15 32 11  0
>34  9  22144  82272   5524 790460    0  228  1144  1572 4698 98136 66 24  4  6  0
> 2  0  22144  86752   5332 784216    0    0   232  1496 5040 137247 34 23 38  6  0
> 5  0  22144  87000   5364 784412    0    0    24   300 4632 100868 20 16 64  1  0
> 9  1  22144  86876   5432 784452    0    0    32   792 3968 44583 22  7 69  2  0
> 0  0  22144  86256   5484 784544    0    0     0   552 3961 62503 25 10 64  1  0
> 0  0  22144  85884   5520 784512    0    0     4   368 4261 107954 22 18 60  0  0
> 0  0  22144  85760   5576 784532    0    0     0   644 3855 90781 22 14 63  1  0
> 0  3  22144  80936   5580 785280    0   28   148  7540 3663 45662 32 15 49  4  0
>145  4  22148  79488   5276 775328    0    0   216 11340 3953 46849 40 42 13  5  0
>188  2  22156  79728   2540 769312    0  364   388  9072 4340 60549 36 55  6  3  0
>138  1  22156  79636   2416 766392    0    0   236  5896 4887 64777 28 65  4  3  0
>36  1  22156  79536   2556 763976    0    0    32  2236 6724 92483 23 74  2  1  0
>279  3  22156  79920   2544 763856    0    4    16   696 5363 78312 23 71  4  1  0
>364  1  22156  79244   2572 763780    0    0    16   952 5752 45062 21 79  0  0  0
>procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------
> r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
>84  4  22156  79700   2592 760460    0    8   344   908 4512 33756 31 69  0  0  0
>40  0  22156  81880   2592 756636    0    0    92  1400 3521 19826 16 80  3  1  0
>396  5  22156  79028   2356 753576    0    0   324   832 3931 26165 29 71  0  0  0
>99  1  22156  79196   2168 753748    0    0    36   424 2360 7308  5 94  0  1  0
>353  2  22156  79488   2032 752760    0    0     0    64 3134 16020  9 91  0  0  0
>42  0  23444  79300   2052 751320    0    0    16     0 4240 18600  8 92  0  0  0
>56  0  24588  79424   2068 750204    0   80     0   188 2987 7493  4 96  0  0  0
>24  0  25060  79732   2080 749756    0   36    20    36 2255 6046  2 98  0  0  0
>18  0  25216  80040   2092 749584    0    0     8    60 2053 5662  2 98  0  0  0
>26  0  25616  80040   2104 749172    0    0     4    16 1063  339  0 100  0  0  0
>24  2  29356  79040   2008 746216    0  256    16   608 1567 7176  5 95  0  0  0
>37  0  31624  80060   2004 744384    0 1116     0  1284 1302 1255  0 99  0  0  0
>21  0  31756  80060   2004 743720    0    0     0     0 1888 9743  2 98  0  0  0
>24  0  31756  80060   2012 743692    0    0     4    92 1702 2219  0 100  0  0  0
>19  0  31756  80060   2036 743692    0    0     8    48 1231  491  0 100  0  0  0
>19  0  31756  80060   2036 743720    0    0     0     0 1584  301  0 100  0  0  0
>15  0  31820  80180   2036 743792    0    0     0     0 1078  147  0 100  0  0  0
>15  0  31904  80304   2036 743572    0    0     0     0 1020  128  0 100  0  0  0
>16  0  32040  80544   2036 743400    0  336     0   336 1059  142  0 100  0  0  0
>15  2  32204  80604   2052 743264    0   16    12    44 1030  177  0 100  0  0  0
>16  1  39924  80832   2472 735836    0 1068     0  1996 1343  676  0 100  0  0  0
>procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------
> r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
> 8  1  48456  79336   2816 728416   32 4640   332  6064 2034 16832 19 72  4  5  0
> 8  1  49936  78960   3276 727160    0  196     0  1176 1259  649  0 75 13 12  0
>35  1  51612  79136   3352 725884    0  448     0   680 2204 3312  4 91  2  2  0
>13  1  60296  80756   3416 717732    0 1652     0  1852 1189  438  0 100  0  0  0
>12  1  68508  81764   3656 709364    0 1996     4  2760 1951 3218  2 97  1  0  0
> 3 12  69380  79312   3372 712528  640 8072   960  9744 3205 25202 35 48  8  9  0
> 9  2  84716  84300   3408 711468  188 19996   676 21472 3410 19928 38 55  1  6  0
>134 16  92476  79396   3588 713460 1244 8896  2152 10992 4713 37878 49 36  7  8  0
>305  5 112904  81076   3620 715480 1364 22260  2272 26860 6822 63581 39 56  2  3  0
>48  2 125460  81632   3520 718140 1300 11632  1652 18840 8008 109232 36 60  2  1  0
> 7  3 126000  79116   3908 720620  540  864   564  4812 4659 43523 17 32 34 17  0
>329 11 138328  80060   4144 722468  848 10872   968 15484 5649 48837 28 44 18 10  0
> 2  3 146652  79048   4284 723160 1052 7980  1460 14596 4730 48483 42 47  7  4  0
> 6  1 152220  83156   4180 727712  680 7168   760 11900 4224 27658 14 67 13  7  0
> 5  0 157920  80488   4320 725072  292 5820   420  8848 4755 45242 29 55 13  3  0
> 3  0 158908  83020   4076 723928  128 1644   128  1664 3382 17597  5 53 38  3  0
>25  1 163868  79500   4052 724928  500 6088   572  9588 5182 58416 32 57 11  1  0
>11  1 168124  79164   3964 727656  508 6732   520  8652 4822 52279 24 65  9  2  0
>138  4 175072  80076   3836 723084  256 5568   632  6964 4937 48498 27 59 14  0  0
>133  0 182340  81896   3544 718884  812 11100  1168 13252 6620 74156 36 63  1  0  0
>42  2 188956  78876   3488 721352  672 5852  1016 10416 7096 94126 42 56  2  0  0
>
>
>
>2) sysrq commands
>
>echo 'w' > /proc/sysrq-trigger
>
>echo 'm' > /proc/sysrq-trigger
>
>
>
>from /var/log/messages
>
>
>
>
>
>
>[root@woodcrest log]# date
>Tue Jul 24 17:38:41 EDT 2007
>You have new mail in /var/spool/mail/root
>
>
>Jul 24 17:37:18 woodcrest kernel: SysRq : Show CPUs
>Jul 24 17:37:18 woodcrest kernel: CPU2:
>Jul 24 17:37:18 woodcrest kernel:  ffff81042fd1ff48 0000000000000000 ffff8101cb1a3a30 ffffffff801917d0
>Jul 24 17:37:18 woodcrest kernel:  0000000000000000 0000000000000001 0000000000000005 ffffffff801917ff
>Jul 24 17:37:18 woodcrest kernel:  ffffffff8005c330 ffffffff800229ee 0000000000018043 0000000000000000
>Jul 24 17:37:18 woodcrest kernel: Call Trace:
>Jul 24 17:37:18 woodcrest kernel:  <IRQ>  [<ffffffff801917d0>] showacpu+0x0/0x3b
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff801917ff>] showacpu+0x2f/0x3b
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8005c330>] call_softirq+0x1c/0x28
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800229ee>] smp_call_function_interrupt+0x57/0x75
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8005bc56>] call_function_interrupt+0x66/0x6c
>Jul 24 17:37:18 woodcrest kernel:  <EOI>  [<ffffffff8006270f>] .text.lock.spinlock+0x5/0x30
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff80032d73>] page_referenced_file+0x42/0xc3
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800c178b>] page_referenced_one+0x81/0xd0
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8003b639>] page_referenced+0xcb/0xe4
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800bd085>] shrink_active_list+0x192/0x426
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800128f4>] shrink_zone+0xc5/0x108
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800be290>] try_to_free_pages+0x163/0x275
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8000ef9a>] __alloc_pages+0x1b1/0x2b2
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8002b46d>] get_zeroed_page+0x21/0x83
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff80015d75>] __pte_alloc+0x1a/0x142
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff80008715>] __handle_mm_fault+0x12d/0xdf2
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff80086c5f>] default_wake_function+0x0/0xe
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800645a5>] do_page_fault+0x4b8/0x81d
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff80060ab8>] thread_return+0x0/0xea
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff80039d2a>] tty_ldisc_deref+0x68/0x7b
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8005be1d>] error_exit+0x0/0x84
>Jul 24 17:37:18 woodcrest kernel:
>Jul 24 17:37:18 woodcrest kernel: CPU4:
>Jul 24 17:37:18 woodcrest kernel:  ffff81042fda3f48 0000000000000000 ffff81006a0c7860 ffffffff801917d0
>Jul 24 17:37:18 woodcrest kernel:  0000000000000000 0000000000000001 0000000000000004 ffffffff801917ff
>Jul 24 17:37:18 woodcrest kernel:  ffffffff8005c330 ffffffff800229ee 0000000000017b3e 0000000000000000
>Jul 24 17:37:18 woodcrest kernel: Call Trace:
>Jul 24 17:37:18 woodcrest kernel:  <IRQ>  [<ffffffff801917d0>] showacpu+0x0/0x3b
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff801917ff>] showacpu+0x2f/0x3b
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8005c330>] call_softirq+0x1c/0x28
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800229ee>] smp_call_function_interrupt+0x57/0x75
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8005bc56>] call_function_interrupt+0x66/0x6c
>Jul 24 17:37:18 woodcrest kernel:  <EOI>  [<ffffffff8006270c>] .text.lock.spinlock+0x2/0x30
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff80032d73>] page_referenced_file+0x42/0xc3
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff8003b639>] page_referenced+0xcb/0xe4
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800bd085>] shrink_active_list+0x192/0x426
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800128f4>] shrink_zone+0xc5/0x108
>Jul 24 17:37:18 woodcrest kernel:  [<ffffffff800be290>] try_to_free_pages+0x163/0x275
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8001e043>] __pollwait+0x0/0xe2
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8000ef9a>] __alloc_pages+0x1b1/0x2b2
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff80016fd3>] cache_grow+0x137/0x395
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff80086c5f>] default_wake_function+0x0/0xe
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8005a564>] cache_alloc_refill+0x136/0x186
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800cc4b1>] __kmalloc+0x95/0x9f
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8002dc81>] __alloc_skb+0x5c/0x123
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8002584c>] tcp_sendmsg+0x184/0xad1
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff80037264>] do_sock_write+0xc4/0xce
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8004543e>] sock_aio_write+0x4f/0x5e
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800177d2>] do_sync_write+0xc7/0x104
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8009b666>] autoremove_wake_function+0x0/0x2e
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff80039d2a>] tty_ldisc_deref+0x68/0x7b
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff80016134>] vfs_write+0xe1/0x174
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800169b2>] sys_write+0x45/0x6e
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8005b2c1>] tracesys+0xd1/0xdc
>Jul 24 17:37:19 woodcrest kernel:
>Jul 24 17:37:19 woodcrest kernel: CPU0:
>Jul 24 17:37:19 woodcrest kernel:  ffffffff80402f48 0000000000000000 ffff810201a77570 ffffffff801917d0
>Jul 24 17:37:19 woodcrest kernel:  0000000000000000 0000000000000000 0000000000000000 ffffffff801917ff
>Jul 24 17:37:19 woodcrest kernel:  ffffffff8005c330 ffffffff800229ee 000000000001151f 0000000000000000
>Jul 24 17:37:19 woodcrest kernel: Call Trace:
>Jul 24 17:37:19 woodcrest kernel:  <IRQ>  [<ffffffff801917d0>] showacpu+0x0/0x3b
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff801917ff>] showacpu+0x2f/0x3b
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8005c330>] call_softirq+0x1c/0x28
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800229ee>] smp_call_function_interrupt+0x57/0x75
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8005bc56>] call_function_interrupt+0x66/0x6c
>Jul 24 17:37:19 woodcrest kernel:  <EOI>  [<ffffffff8006270f>] .text.lock.spinlock+0x5/0x30
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff80032d73>] page_referenced_file+0x42/0xc3
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800b9899>] __remove_from_page_cache+0x1b/0x39
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800c3902>] swap_duplicate+0x5a/0xf1
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff8003b61a>] page_referenced+0xac/0xe4
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800cb829>] shmem_writepage+0x13e/0x167
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800bd5b0>] shrink_inactive_list+0x186/0x79f
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff800bcecc>] isolate_lru_pages+0x98/0xbf
>Jul 24 17:37:19 woodcrest kernel:  [<ffffffff80045d5d>] __pagevec_release+0x19/0x22
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff800bd309>] shrink_active_list+0x416/0x426
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff80012912>] shrink_zone+0xe3/0x108
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff800be290>] try_to_free_pages+0x163/0x275
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8009b666>] autoremove_wake_function+0x0/0x2e
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8000ef9a>] __alloc_pages+0x1b1/0x2b2
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8002b46d>] get_zeroed_page+0x21/0x83
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff80015d75>] __pte_alloc+0x1a/0x142
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff800e1af8>] mpage_bio_submit+0x22/0x26
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff80008715>] __handle_mm_fault+0x12d/0xdf2
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff800bea3c>] zone_statistics+0x3e/0x6d
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff800645a5>] do_page_fault+0x4b8/0x81d
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff80060ab8>] thread_return+0x0/0xea
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8006b35b>] do_gettimeofday+0x50/0x92
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff80028403>] sync_page+0x0/0x42
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8005be1d>] error_exit+0x0/0x84
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8000cbd1>] file_read_actor+0x25/0x154
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8000bd19>] do_generic_mapping_read+0x193/0x3f8
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8000cbac>] file_read_actor+0x0/0x154
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff800864bc>] __activate_task+0x27/0x39
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8000c0e3>] __generic_file_aio_read+0x165/0x1bb
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff80016470>] generic_file_aio_read+0x34/0x39
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8000c8f8>] do_sync_read+0xc7/0x104
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff800645d8>] do_page_fault+0x4eb/0x81d
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8009b666>] autoremove_wake_function+0x0/0x2e
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff80039d2a>] tty_ldisc_deref+0x68/0x7b
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8000b212>] vfs_read+0xcb/0x171
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff80012dbe>] sys_pread64+0x50/0x70
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8005b261>] tracesys+0x71/0xdc
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8005b2c1>] tracesys+0xd1/0xdc
>Jul 24 17:37:20 woodcrest kernel:
>Jul 24 17:37:20 woodcrest kernel: CPU6:
>Jul 24 17:37:20 woodcrest kernel:  ffff81042fe2bf48 0000000000000000 ffff81042f799b70 ffffffff801917d0
>Jul 24 17:37:20 woodcrest kernel:  0000000000000000 0000000000000001 0000000000000003 ffffffff801917ff
>Jul 24 17:37:20 woodcrest kernel:  ffffffff8005c330 ffffffff800229ee 000000000001853d 0000000000000000
>Jul 24 17:37:20 woodcrest kernel: Call Trace:
>Jul 24 17:37:20 woodcrest kernel:  <IRQ>  [<ffffffff801917d0>] showacpu+0x0/0x3b
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff801917ff>] showacpu+0x2f/0x3b
>Jul 24 17:37:20 woodcrest kernel:  [<ffffffff8005c330>] call_softirq+0x1c/0x28
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff800229ee>] smp_call_function_interrupt+0x57/0x75
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8005bc56>] call_function_interrupt+0x66/0x6c
>Jul 24 17:37:21 woodcrest kernel:  <EOI>  [<ffffffff8006270c>] .text.lock.spinlock+0x2/0x30
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff80032d73>] page_referenced_file+0x42/0xc3
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff800c178b>] page_referenced_one+0x81/0xd0
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8003b639>] page_referenced+0xcb/0xe4
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff800bd085>] shrink_active_list+0x192/0x426
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff800128f4>] shrink_zone+0xc5/0x108
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff80055aba>] kswapd+0x337/0x45e
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8009b666>] autoremove_wake_function+0x0/0x2e
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8009b4a3>] keventd_create_kthread+0x0/0x61
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff80055783>] kswapd+0x0/0x45e
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8009b4a3>] keventd_create_kthread+0x0/0x61
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8003216e>] kthread+0xfe/0x132
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8005bfe5>] child_rip+0xa/0x11
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8009b4a3>] keventd_create_kthread+0x0/0x61
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff80032070>] kthread+0x0/0x132
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8005bfdb>] child_rip+0x0/0x11
>Jul 24 17:37:21 woodcrest kernel:
>Jul 24 17:37:21 woodcrest kernel: CPU5:
>Jul 24 17:37:21 woodcrest kernel:  ffff81042fdf7f48 0000000000000000 ffff8101ef0c7860 ffffffff801917d0
>Jul 24 17:37:21 woodcrest kernel:  0000000000000000 0000000000000001 0000000000000005 ffffffff801917ff
>Jul 24 17:37:21 woodcrest kernel:  ffffffff8005c330 ffffffff800229ee 00000000000213b8 0000000000000000
>Jul 24 17:37:21 woodcrest kernel: Call Trace:
>Jul 24 17:37:21 woodcrest kernel:  <IRQ>  [<ffffffff801917d0>] showacpu+0x0/0x3b
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff801917ff>] showacpu+0x2f/0x3b
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8005c330>] call_softirq+0x1c/0x28
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff800229ee>] smp_call_function_interrupt+0x57/0x75
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8005bc56>] call_function_interrupt+0x66/0x6c
>Jul 24 17:37:21 woodcrest kernel:  <EOI>  [<ffffffff8006270a>] .text.lock.spinlock+0x0/0x30
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff80032d73>] page_referenced_file+0x42/0xc3
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8003b639>] page_referenced+0xcb/0xe4
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff800bd085>] shrink_active_list+0x192/0x426
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff800128f4>] shrink_zone+0xc5/0x108
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff800be290>] try_to_free_pages+0x163/0x275
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8001e043>] __pollwait+0x0/0xe2
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8000ef9a>] __alloc_pages+0x1b1/0x2b2
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff80016fd3>] cache_grow+0x137/0x395
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff80086c5f>] default_wake_function+0x0/0xe
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8005a564>] cache_alloc_refill+0x136/0x186
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8000a856>] kmem_cache_alloc+0x6c/0x76
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8002dc5c>] __alloc_skb+0x37/0x123
>Jul 24 17:37:21 woodcrest kernel:  [<ffffffff8002584c>] tcp_sendmsg+0x184/0xad1
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80086480>] enqueue_task+0x41/0x56
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80037264>] do_sock_write+0xc4/0xce
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8004543e>] sock_aio_write+0x4f/0x5e
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff800177d2>] do_sync_write+0xc7/0x104
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8009b666>] autoremove_wake_function+0x0/0x2e
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80039d2a>] tty_ldisc_deref+0x68/0x7b
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80016134>] vfs_write+0xe1/0x174
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff800169b2>] sys_write+0x45/0x6e
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8005b2c1>] tracesys+0xd1/0xdc
>Jul 24 17:37:23 woodcrest kernel:
>Jul 24 17:37:23 woodcrest kernel: CPU7:
>Jul 24 17:37:23 woodcrest kernel:  ffff81042fe7ff48 0000000000000000 ffff810127f57a30 ffffffff801917d0
>Jul 24 17:37:23 woodcrest kernel:  0000000000000000 0000000000000001 0000000000000005 ffffffff801917ff
>Jul 24 17:37:23 woodcrest kernel:  ffffffff8005c330 ffffffff800229ee 00000000000206f0 0000000000000000
>Jul 24 17:37:23 woodcrest kernel: Call Trace:
>Jul 24 17:37:23 woodcrest kernel:  <IRQ>  [<ffffffff801917d0>] showacpu+0x0/0x3b
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff801917ff>] showacpu+0x2f/0x3b
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8005c330>] call_softirq+0x1c/0x28
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff800229ee>] smp_call_function_interrupt+0x57/0x75
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8005bc56>] call_function_interrupt+0x66/0x6c
>Jul 24 17:37:23 woodcrest kernel:  <EOI>  [<ffffffff8006270c>] .text.lock.spinlock+0x2/0x30
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80032d73>] page_referenced_file+0x42/0xc3
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8003b639>] page_referenced+0xcb/0xe4
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff800bd085>] shrink_active_list+0x192/0x426
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff800128f4>] shrink_zone+0xc5/0x108
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff800be290>] try_to_free_pages+0x163/0x275
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8000ef9a>] __alloc_pages+0x1b1/0x2b2
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8002b46d>] get_zeroed_page+0x21/0x83
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80015d75>] __pte_alloc+0x1a/0x142
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80008715>] __handle_mm_fault+0x12d/0xdf2
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff800645a5>] do_page_fault+0x4b8/0x81d
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80060ab8>] thread_return+0x0/0xea
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff80039d2a>] tty_ldisc_deref+0x68/0x7b
>Jul 24 17:37:23 woodcrest kernel:  [<ffffffff8005be1d>] error_exit+0x0/0x84
>Jul 24 17:37:23 woodcrest kernel:
>Jul 24 17:37:24 woodcrest kernel: CPU3:
>Jul 24 17:37:24 woodcrest kernel:  ffff81028b685e58 0000000000000000 0000000000000000 0000000000000000
>Jul 24 17:37:24 woodcrest kernel:  ffffffff801917d0 0000000000000000 0000000000000006 ffffffff801917ff
>Jul 24 17:37:24 woodcrest kernel:  0000000000000000 ffffffff8008de84 ffffffff802fcaa0 0000000000000077
>Jul 24 17:37:24 woodcrest kernel: Call Trace:
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff801917d0>] showacpu+0x0/0x3b
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff801917ff>] showacpu+0x2f/0x3b
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff8008de84>] on_each_cpu+0x19/0x22
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff80191705>] __handle_sysrq+0x90/0x121
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff800f6e66>] write_sysrq_trigger+0x2a/0x32
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff80016121>] vfs_write+0xce/0x174
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff800169b2>] sys_write+0x45/0x6e
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff8005b2c1>] tracesys+0xd1/0xdc
>Jul 24 17:37:24 woodcrest kernel:
>Jul 24 17:37:24 woodcrest kernel: CPU1:
>Jul 24 17:37:24 woodcrest kernel:  ffff81042fcebf48 0000000000000000 ffff810115be37f0 ffffffff801917d0
>Jul 24 17:37:24 woodcrest kernel:  0000000000000000 0000000000000000 0000000000000004 ffffffff801917ff
>Jul 24 17:37:24 woodcrest kernel:  ffffffff8005c330 ffffffff800229ee ffff81000eddcb40 ffff8103970fcbc0
>Jul 24 17:37:24 woodcrest kernel: Call Trace:
>Jul 24 17:37:24 woodcrest kernel:  <IRQ>  [<ffffffff801917d0>] showacpu+0x0/0x3b
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff801917ff>] showacpu+0x2f/0x3b
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff8005c330>] call_softirq+0x1c/0x28
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff800229ee>] smp_call_function_interrupt+0x57/0x75
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff8005bc56>] call_function_interrupt+0x66/0x6c
>Jul 24 17:37:24 woodcrest kernel:  <EOI>  [<ffffffff800c161f>] page_check_address+0x79/0x164
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff800c176b>] page_referenced_one+0x61/0xd0
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff80032dc1>] page_referenced_file+0x90/0xc3
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff8003b639>] page_referenced+0xcb/0xe4
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff800bd085>] shrink_active_list+0x192/0x426
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff800128f4>] shrink_zone+0xc5/0x108
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff800be290>] try_to_free_pages+0x163/0x275
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff8001e043>] __pollwait+0x0/0xe2
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff8000ef9a>] __alloc_pages+0x1b1/0x2b2
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff80016fd3>] cache_grow+0x137/0x395
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff80086c5f>] default_wake_function+0x0/0xe
>Jul 24 17:37:24 woodcrest kernel:  [<ffffffff8005a564>] cache_alloc_refill+0x136/0x186
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff8000a856>] kmem_cache_alloc+0x6c/0x76
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff8002dc5c>] __alloc_skb+0x37/0x123
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff8002584c>] tcp_sendmsg+0x184/0xad1
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff80086480>] enqueue_task+0x41/0x56
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff80037264>] do_sock_write+0xc4/0xce
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff8004543e>] sock_aio_write+0x4f/0x5e
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff800177d2>] do_sync_write+0xc7/0x104
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff8009b666>] autoremove_wake_function+0x0/0x2e
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff80039d2a>] tty_ldisc_deref+0x68/0x7b
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff80016134>] vfs_write+0xe1/0x174
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff800169b2>] sys_write+0x45/0x6e
>Jul 24 17:37:25 woodcrest kernel:  [<ffffffff8005b2c1>] tracesys+0xd1/0xdc
>Jul 24 17:37:25 woodcrest kernel:
>Jul 24 17:37:29 woodcrest kernel: SysRq : Show Memory
>Jul 24 17:37:29 woodcrest kernel: Mem-info:
>Jul 24 17:37:29 woodcrest kernel: Node 0 DMA per-cpu:
>Jul 24 17:37:29 woodcrest kernel: cpu 0 hot: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 0 cold: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 1 hot: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 1 cold: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 2 hot: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 2 cold: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 3 hot: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 3 cold: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 4 hot: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 4 cold: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 5 hot: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 5 cold: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 6 hot: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 6 cold: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 7 hot: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: cpu 7 cold: high 0, batch 1 used:0
>Jul 24 17:37:29 woodcrest kernel: Node 0 DMA32 per-cpu:
>Jul 24 17:37:30 woodcrest kernel: cpu 0 hot: high 186, batch 31 used:42
>Jul 24 17:37:30 woodcrest kernel: cpu 0 cold: high 62, batch 15 used:59
>Jul 24 17:37:30 woodcrest kernel: cpu 1 hot: high 186, batch 31 used:14
>Jul 24 17:37:30 woodcrest kernel: cpu 1 cold: high 62, batch 15 used:52
>Jul 24 17:37:30 woodcrest kernel: cpu 2 hot: high 186, batch 31 used:4
>Jul 24 17:37:30 woodcrest kernel: cpu 2 cold: high 62, batch 15 used:47
>Jul 24 17:37:30 woodcrest kernel: cpu 3 hot: high 186, batch 31 used:5
>Jul 24 17:37:30 woodcrest kernel: cpu 3 cold: high 62, batch 15 used:53
>Jul 24 17:37:30 woodcrest kernel: cpu 4 hot: high 186, batch 31 used:30
>Jul 24 17:37:30 woodcrest kernel: cpu 4 cold: high 62, batch 15 used:48
>Jul 24 17:37:30 woodcrest kernel: cpu 5 hot: high 186, batch 31 used:19
>Jul 24 17:37:30 woodcrest kernel: cpu 5 cold: high 62, batch 15 used:49
>Jul 24 17:37:30 woodcrest kernel: cpu 6 hot: high 186, batch 31 used:15
>Jul 24 17:37:30 woodcrest kernel: cpu 6 cold: high 62, batch 15 used:50
>Jul 24 17:37:30 woodcrest kernel: cpu 7 hot: high 186, batch 31 used:17
>Jul 24 17:37:30 woodcrest kernel: cpu 7 cold: high 62, batch 15 used:48
>Jul 24 17:37:30 woodcrest kernel: Node 0 Normal per-cpu:
>Jul 24 17:37:30 woodcrest kernel: cpu 0 hot: high 186, batch 31 used:170
>Jul 24 17:37:30 woodcrest kernel: cpu 0 cold: high 62, batch 15 used:49
>Jul 24 17:37:30 woodcrest kernel: cpu 1 hot: high 186, batch 31 used:5
>Jul 24 17:37:30 woodcrest kernel: cpu 1 cold: high 62, batch 15 used:51
>Jul 24 17:37:30 woodcrest kernel: cpu 2 hot: high 186, batch 31 used:6
>Jul 24 17:37:30 woodcrest kernel: cpu 2 cold: high 62, batch 15 used:56
>Jul 24 17:37:30 woodcrest kernel: cpu 3 hot: high 186, batch 31 used:7
>Jul 24 17:37:30 woodcrest kernel: cpu 3 cold: high 62, batch 15 used:48
>Jul 24 17:37:30 woodcrest kernel: cpu 4 hot: high 186, batch 31 used:4
>Jul 24 17:37:30 woodcrest kernel: cpu 4 cold: high 62, batch 15 used:57
>Jul 24 17:37:30 woodcrest kernel: cpu 5 hot: high 186, batch 31 used:1
>Jul 24 17:37:30 woodcrest kernel: cpu 5 cold: high 62, batch 15 used:61
>Jul 24 17:37:30 woodcrest kernel: cpu 6 hot: high 186, batch 31 used:0
>Jul 24 17:37:30 woodcrest kernel: cpu 6 cold: high 62, batch 15 used:56
>Jul 24 17:37:30 woodcrest kernel: cpu 7 hot: high 186, batch 31 used:4
>Jul 24 17:37:30 woodcrest kernel: cpu 7 cold: high 62, batch 15 used:55
>Jul 24 17:37:30 woodcrest kernel: Node 0 HighMem per-cpu: empty
>Jul 24 17:37:30 woodcrest kernel: Free pages:       81440kB (0kB HighMem)
>Jul 24 17:37:30 woodcrest kernel: Active:2719956 inactive:27752 dirty:36 writeback:73 unstable:0 free:20360 sl
>ab:165960 mapped:176196 pagetables:929638
>Jul 24 17:37:30 woodcrest kernel: Node 0 DMA free:11200kB min:8kB low:8kB high:12kB active:0kB inactive:0kB pr
>esent:10868kB pages_scanned:0 all_unreclaimable? yes
>Jul 24 17:37:30 woodcrest kernel: lowmem_reserve[]: 0 3255 16133 16133
>Jul 24 17:37:30 woodcrest kernel: Node 0 DMA32 free:54924kB min:3276kB low:4092kB high:4912kB active:2001488kB
> inactive:14484kB present:3333728kB pages_scanned:12772 all_unreclaimable? no
>Jul 24 17:37:31 woodcrest kernel: lowmem_reserve[]: 0 0 12877 12877
>Jul 24 17:37:31 woodcrest kernel: Node 0 Normal free:15316kB min:12968kB low:16208kB high:19452kB active:88783
>36kB inactive:96524kB present:13186560kB pages_scanned:40835 all_unreclaimable? no
>Jul 24 17:37:31 woodcrest kernel: lowmem_reserve[]: 0 0 0 0
>Jul 24 17:37:31 woodcrest kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0
>kB present:0kB pages_scanned:0 all_unreclaimable? no
>Jul 24 17:37:31 woodcrest kernel: lowmem_reserve[]: 0 0 0 0
>Jul 24 17:37:31 woodcrest kernel: Node 0 DMA: 2*4kB 3*8kB 2*16kB 2*32kB 5*64kB 0*128kB 2*256kB 0*512kB 2*1024k
>B 0*2048kB 2*4096kB = 11200kB
>Jul 24 17:37:31 woodcrest kernel: Node 0 DMA32: 23*4kB 12*8kB 3*16kB 1*32kB 0*64kB 1*128kB 1*256kB 0*512kB 1*1
>024kB 0*2048kB 13*4096kB = 54924kB
>Jul 24 17:37:31 woodcrest kernel: Node 0 Normal: 415*4kB 67*8kB 12*16kB 6*32kB 3*64kB 0*128kB 1*256kB 0*512kB
>0*1024kB 0*2048kB 3*4096kB = 15316kB
>Jul 24 17:37:31 woodcrest kernel: Node 0 HighMem: empty
>Jul 24 17:37:31 woodcrest kernel: Swap cache: add 32106, delete 25199, find 316/471, race 0+0
>Jul 24 17:37:31 woodcrest kernel: Free swap  = 32645920kB
>Jul 24 17:37:31 woodcrest kernel: Total swap = 32769100kB
>Jul 24 17:37:31 woodcrest kernel: Free swap:       32645920kB
>Jul 24 17:37:31 woodcrest kernel: 4390912 pages of RAM
>Jul 24 17:37:31 woodcrest kernel: 280877 reserved pages
>Jul 24 17:37:31 woodcrest kernel: 20248321 pages shared
>Jul 24 17:37:31 woodcrest kernel: 6796 pages swap cached
>
>
>3) sysinfo
>
>/usr/sbin/sysreport [not included, needed?]
>
>

Actions: View

Attachments on bug 250155: 160264 | 160270 | 160315 | 160920 | 176881 | 176901 | 176921 | 176941 | 176961 | 176981 | 210711