Attachment 210711 Details for Bug 250155 – Some more oprofile data form Fima

Some more oprofile data form Fima

Tigerton9 oprofile Shak Down Try.txt (text/plain), 11.15 KB, created by Vijay Trehan on 2007-09-28 17:18:52 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Vijay Trehan

Created: 2007-09-28 17:18:52 UTC

Size: 11.15 KB

patch

obsolete

>
>Yefim Somin wrote on 09-28-2007:
>>
>> I have finally been able to revamp my environment under the new
>> restrictions. I then collected some more profiling data (see attached).
>> The detailed __down report is at the end. It seems tantalizingly useful,
>> but displays no symbols. Given that I get symbols for other reports, I
>> wonder if something else needs to be done to have symbols for __down
>> report or this can already be utilized somehow. As you can see I saved
>> the profiling cession, which I assume to mean that I could extract more
>> data from it later, although I have not seen a specification of how to
>> do it in the man pages.
>>
>> I have looked at the description of library wrappers, and it seems it
>> may be hard to implement in our case. Our processes get initiated
>> through a telnet remote emulator login by setting up a cession with the
>> database. There are thousands of processes and it may be quite some time
>> into the run before the situation is right for a useful breakpoint in
>> one of them. I am not sure how this could be organized.
>>
>> I will be away overseas starting tomorrow 9/28 and back 10/9.
>>
>> Regards,
>> Fima
>=========================================================================
>
>
>
>opcontrol --setup --vmlinux=/usr/lib/debug/lib/modules/`uname -r`/vmlinux --separate=library; opcontrol --start; sleep 20; opcontrol --stop; opcontrol --dump; opcontrol --shutdown; opreport | head -40; opreport -l | head -40; opreport -l /usr/lib/debug/lib/modules/`uname -r`/vmlinux | head -40
>
>
>
>opcontrol --setup --vmlinux=/usr/lib/debug/lib/modules/`uname -r`/vmlinux --separate=library; opcontrol --start; sleep 20; opcontrol --stop; opcontrol --dump; opreport | head -40; opreport -l | head -40; opreport -l /usr/lib/debug/lib/modules/`uname -r`/vmlinux | head -40
>
>
>opreport --details --include-symbols __down /usr/lib/debug/lib/modules/2.6.18-8.el5/vmlinux
>
>
>[root@tigerton9 oprof-dir]# opcontrol --save=opsession4000-v2
>Signalling daemon... done
>
>
>
>[root@tigerton9 oprof-dir]# opcontrol --setup --vmlinux=/usr/lib/debug/lib/modules/`uname -r`/vmlinux --separate=library; opcontrol --start; sleep 20; opcontrol --stop; opcontrol --dump; opcontrol --shutdown; opreport | head -40; opreport -l | head -40; opreport -l /usr/lib/debug/lib/modules/`uname -r`/vmlinux | head -40
>Using default event: CPU_CLK_UNHALTED:100000:0:1:1
>Using 2.6+ OProfile kernel interface.
>Reading module info.
>Using log file /var/lib/oprofile/oprofiled.log
>Daemon started.
>Profiler running.
>Stopping profiling.
>Stopping profiling.
>Killing daemon.
>CPU: Core 2, speed 2937 MHz (estimated)
>Counted CPU_CLK_UNHALTED events (Clock cycles when not halted) with a unit mask of 0x00 (Unhalted core cycles) count 100000
>CPU_CLK_UNHALT...|
>  samples|      %|
>------------------
>  6751276 58.9631 cache
>        CPU_CLK_UNHALT...|
>          samples|      %|
>        ------------------
>          6378647 94.4806 cache
>           371270  5.4993 libc-2.5.so
>              833  0.0123 ld-2.5.so
>              501  0.0074 libpthread-2.5.so
>                8 1.2e-04 libresolv-2.5.so
>                7 1.0e-04 libnss_files-2.5.so
>                5 7.4e-05 libnsl-2.5.so
>                3 4.4e-05 libnss_dns-2.5.so
>                1 1.5e-05 libdl-2.5.so
>                1 1.5e-05 libm-2.5.so
>  4215872 36.8199 vmlinux
>   139310  1.2167 oprofile
>   127509  1.1136 in.telnetd
>        CPU_CLK_UNHALT...|
>          samples|      %|
>        ------------------
>            73955 57.9998 in.telnetd
>            53190 41.7147 libc-2.5.so
>              248  0.1945 ld-2.5.so
>              109  0.0855 libresolv-2.5.so
>                3  0.0024 libnss_files-2.5.so
>                3  0.0024 libutil-2.5.so
>                1 7.8e-04 libnss_dns-2.5.so
>    58019  0.5067 oprofiled
>        CPU_CLK_UNHALT...|
>          samples|      %|
>        ------------------
>            57534 99.1641 oprofiled
>              485  0.8359 libc-2.5.so
>    44843  0.3916 e1000
>    27498  0.2402 jbd
>warning: /autofs4 could not be found.
>warning: /cdrom could not be found.
>warning: /cpufreq_ondemand could not be found.
>warning: /dm_mod could not be found.
>warning: /e1000 could not be found.
>warning: /ehci_hcd could not be found.
>warning: /ext3 could not be found.
>warning: /ide_cd could not be found.
>warning: /ipv6 could not be found.
>warning: /jbd could not be found.
>warning: /megaraid_sas could not be found.
>warning: /nfs could not be found.
>warning: /oprofile could not be found.
>warning: /scsi_mod could not be found.
>warning: /sd_mod could not be found.
>warning: /sunrpc could not be found.
>warning: /uhci_hcd could not be found.
>CPU: Core 2, speed 2937 MHz (estimated)
>Counted CPU_CLK_UNHALTED events (Clock cycles when not halted) with a unit mask of 0x00 (Unhalted core cycles) count 100000
>samples  %        image name               app name                 symbol name
>1524772  13.3170  vmlinux                  vmlinux                  __down
>586631    5.1235  vmlinux                  vmlinux                  schedule
>404977    3.5370  cache                    cache                    lost_find_exact
>295082    2.5772  cache                    cache                    mcominit
>293262    2.5613  cache                    cache                    ncfast
>286626    2.5033  cache                    cache                    symaddb
>260270    2.2731  cache                    cache                    zu96fun
>257533    2.2492  vmlinux                  vmlinux                  __wake_up
>196140    1.7130  libc-2.5.so              cache                    memcpy
>147869    1.2914  cache                    cache                    compileFCorrelative
>146245    1.2773  cache                    cache                    gsearch4k
>139310    1.2167  oprofile                 oprofile                 (no symbols)
>136352    1.1909  vmlinux                  vmlinux                  thread_return
>116276    1.0155  cache                    cache                    ex2cnul
>104315    0.9111  vmlinux                  vmlinux                  try_to_wake_up
>103868    0.9072  vmlinux                  vmlinux                  copy_user_generic
>102956    0.8992  cache                    cache                    DISPATCH
>97893     0.8550  cache                    cache                    dsmnxtreq
>95792     0.8366  cache                    cache                    Ccbless
>88320     0.7714  cache                    cache                    gformat
>86762     0.7578  cache                    cache                    ismj
>84474     0.7378  vmlinux                  vmlinux                  mwait_idle
>74424     0.6500  cache                    cache                    zu167fun
>73955     0.6459  in.telnetd               in.telnetd               (no symbols)
>71204     0.6219  cache                    cache                    lp13
>68131     0.5950  vmlinux                  vmlinux                  system_call
>65476     0.5718  cache                    cache                    LocToUTC
>63498     0.5546  cache                    cache                    zucharwin
>62870     0.5491  cache                    cache                    cnsresqrelease
>62455     0.5455  cache                    cache                    setupfasterr
>60869     0.5316  cache                    cache                    revstr
>60608     0.5293  cache                    cache                    syslock_lock
>57980     0.5064  cache                    cache                    budget
>57534     0.5025  oprofiled                oprofiled                (no symbols)
>57500     0.5022  cache                    cache                    istaget
>56836     0.4964  cache                    cache                    Cbol
>56785     0.4959  cache                    cache                    cnssznotmine
>CPU: Core 2, speed 2136 MHz (estimated)
>Counted CPU_CLK_UNHALTED events (Clock cycles when not halted) with a unit mask of 0x00 (Unhalted core cycles) count 100000
>samples  %        symbol name
>1524772  36.1674  __down
>586631   13.9148  schedule
>257533    6.1087  __wake_up
>136352    3.2343  thread_return
>104315    2.4743  try_to_wake_up
>103868    2.4637  copy_user_generic
>84474     2.0037  mwait_idle
>68131     1.6161  system_call
>49468     1.1734  tty_ldisc_try
>42659     1.0119  find_first_bit
>40361     0.9574  __switch_to
>37154     0.8813  write_chan
>36253     0.8599  do_select
>35863     0.8507  find_next_bit
>28502     0.6761  get_task_mm
>28218     0.6693  tty_write
>26421     0.6267  read_chan
>24250     0.5752  n_tty_receive_buf
>22681     0.5380  dnotify_parent
>20496     0.4862  kmem_cache_free
>20277     0.4810  fget_light
>20263     0.4806  tty_ldisc_deref
>19645     0.4660  n_tty_chars_in_buffer
>19129     0.4537  remove_wait_queue
>18571     0.4405  tcp_sendmsg
>17896     0.4245  page_fault
>17088     0.4053  tcp_poll
>16606     0.3939  tcp_v4_rcv
>16366     0.3882  reschedule_interrupt
>15459     0.3667  __handle_mm_fault
>15391     0.3651  copy_from_read_buf
>15200     0.3605  posix_same_owner
>15054     0.3571  rw_verify_area
>14426     0.3422  tty_read
>14222     0.3373  add_wait_queue
>13847     0.3284  apic_timer_interrupt
>13709     0.3252  __up_read
>[root@tigerton9 oprof-dir]#
>[root@tigerton9 oprof-dir]#
>[root@tigerton9 oprof-dir]# opreport --details --include-symbols __down /usr/lib/debug/lib/modules/2.6.18-8.el5/vmlinux
>CPU: Core 2, speed 2136 MHz (estimated)
>Counted CPU_CLK_UNHALTED events (Clock cycles when not halted) with a unit mask of 0x00 (Unhalted core cycles) count 100000
>vma      samples  %        symbol name
>ffffffff80062481 1524772  100.000  __down
>  ffffffff80062481 103       0.0068
>  ffffffff80062483 42        0.0028
>  ffffffff80062485 6        3.9e-04
>  ffffffff80062486 3        2.0e-04
>  ffffffff80062487 37        0.0024
>  ffffffff80062497 141       0.0092
>  ffffffff80062498 58        0.0038
>  ffffffff8006249a 44        0.0029
>  ffffffff800624a2 511       0.0335
>  ffffffff800624a4 212       0.0139
>  ffffffff800624ad 79        0.0052
>  ffffffff800624b6 35        0.0023
>  ffffffff800624be 55        0.0036
>  ffffffff800624c1 8        5.2e-04
>  ffffffff800624c6 429466   28.1659
>  ffffffff800624ca 311       0.0204
>  ffffffff800624ce 207       0.0136
>  ffffffff800624da 1128      0.0740
>  ffffffff800624df 61        0.0040
>  ffffffff800624e2 7688      0.5042
>  ffffffff800624e5 2103      0.1379
>  ffffffff800624e7 39        0.0026
>  ffffffff800624ea 81195     5.3251
>  ffffffff800624ed 7        4.6e-04
>  ffffffff800624f6 223       0.0146
>  ffffffff800624fd 109       0.0071
>  ffffffff80062502 81        0.0053
>  ffffffff8006250f 105       0.0069
>  ffffffff80062512 317       0.0208
>  ffffffff80062515 22        0.0014
>  ffffffff8006251a 1288      0.0845
>  ffffffff80062522 534       0.0350
>  ffffffff80062527 1570      0.1030
>  ffffffff80062528 59        0.0039
>  ffffffff8006252a 1284      0.0842
>  ffffffff8006252c 51        0.0033
>  ffffffff8006252d 85        0.0056
>  ffffffff80062530 145       0.0095
>  ffffffff80062533 21        0.0014
>  ffffffff8006253a 91        0.0060
>  ffffffff8006253f 7639      0.5010
>  ffffffff80062544 1958      0.1284
>  ffffffff80062547 1160      0.0761
>  ffffffff8006254c 984012   64.5350
>  ffffffff8006254f 289       0.0190
>  ffffffff80062557 190       0.0125
>
>
>
>
>
>

Actions: View

Attachments on bug 250155: 160264 | 160270 | 160315 | 160920 | 176881 | 176901 | 176921 | 176941 | 176961 | 176981 | 210711