Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 582133

Summary: qpid c++ client library abort in ~ConnectionImpl when authenticating SASL PLAIN
Product: Red Hat Enterprise MRG Reporter: Frantisek Reznicek <freznice>
Component: qpid-cppAssignee: messaging-bugs <messaging-bugs>
Status: CLOSED DUPLICATE QA Contact: MRG Quality Engineering <mrgqe-bugs>
Severity: high Docs Contact:
Priority: high    
Version: DevelopmentCC: esammons, gsim
Target Milestone: 1.3   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2010-04-15 21:57:11 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Frantisek Reznicek 2010-04-14 08:27:59 UTC
Description of problem:

There are observed aborts when c++ client (perftest,qc_client) runs against broker with SASL PLAIN authentication enabled:

  (gdb)   2 process 28884  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  * 1 process 28881  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  Thread 2 (process 28884):
  #0  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  #1  0x00bb862e in epoll_wait () from /lib/tls/libc.so.6
  #2  0x00420b40 in qpid::sys::Poller::wait (this=0x9189898, timeout=
        {nanosecs = 9223372036854775807}) at qpid/sys/epoll/EpollPoller.cpp:524
  #3  0x00421edc in qpid::sys::Poller::run (this=0x9189898)
      at qpid/sys/epoll/EpollPoller.cpp:479
  #4  0x00413c21 in qpid::sys::(anonymous namespace)::runRunnable (p=0xfffffffc)
      at qpid/sys/posix/Thread.cpp:35
  #5  0x00d515cc in start_thread () from /lib/tls/libpthread.so.0
  #6  0x00bb7fae in clone () from /lib/tls/libc.so.6
  Thread 1 (process 28881):
  #0  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  #1  0x00b138c5 in raise () from /lib/tls/libc.so.6
  #2  0x00b15329 in abort () from /lib/tls/libc.so.6
  #3  0x0079993d in ~ConnectionImpl (this=0x91890d8)
      at ../include/qpid/sys/posix/Mutex.h:112
  #4  0x0078835e in boost::detail::sp_counted_impl_pd<qpid::client::ConnectionImpl*, boost::checked_deleter<qpid::client::ConnectionImpl> >::dispose (this=0x0)
      at /usr/include/boost/checked_delete.hpp:34
  #5  0x00784c4e in ~Connection (this=0xbffa1c78)
      at ./boost/detail/sp_counted_base_gcc_x86.hpp:145
  #6  0x0805454c in Client (this=0xbffa1c70)
      at ../../include/qpid/client/AsyncSession_0_10.h:553
  #7  0x08050215 in main (argc=13, argv=0xbffa1d94) at perftest.cpp:694
  #8  0x00b00e93 in __libc_start_main () from /lib/tls/libc.so.6
  #9  0x0804f271 in _start ()



Version-Release number of selected component (if applicable):
cyrus-sasl-2.1.19-14
cyrus-sasl-2.1.19-14
cyrus-sasl-devel-2.1.19-14
cyrus-sasl-gssapi-2.1.19-14
cyrus-sasl-gssapi-2.1.19-14
cyrus-sasl-md5-2.1.19-14
cyrus-sasl-md5-2.1.19-14
cyrus-sasl-ntlm-2.1.19-14
cyrus-sasl-plain-2.1.19-14
cyrus-sasl-plain-2.1.19-14
cyrus-sasl-sql-2.1.19-14
python-qmf-0.7.930108-1.el4
python-qpid-0.7.930108-1.el4
qmf-0.7.929717-1.el4
qmf-devel-0.7.929717-1.el4
qpid-cpp-client-0.7.929717-1.el4
qpid-cpp-client-devel-0.7.929717-1.el4
qpid-cpp-client-devel-docs-0.7.929717-1.el4
qpid-cpp-client-ssl-0.7.929717-1.el4
qpid-cpp-mrg-debuginfo-0.7.929717-1.el4
qpid-cpp-server-0.7.929717-1.el4
qpid-cpp-server-devel-0.7.929717-1.el4
qpid-cpp-server-ssl-0.7.929717-1.el4
qpid-cpp-server-store-0.7.929717-1.el4
qpid-cpp-server-xml-0.7.929717-1.el4
qpid-java-client-0.7.918215-1.el4
qpid-java-common-0.7.918215-1.el4
qpid-tools-0.7.930108-1.el4


How reproducible:
>40%

Steps to Reproduce:
1. set-up SASL PLAIN authentication
2. start broker with --auth yes
3. run perftest client
   perftest --mechanism PLAIN --count 1 -p 40763 \
   --password <pass-id>  --broker 127.0.0.1 --user <user-id>
4. repeat 3 in loop for valid|invalid user-id and valid/invalid pass-id
Actual results:
C++ client aborts.


Expected results:
C++ client should not abort


Additional info:

rhel 4.8 i386

[03:16:24] Core file: core.28881 generated by perftest ----------------------3/4-
core.28881: ELF 32-bit LSB core file Intel 80386, version 1 (SYSV), SVR4-style, from 'perftest'
  GNU gdb Red Hat Linux (6.3.0.0-1.162.el4rh)
  Copyright 2004 Free Software Foundation, Inc.
  GDB is free software, covered by the GNU General Public License, and you are
  welcome to change it and/or distribute copies of it under certain conditions.
  Type "show copying" to see the conditions.
  There is absolutely no warranty for GDB.  Type "show warranty" for details.
  This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1".
  Core was generated by `perftest --mechanism PLAIN --count 1 -p 39234 --password _I_XESkuW5N_I_ --broke'.
  Program terminated with signal 6, Aborted.
  #0  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  (gdb) eax            0x0      0
  ecx            0x70d1 28881
  edx            0x6    6
  ebx            0x70d1 28881
  esp            0xbffa18c4     0xbffa18c4
  ebp            0xbffa18d8     0xbffa18d8
  esi            0x70d1 28881
  edi            0xc17ff4       12681204
  eip            0xad27a2       0xad27a2
  eflags         0x206  518
  cs             0x73   115
  ss             0x7b   123
  ds             0x7b   123
  es             0x7b   123
  fs             0x0    0
  gs             0x33   51
  st0            0      (raw 0x00000000000000000000)
  st1            0      (raw 0x00000000000000000000)
  st2            0      (raw 0x00000000000000000000)
  st3            0      (raw 0x00000000000000000000)
  st4            0      (raw 0x00000000000000000000)
  st5            0      (raw 0x00000000000000000000)
  st6            0      (raw 0x00000000000000000000)
  st7            0      (raw 0x00000000000000000000)
  fctrl          0x0    0
  fstat          0x0    0
  ftag           0x0    0
  fiseg          0x0    0
  fioff          0x0    0
  foseg          0x0    0
  fooff          0x0    0
  fop            0x0    0
  (gdb) There are no memory regions defined.
  (gdb) From        To          Syms Read   Shared Object Library
  0x0076f810  0x00874fbc  Yes         /usr/lib/libqpidclient.so.2
  0x003f8320  0x005315cc  Yes         /usr/lib/libqpidcommon.so.2
  0x00c60214  0x00c831fc  Yes         /usr/lib/libboost_program_options.so.1
  0x00c91b8c  0x00c99a70  Yes         /usr/lib/libboost_filesystem.so.1
  0x00a650d0  0x00a6a66c  Yes         /lib/tls/librt.so.1
  0x00a4f060  0x00a5d500  Yes         /usr/lib/libsasl2.so.2
  0x00c43bb0  0x00c448c4  Yes         /lib/libdl.so.2
  0x002343f0  0x0023fecc  Yes         /lib/libresolv.so.2
  0x02c368d0  0x02c3c400  Yes         /lib/libcrypt.so.1
  0x00c4a020  0x00c4b7b4  Yes         /lib/tls/libuuid.so.1
  0x00668c30  0x006d1188  Yes         /usr/lib/libstdc++.so.6
  0x00c21300  0x00c3a5a4  Yes         /lib/tls/libm.so.6
  0x002e47e8  0x002eb12c  Yes         /lib/libgcc_s.so.1
  0x00b00c70  0x00bf6f70  Yes         /lib/tls/libc.so.6
  0x00d502d0  0x00d58ab8  Yes         /lib/tls/libpthread.so.0
  0x00ad27a0  0x00ae4caf  Yes         /lib/ld-linux.so.2
  0x00e748f0  0x00e85e84  Yes         /usr/lib/qpid/client/sslconnector.so
  0x0011c380  0x00136a88  Yes         /usr/lib/libsslcommon.so.2
  0x02fe68b0  0x030c6f0c  Yes         /usr/lib/libnss3.so
  0x02d79ac0  0x02d9d91c  Yes         /usr/lib/libssl3.so
  0x02d49cd0  0x02d6a7b0  Yes         /usr/lib/libnspr4.so
  0x02da8d30  0x02db373c  Yes         /usr/lib/libnssutil3.so
  0x0013cf70  0x0013e84c  Yes         /usr/lib/libplc4.so
  0x00140b88  0x0014197c  Yes         /usr/lib/libplds4.so
  0x00d3b5b0  0x00d44abc  Yes         /usr/lib/libz.so.1
  0x00144250  0x001476e0  Yes         /usr/lib/sasl2/libsql.so.2
  0x008bd290  0x008e8b0c  Yes         /usr/lib/mysql/libmysqlclient.so.14
  0x0014e7c0  0x0015fa68  Yes         /usr/lib/libpq.so.3
  0x001678d0  0x00175208  Yes         /lib/libnsl.so.1
  0x00184840  0x001a7dfc  Yes         /lib/libssl.so.4
  0x00d88bc0  0x00e1bbec  Yes         /lib/libcrypto.so.4
  0x001bf860  0x0020df04  Yes         /usr/lib/libkrb5.so.3
  0x002158ec  0x00215fcc  Yes         /lib/libcom_err.so.2
  0x0021ccd0  0x0022a364  Yes         /usr/lib/libgssapi_krb5.so.2
  0x00248260  0x0025d068  Yes         /usr/lib/libk5crypto.so.3
  0x0022cc00  0x0022eaa0  Yes         /usr/lib/sasl2/libplain.so.2
  0x00e9fa60  0x00f3aeb0  Yes         /usr/lib/sasl2/libsasldb.so.2
  0x00606bf0  0x006089e0  Yes         /usr/lib/sasl2/liblogin.so.2
  0x002671f0  0x0026f140  Yes         /usr/lib/sasl2/libdigestmd5.so.2
  0x00272cb0  0x00275150  Yes         /usr/lib/sasl2/libcrammd5.so.2
  0x002781c0  0x0027c850  Yes         /usr/lib/sasl2/libgssapiv2.so.2
  0x0027f130  0x00284040  Yes         /usr/lib/sasl2/libntlm.so.2
  0x00286c00  0x00288900  Yes         /usr/lib/sasl2/libanonymous.so.2
  (gdb)   2 process 28884  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  * 1 process 28881  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  Thread 2 (process 28884):
  #0  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  #1  0x00bb862e in epoll_wait () from /lib/tls/libc.so.6
  #2  0x00420b40 in qpid::sys::Poller::wait (this=0x9189898, timeout=
        {nanosecs = 9223372036854775807}) at qpid/sys/epoll/EpollPoller.cpp:524
  #3  0x00421edc in qpid::sys::Poller::run (this=0x9189898)
      at qpid/sys/epoll/EpollPoller.cpp:479
  #4  0x00413c21 in qpid::sys::(anonymous namespace)::runRunnable (p=0xfffffffc)
      at qpid/sys/posix/Thread.cpp:35
  #5  0x00d515cc in start_thread () from /lib/tls/libpthread.so.0
  #6  0x00bb7fae in clone () from /lib/tls/libc.so.6
  Thread 1 (process 28881):
  #0  0x00ad27a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
  #1  0x00b138c5 in raise () from /lib/tls/libc.so.6
  #2  0x00b15329 in abort () from /lib/tls/libc.so.6
  #3  0x0079993d in ~ConnectionImpl (this=0x91890d8)
      at ../include/qpid/sys/posix/Mutex.h:112
  #4  0x0078835e in boost::detail::sp_counted_impl_pd<qpid::client::ConnectionImpl*, boost::checked_deleter<qpid::client::ConnectionImpl> >::dispose (this=0x0)
      at /usr/include/boost/checked_delete.hpp:34
  #5  0x00784c4e in ~Connection (this=0xbffa1c78)
      at ./boost/detail/sp_counted_base_gcc_x86.hpp:145
  #6  0x0805454c in Client (this=0xbffa1c70)
      at ../../include/qpid/client/AsyncSession_0_10.h:553
  #7  0x08050215 in main (argc=13, argv=0xbffa1d94) at perftest.cpp:694
  #8  0x00b00e93 in __libc_start_main () from /lib/tls/libc.so.6
  #9  0x0804f271 in _start ()

rhel 4.8 x86_64

[03:17:14] Core file: core.23437 generated by /root/MRG/Messaging/qpid_common/clients/c++/qc_client ----------------------1/66-
core.23437: ELF 64-bit LSB core file AMD x86-64, version 1 (SYSV), SVR4-style, from 'qc_client'
  GNU gdb Red Hat Linux (6.3.0.0-1.162.el4rh)
  Copyright 2004 Free Software Foundation, Inc.
  GDB is free software, covered by the GNU General Public License, and you are
  welcome to change it and/or distribute copies of it under certain conditions.
  Type "show copying" to see the conditions.
  There is absolutely no warranty for GDB.  Type "show warranty" for details.
  This GDB was configured as "x86_64-redhat-linux-gnu"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
  Core was generated by `/root/MRG/Messaging/qpid_common/clients/c++/qc_client -p 14851 --password EzltD'.
  Program terminated with signal 6, Aborted.
  #0  0x0000003f3002e32d in raise () from /lib64/tls/libc.so.6
  (gdb) rax            0x0      0
  rbx            0x52fd28       5438760
  rcx            0xffffffffffffffff     -1
  rdx            0x6    6
  rsi            0x5b8d 23437
  rdi            0x5b8d 23437
  rbp            0x2a95820640   0x2a95820640
  rsp            0x7fbfffedd8   0x7fbfffedd8
  r8             0x6    6
  r9             0x5b8d 23437
  r10            0x8    8
  r11            0x206  518
  r12            0x5301c0       5439936
  r13            0x10   16
  r14            0x0    0
  r15            0x0    0
  rip            0x3f3002e32d   0x3f3002e32d <raise+61>
  eflags         0x206  518
  cs             0x33   51
  ss             0x2b   43
  ds             0x0    0
  es             0x0    0
  fs             0x0    0
  gs             0x0    0
  st0            0      (raw 0x00000000000000000000)
  st1            0      (raw 0x00000000000000000000)
  st2            0      (raw 0x00000000000000000000)
  st3            0      (raw 0x00000000000000000000)
  st4            0      (raw 0x00000000000000000000)
  st5            0      (raw 0x00000000000000000000)
  st6            0      (raw 0x00000000000000000000)
  st7            0      (raw 0x00000000000000000000)
  fctrl          0x0    0
  fstat          0x0    0
  ftag           0x0    0
  fiseg          0x0    0
  fioff          0x0    0
  foseg          0x0    0
  fooff          0x0    0
  fop            0x0    0
  (gdb) There are no memory regions defined.
  (gdb) From                To                  Syms Read   Shared Object Library
  0x0000002a9559bb60  0x0000002a955e48d8  Yes         /usr/lib64/libboost_regex.so.1
  0x0000002a95707eb0  0x0000002a95713938  Yes         /usr/lib64/libboost_thread.so.1
  0x0000003f3138f8f0  0x0000003f31478788  Yes         /usr/lib64/libqpidclient.so.2
  0x0000003f3444d090  0x0000003f344b5498  Yes         /usr/lib64/libstdc++.so.6
  0x0000003f30303df0  0x0000003f30346b98  Yes         /lib64/tls/libm.so.6
  0x0000003f34202060  0x0000003f3420ab08  Yes         /lib64/libgcc_s.so.1
  0x0000003f3001c2d0  0x0000003f300fe2ac  Yes         /lib64/tls/libc.so.6
  0x0000003f310476b0  0x0000003f311652e8  Yes         /usr/lib64/libqpidcommon.so.2
  0x0000003f30914160  0x0000003f30935e68  Yes         /usr/lib64/libboost_program_options.so.1
  0x0000003f35c02c90  0x0000003f35c07b38  Yes         /lib64/tls/librt.so.1
  0x0000003f30d05100  0x0000003f30d0d228  Yes         /lib64/tls/libpthread.so.0
  0x0000003f30701670  0x0000003f307028c8  Yes         /lib64/tls/libuuid.so.1
  0x0000003f2fe00a80  0x0000003f2fe10de7  Yes         /lib64/ld-linux-x86-64.so.2
  0x0000003f30b05cc0  0x0000003f30b0d7a8  Yes         /usr/lib64/libboost_filesystem.so.1
  0x0000003f30500f80  0x0000003f30501918  Yes         /lib64/libdl.so.2
  0x0000003f37c044f0  0x0000003f37c11ec8  Yes         /usr/lib64/libsasl2.so.2
  0x0000003f331036a0  0x0000003f3310ee28  Yes         /lib64/libresolv.so.2
  0x0000003f37800bf0  0x0000003f37805668  Yes         /lib64/libcrypt.so.1
  0x0000002a9582be60  0x0000002a9583b158  Yes         /usr/lib64/qpid/client/sslconnector.so
  0x0000002a95970490  0x0000002a95987e58  Yes         /usr/lib64/libsslcommon.so.2
  0x0000003f38418d50  0x0000003f384fed38  Yes         /usr/lib64/libnss3.so
  0x0000003f39108ca0  0x0000003f3912c018  Yes         /usr/lib64/libssl3.so
  0x0000003f37e0d4f0  0x0000003f37e2bec8  Yes         /usr/lib64/libnspr4.so
  0x0000003f393085f0  0x0000003f39312c08  Yes         /usr/lib64/libnssutil3.so
  0x0000003f382015d0  0x0000003f38202cb8  Yes         /usr/lib64/libplc4.so
  0x0000003f38001010  0x0000003f38001e68  Yes         /usr/lib64/libplds4.so
  0x0000002a95a90f20  0x0000002a95a9a278  Yes         /usr/lib64/libz.so.1
  0x0000002a95ba4290  0x0000002a95bab008  Yes         /lib64/libnss_files.so.2
  0x0000002a95caf0e0  0x0000002a95cb0e28  Yes         /usr/lib64/sasl2/libplain.so.2
  0x0000002a95db3b00  0x0000002a95dbaf18  Yes         /usr/lib64/sasl2/libdigestmd5.so.2
  0x0000003f3574c9d0  0x0000003f357d7468  Yes         /lib64/libcrypto.so.4
  0x0000003f351069e0  0x0000003f35112b08  Yes         /usr/lib64/libgssapi_krb5.so.2
  0x0000003f35316de0  0x0000003f3535efc8  Yes         /usr/lib64/libkrb5.so.3
  0x0000003f34a00cd0  0x0000003f34a013b8  Yes         /lib64/libcom_err.so.2
  0x0000003f35505140  0x0000003f35517bc8  Yes         /usr/lib64/libk5crypto.so.3
  0x0000002a95ebe0d0  0x0000002a95ebfd98  Yes         /usr/lib64/sasl2/liblogin.so.2
  0x0000002a95fdd590  0x0000002a9606dfa8  Yes         /usr/lib64/sasl2/libsasldb.so.2
  0x0000002a9618c1e0  0x0000002a9618e478  Yes         /usr/lib64/sasl2/libcrammd5.so.2
  0x0000002a962918f0  0x0000002a96295888  Yes         /usr/lib64/sasl2/libgssapiv2.so.2
  0x0000002a963980e0  0x0000002a96399c78  Yes         /usr/lib64/sasl2/libanonymous.so.2
  (gdb)   2 process 23440  0x0000003f300ca39c in epoll_wait ()
     from /lib64/tls/libc.so.6
  * 1 process 23437  0x0000003f3002e32d in raise () from /lib64/tls/libc.so.6
  Thread 2 (process 23440):
  #0  0x0000003f300ca39c in epoll_wait () from /lib64/tls/libc.so.6
  #1  0x0000003f3106afa9 in qpid::sys::Poller::wait (this=0x52f590, timeout=Variable "timeout" is not available.
      at qpid/sys/epoll/EpollPoller.cpp:524
  #2  0x0000003f3106be06 in qpid::sys::Poller::run (this=0x52f590)
      at qpid/sys/epoll/EpollPoller.cpp:479
  #3  0x0000003f3105ff5a in qpid::sys::(anonymous namespace)::runRunnable (p=0x8)
      at qpid/sys/posix/Thread.cpp:35
  #4  0x0000003f30d06317 in start_thread () from /lib64/tls/libpthread.so.0
  #5  0x0000003f300c9fc3 in clone () from /lib64/tls/libc.so.6
  Thread 1 (process 23437):
  #0  0x0000003f3002e32d in raise () from /lib64/tls/libc.so.6
  #1  0x0000003f3002fb2e in abort () from /lib64/tls/libc.so.6
  #2  0x0000003f313b8bbe in ~ConnectionImpl (this=0x52f9a0)
      at ../include/qpid/sys/posix/Mutex.h:112
  #3  0x0000003f313a5c8c in ~Connection (this=0x5301c0)
      at ./boost/detail/sp_counted_base_gcc_x86.hpp:145
  #4  0x000000000040c9b9 in qc_lib::qc_client<qc_lib::qc_optparser_client>::data_dealloc_sess_conn (this=0x7fbffff080) at qc_client.hpp:295
  #5  0x000000000040af23 in qc_lib::qc_client<qc_lib::qc_optparser_client>::data_dealloc (this=0x7fbffff080) at qc_client.hpp:269
  #6  0x0000000000408adc in ~qc_client (this=0x7fbffff080) at qc_client.hpp:234
  #7  0x0000000000406399 in main (argc=11, argv=0x7fbffff3e8) at qc_client.cpp:82

Comment 1 Frantisek Reznicek 2010-04-14 08:31:05 UTC
Similar abort on RHEL5.5, I'm not sure this abort is relevant to bug 582133 (current one) or bug 580824.

core.6115: ELF 32-bit LSB core file Intel 80386, version 1 (SYSV), SVR4-style, from 'qc_client'
  GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-23.el5)
  Copyright (C) 2009 Free Software Foundation, Inc.
  License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
  This is free software: you are free to change and redistribute it.
  There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
  and "show warranty" for details.
  This GDB was configured as "i386-redhat-linux-gnu".
  For bug reporting instructions, please see:
  [New Thread 6117]
  warning: .dynamic section for "/lib/libm.so.6" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/lib/libpthread.so.0" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/lib/libdl.so.2" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/lib/libresolv.so.2" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/usr/lib/libz.so.1" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/usr/lib/libgssapi_krb5.so.2" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/usr/lib/libk5crypto.so.3" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/usr/lib/libkrb5support.so.0" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/lib/libselinux.so.1" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  warning: .dynamic section for "/lib/libsepol.so.1" is not at the expected address
  warning: difference appears to be caused by prelink, adjusting expectations
  Core was generated by `/root/MRG/Messaging/qpid_common/clients/c++/qc_client -p 28486 --password HT6RE'.
  Program terminated with signal 6, Aborted.
  #0  0x00ee5410 in __kernel_vsyscall ()
  (gdb) eax            0x0      0
  ecx            0x17e3 6115
  edx            0x6    6
  ebx            0x17e3 6115
  esp            0xbf8718c4     0xbf8718c4
  ebp            0xbf8718dc     0xbf8718dc
  esi            0xbf87197c     -1081665156
  edi            0x66dff4       6742004
  eip            0xee5410       0xee5410 <__kernel_vsyscall+16>
  eflags         0x202  [ IF ]
  cs             0x73   115
  ss             0x7b   123
  ds             0x7b   123
  es             0x7b   123
  fs             0x0    0
  gs             0x33   51
  st0            0      (raw 0x00000000000000000000)
  st1            0      (raw 0x00000000000000000000)
  st2            0      (raw 0x00000000000000000000)
  st3            0      (raw 0x00000000000000000000)
  st4            0      (raw 0x00000000000000000000)
  st5            0      (raw 0x00000000000000000000)
  st6            0      (raw 0x00000000000000000000)
  st7            0      (raw 0x00000000000000000000)
  fctrl          0x0    0
  fstat          0x0    0
  ftag           0x0    0
  fiseg          0x0    0
  fioff          0x0    0
  foseg          0x0    0
  fooff          0x0    0
  fop            0x0    0
  (gdb) Using memory regions provided by the target.
  There are no memory regions defined.
  (gdb) From        To          Syms Read   Shared Object Library
  0x0033fb40  0x003a7584  Yes (*)     /usr/lib/libboost_regex.so.2
  0x008171d0  0x0081b324  Yes (*)     /usr/lib/libboost_thread.so.2
  0x00421ea0  0x004ee824  Yes (*)     /usr/lib/libqpidclient.so.2
  0x071dac50  0x07256134  Yes (*)     /usr/lib/libstdc++.so.6
  0x00113410  0x0012e594  Yes (*)     /lib/libm.so.6
  0x00b37660  0x00b3ef34  Yes (*)     /lib/libgcc_s.so.1
  0x00541c80  0x0063cc40  Yes (*)     /lib/libc.so.6
  0x00c158c0  0x00d33ae4  Yes (*)     /usr/lib/libqpidcommon.so.2
  0x006bf970  0x006de524  Yes (*)     /usr/lib/libboost_program_options.so.2
  0x009403f0  0x009fb2b4  Yes (*)     /usr/lib/libicui18n.so.36
  0x007165e0  0x007aa544  Yes (*)     /usr/lib/libicuuc.so.36
  0x003ce880  0x003d2b04  Yes (*)     /lib/librt.so.1
  0x0013b210  0x00146a74  Yes (*)     /lib/libpthread.so.0
  0x077ccee0  0x077ce954  Yes (*)     /lib/libuuid.so.1
  0x002097f0  0x0021eebf  Yes (*)     /lib/ld-linux.so.2
  0x006a39a0  0x006ac614  Yes (*)     /usr/lib/libboost_filesystem.so.2
  0x0014fa50  0x00150a84  Yes (*)     /lib/libdl.so.2
  0x077da190  0x077ea774  Yes (*)     /usr/lib/libsasl2.so.2
                          Yes (*)     /usr/lib/libicudata.so.36
  0x001550c0  0x00160054  Yes (*)     /lib/libresolv.so.2
  0x074326e0  0x07439314  Yes (*)     /lib/libcrypt.so.1
  0x0016d050  0x0017a9f4  Yes (*)     /usr/lib/qpid/client/sslconnector.so
  0x00188760  0x001a1b74  Yes (*)     /usr/lib/libsslcommon.so.2
  0x04d7afc0  0x04e5ea04  Yes (*)     /usr/lib/libnss3.so
  0x04efb480  0x04f21664  Yes (*)     /usr/lib/libssl3.so
  0x04e9a7a0  0x04ebd3f4  Yes (*)     /usr/lib/libnspr4.so
  0x04d4db40  0x04d59284  Yes (*)     /usr/lib/libnssutil3.so
  0x04d64df0  0x04d66704  Yes (*)     /usr/lib/libplc4.so
  0x00204a30  0x002059a4  Yes (*)     /usr/lib/libplds4.so
  0x001a96a0  0x001b48d4  Yes (*)     /usr/lib/libz.so.1
  0x00faf8c0  0x00fb6264  Yes (*)     /lib/libnss_files.so.2
  0x00ee8b80  0x00eeab74  Yes (*)     /usr/lib/sasl2/libplain.so.2
  0x001bbb80  0x001bda04  Yes (*)     /usr/lib/sasl2/libanonymous.so.2
  0x001c10a0  0x001c5584  Yes (*)     /usr/lib/sasl2/libgssapiv2.so.2
  0x001ce3d0  0x001ef374  Yes (*)     /usr/lib/libgssapi_krb5.so.2
  0x00a4f160  0x00abe884  Yes (*)     /usr/lib/libkrb5.so.3
  0x00228790  0x00240564  Yes (*)     /usr/lib/libk5crypto.so.3
  0x00a397e0  0x00a39f94  Yes (*)     /lib/libcom_err.so.2
  0x001f6960  0x001fb1b4  Yes (*)     /usr/lib/libkrb5support.so.0
  0x00afa8d0  0x00afb014  Yes (*)     /lib/libkeyutils.so.1
  0x0024e530  0x0025b504  Yes (*)     /lib/libselinux.so.1
  0x00265f40  0x00293e34  Yes (*)     /lib/libsepol.so.1
  0x00dc6a00  0x00e71094  Yes (*)     /usr/lib/sasl2/libsasldb.so.2
  0x001feb70  0x00200a94  Yes (*)     /usr/lib/sasl2/liblogin.so.2
  (*): Shared library is missing debugging information.
  (gdb)   2 Thread 6117  0x071dad37 in std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >::_M_replace_aux () from /u
sr/lib/libstdc++.so.6
  * 1 Thread 6115  0x00ee5410 in __kernel_vsyscall ()
  Thread 2 (Thread 6117):
  #0  0x071dad37 in std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >::_M_replace_aux () from /usr/lib/libstdc++.so
.6
  #1  0x0724ed9c in ?? () from /usr/lib/libstdc++.so.6
  #2  0x0724f1a6 in __gxx_personality_v0 () from /usr/lib/libstdc++.so.6
  #3  0x00b3cd8b in _Unwind_RaiseException () from /lib/libgcc_s.so.1
  #4  0x0724f67d in __cxa_throw () from /usr/lib/libstdc++.so.6
  #5  0x004389ee in qpid::sys::Mutex::lock (this=0x83429f8)
      at ../include/qpid/sys/posix/Mutex.h:116
  #6  0x00451b1d in ~ScopedUnlock (this=0x83427f0, f=...)
      at ../include/qpid/sys/Mutex.h:44
  #7  qpid::client::ConnectionImpl::closeInternal<boost::_bi::bind_t<void, boost::_mfi::mf2<void, qpid::client::SessionImpl, unsigned short, std:
:string const&>, boost::_bi::list3<boost::arg<1>, boost::_bi::value<unsigned short>, boost::_bi::value<std::basic_string<char, std::char_traits<c
har>, std::allocator<char> > > > > > (this=0x83427f0, f=...) at qpid/client/ConnectionImpl.cpp:314
  #8  0x0044882a in qpid::client::ConnectionImpl::closed (this=0x83427f0,
      code=320, text=...) at qpid/client/ConnectionImpl.cpp:332
  #9  0x0044d86d in operator() (function_obj_ptr=..., a0=320, a1=...)
      at /usr/include/boost/bind/mem_fn_template.hpp:252
  #10 operator()<boost::_mfi::mf2<void, qpid::client::ConnectionImpl, unsigned short, std::string const&>, boost::_bi::list2<unsigned short&, std
::basic_string<char, std::char_traits<char>, std::allocator<char> > const&> > (
      function_obj_ptr=..., a0=320, a1=...) at /usr/include/boost/bind.hpp:348
  #11 operator()<unsigned short, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const> (function_obj_ptr=..., a0=320, a1=
...)
      at /usr/include/boost/bind/bind_template.hpp:44
  #12 boost::detail::function::void_function_obj_invoker2<boost::_bi::bind_t<void, boost::_mfi::mf2<void, qpid::client::ConnectionImpl, unsigned
short, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&>, boost::_bi::list3<boost::_bi::value<qpid::client::Connecti
onImpl*>, boost::arg<1>, boost::arg<2> > >, void, unsigned short, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&>:
:invoke (function_obj_ptr=..., a0=320, a1=...)
      at /usr/include/boost/function/function_template.hpp:136
  #13 0x0044322f in boost::function2<void, unsigned short, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::al
locator<void> >::operator() (this=0x83429cc, a0=320, a1=...)
      at /usr/include/boost/function/function_template.hpp:576
  #14 0x0043fbf3 in qpid::client::ConnectionHandler::close (this=0x8342880,
      replyCode=320, replyText=...) at qpid/client/ConnectionHandler.cpp:281
  #15 0x00c6d821 in invoke<qpid::framing::AMQP_ClientOperations::ConnectionHandler> (this=0xb75bc868, body=...) at qpid/framing/ConnectionCloseBo
dy.h:71
  #16 qpid::framing::AMQP_ClientOperations::ConnectionHandler::Invoker::visit (
      this=0xb75bc868, body=...) at qpid/framing/ClientInvoker.cpp:286
  #17 0x00c6a328 in qpid::framing::ConnectionCloseBody::accept (this=0x854d230,
      v=...) at qpid/framing/ConnectionCloseBody.h:75
  #18 0x00443e68 in qpid::framing::invoke<qpid::framing::AMQP_ClientOperations::ConnectionHandler> (target=..., body=...) at qpid/framing/Invoker
.h:80
  #19 0x0043e163 in qpid::client::ConnectionHandler::incoming (this=0x8342880,
      frame=...) at qpid/client/ConnectionHandler.cpp:105
  #20 0x00443f54 in qpid::client::ConnectionHandler::received (this=0x8342880,
      f=...) at qpid/client/ConnectionHandler.h:107
  #21 0x004a1473 in qpid::client::TCPConnector::decode (this=0x83422d8,
      buffer=0x835b928 "\017", size=59) at qpid/client/TCPConnector.cpp:304
  #22 0x0049d606 in qpid::client::TCPConnector::readbuff (this=0x83422d8,
      aio=..., buff=0x8343638) at qpid/client/TCPConnector.cpp:272
  #23 0x004a2674 in operator() (function_obj_ptr=..., a0=..., a1=0x8343638)
      at /usr/include/boost/bind/mem_fn_template.hpp:252
  #24 operator()<bool, boost::_mfi::mf2<bool, qpid::client::TCPConnector, qpid::sys::AsynchIO&, qpid::sys::AsynchIOBufferBase*>, boost::_bi::list
2<qpid::sys::AsynchIO&, qpid::sys::AsynchIOBufferBase*&> > (function_obj_ptr=..., a0=...,
      a1=0x8343638) at /usr/include/boost/bind.hpp:338
  #25 operator()<qpid::sys::AsynchIO, qpid::sys::AsynchIOBufferBase*> (
      function_obj_ptr=..., a0=..., a1=0x8343638)
      at /usr/include/boost/bind/bind_template.hpp:44
  #26 boost::detail::function::void_function_obj_invoker2<boost::_bi::bind_t<bool, boost::_mfi::mf2<bool, qpid::client::TCPConnector, qpid::sys::
AsynchIO&, qpid::sys::AsynchIOBufferBase*>, boost::_bi::list3<boost::_bi::value<qpid::client::TCPConnector*>, boost::arg<1>, boost::arg<2> > >, v
oid, qpid::sys::AsynchIO&, qpid::sys::AsynchIOBufferBase*>::invoke (function_obj_ptr=..., a0=..., a1=0x8343638)
      at /usr/include/boost/function/function_template.hpp:136
  #27 0x00c2a68e in boost::function2<void, qpid::sys::AsynchIO&, qpid::sys::AsynchIOBufferBase*, std::allocator<boost::function_base> >::operator
() (
      this=0x8343edc, a0=..., a1=0x8343638)
      at /usr/include/boost/function/function_template.hpp:576
  #28 0x00c27e90 in qpid::sys::posix::AsynchIO::readable (this=0x8343e38, h=...)
      at qpid/sys/posix/AsynchIO.cpp:418
  #29 0x00c28fbd in operator() (function_obj_ptr=..., a0=...)
      at /usr/include/boost/bind/mem_fn_template.hpp:149
  #30 operator()<boost::_mfi::mf1<void, qpid::sys::posix::AsynchIO, qpid::sys::DispatchHandle&>, boost::_bi::list1<qpid::sys::DispatchHandle&> >
(
      function_obj_ptr=..., a0=...) at /usr/include/boost/bind.hpp:287
  #31 operator()<qpid::sys::DispatchHandle> (function_obj_ptr=..., a0=...)
      at /usr/include/boost/bind/bind_template.hpp:32
  #32 boost::detail::function::void_function_obj_invoker1<boost::_bi::bind_t<void, boost::_mfi::mf1<void, qpid::sys::posix::AsynchIO, qpid::sys::
DispatchHandle&>, boost::_bi::list2<boost::_bi::value<qpid::sys::posix::AsynchIO*>, boost::arg<1> > >, void, qpid::sys::DispatchHandle&>::invoke
(function_obj_ptr=..., a0=...)
      at /usr/include/boost/function/function_template.hpp:136
  #33 0x00d2c0d4 in boost::function1<void, qpid::sys::DispatchHandle&, std::allocator<boost::function_base> >::operator() (this=0x8343e44, a0=...
)
      at /usr/include/boost/function/function_template.hpp:576
  #34 0x00d27cb8 in qpid::sys::DispatchHandle::processEvent (this=0x8343e3c,
      type=READABLE) at qpid/sys/DispatchHandle.cpp:278
  #35 0x00c38054 in process (this=0x8342400) at qpid/sys/Poller.h:123
  #36 qpid::sys::Poller::run (this=0x8342400)
      at qpid/sys/epoll/EpollPoller.cpp:483
  #37 0x00c2cd21 in qpid::sys::(anonymous namespace)::runRunnable (p=0x8342400)
      at qpid/sys/posix/Thread.cpp:35
  #38 0x0013c832 in start_thread () from /lib/libpthread.so.0
  #39 0x005fde0e in clone () from /lib/libc.so.6
  Thread 1 (Thread 6115):
  #0  0x00ee5410 in __kernel_vsyscall ()
  #1  0x00554df0 in raise () from /lib/libc.so.6
  #2  0x00556701 in abort () from /lib/libc.so.6
  #3  0x0049f40e in ~Mutex (this=0x83422d8, __in_chrg=<value optimized out>)
      at ../include/qpid/sys/posix/Mutex.h:112
  #4  qpid::client::TCPConnector::~TCPConnector (this=0x83422d8,
      __in_chrg=<value optimized out>) at qpid/client/TCPConnector.cpp:88
  #5  0x0044b4b4 in checked_delete<qpid::client::Connector> (this=0x83427f0,
      __in_chrg=<value optimized out>)
      at /usr/include/boost/checked_delete.hpp:34
  #6  ~scoped_ptr (this=0x83427f0, __in_chrg=<value optimized out>)
      at /usr/include/boost/scoped_ptr.hpp:77
  #7  qpid::client::ConnectionImpl::~ConnectionImpl (this=0x83427f0,
      __in_chrg=<value optimized out>) at qpid/client/ConnectionImpl.cpp:191
  #8  0x0043cdd8 in checked_delete<qpid::client::ConnectionImpl> (this=0x83427a8)
      at /usr/include/boost/checked_delete.hpp:34
  #9  boost::detail::sp_counted_impl_p<qpid::client::ConnectionImpl>::dispose (
      this=0x83427a8) at /usr/include/boost/detail/sp_counted_impl.hpp:76
  #10 0x0043a93b in ~shared_count (this=0x834b7e0,
      __in_chrg=<value optimized out>)
      at /usr/include/boost/detail/sp_counted_base_gcc_x86.hpp:145
  #11 ~shared_ptr (this=0x834b7e0, __in_chrg=<value optimized out>)
      at /usr/include/boost/shared_ptr.hpp:106
  #12 qpid::client::Connection::~Connection (this=0x834b7e0,
      __in_chrg=<value optimized out>) at qpid/client/Connection.cpp:50
  #13 0x0805be69 in qc_lib::qc_client<qc_lib::qc_optparser_client>::data_dealloc_sess_conn (this=0xbf871bb4) at qc_client.hpp:295
  #14 0x0805bf59 in qc_lib::qc_client<qc_lib::qc_optparser_client>::data_dealloc
      (this=0xbf871bb4) at qc_client.hpp:269
  #15 0x0805bfa6 in qc_lib::qc_client<qc_lib::qc_optparser_client>::~qc_client (
      this=0xbf871bb4, __in_chrg=<value optimized out>) at qc_client.hpp:234
  #16 0x0804f990 in main (argc=Cannot access memory at address 0x17e3
  ) at qc_client.cpp:82
  (gdb) quit

Comment 2 Gordon Sim 2010-04-15 21:57:11 UTC

*** This bug has been marked as a duplicate of bug 580824 ***