Bug 1448433
| Summary: | [gluster-block]:tcmu-runner crashes if glusterd is stopped and try to start tcmu-runner | ||
|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Gluster Storage | Reporter: | surabhi <sbhaloth> |
| Component: | tcmu-runner | Assignee: | Prasanna Kumar Kalever <prasanna.kalever> |
| Status: | CLOSED ERRATA | QA Contact: | surabhi <sbhaloth> |
| Severity: | high | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | rhgs-3.3 | CC: | amukherj, pkarampu, prasanna.kalever, rhs-bugs |
| Target Milestone: | --- | ||
| Target Release: | RHGS 3.3.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | tcmu-runner-1.2.0-2 | Doc Type: | If docs needed, set a value |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2017-09-21 04:17:54 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | |||
| Bug Blocks: | 1417151 | ||
|
Description
surabhi
2017-05-05 12:14:13 UTC
Here is patch: https://github.com/open-iscsi/tcmu-runner/pull/144/commits/cc42f9ad5aa25b0efaa1f19c2d397d23358967b5 With the latest builds , I still see this crash after following the exact same steps provided in the description. May 30 09:36:02 dhcp46-151 : tcmu_create_glfs_object:405 : glfs_init failed: Success May 30 09:36:02 dhcp46-151 tcmu-runner: 2017-05-30 09:36:02.917 16886 [ERROR] tcmu_create_glfs_object:405 : glfs_init failed: Success May 30 09:36:03 dhcp46-151 tcmu-runner: *** Error in `/usr/bin/tcmu-runner': double free or corruption (out): 0x0000000002360590 *** May 30 09:36:03 dhcp46-151 tcmu-runner: ======= Backtrace: ========= May 30 09:36:03 dhcp46-151 tcmu-runner: /lib64/libc.so.6(+0x7c503)[0x7f15d9fac503] May 30 09:36:03 dhcp46-151 tcmu-runner: /usr/lib64/tcmu-runner/handler_glfs.so(+0x1754)[0x7f15d8b41754] May 30 09:36:03 dhcp46-151 tcmu-runner: /usr/lib64/tcmu-runner/handler_glfs.so(+0x23a7)[0x7f15d8b423a7] May 30 09:36:03 dhcp46-151 tcmu-runner: /lib64/libtcmu.so.1(+0x988d)[0x7f15db87488d] May 30 09:36:03 dhcp46-151 tcmu-runner: /lib64/libtcmu.so.1(+0x9ddf)[0x7f15db874ddf] May 30 09:36:03 dhcp46-151 tcmu-runner: /lib64/libtcmu.so.1(tcmulib_initialize+0x1f8)[0x7f15db875358] May 30 09:36:03 dhcp46-151 tcmu-runner: /usr/bin/tcmu-runner[0x407780] May 30 09:36:03 dhcp46-151 tcmu-runner: /lib64/libc.so.6(__libc_start_main+0xf5)[0x7f15d9f51b35] May 30 09:36:03 dhcp46-151 tcmu-runner: /usr/bin/tcmu-runner[0x407927] May 30 09:36:03 dhcp46-151 tcmu-runner: ======= Memory map: ======== May 30 09:36:03 dhcp46-151 tcmu-runner: 00400000-00415000 r-xp 00000000 fd:00 780917 /usr/bin/tcmu-runner May 30 09:36:03 dhcp46-151 tcmu-runner: 00615000-00616000 r--p 00015000 fd:00 780917 /usr/bin/tcmu-runner May 30 09:36:03 dhcp46-151 tcmu-runner: 00616000-00617000 rw-p 00016000 fd:00 780917 /usr/bin/tcmu-runner May 30 09:36:03 dhcp46-151 tcmu-runner: 02351000-0242b000 rw-p 00000000 00:00 0 [heap] May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15bc000000-7f15bc021000 rw-p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15bc021000-7f15c0000000 ---p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15c0000000-7f15c0021000 rw-p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15c0021000-7f15c4000000 ---p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15c4000000-7f15c4021000 rw-p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15c4021000-7f15c8000000 ---p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15c9991000-7f15c9992000 ---p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15c9992000-7f15ca993000 rw-p 00000000 00:00 0 [stack:16895] May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15ca993000-7f15ca994000 ---p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15ca994000-7f15cb194000 rw-p 00000000 00:00 0 May 30 09:36:03 dhcp46-151 tcmu-runner: 7f15cb194000-7f15cb19c000 r-xp 00000000 fd:00 34106719 /usr/lib64/libnss_sss.so.2 Please have a look. Surabhi can you please paste me the version numbers of gluster-block and tcmu-runner which you have used to verify this bug ? rpm -qa | grep gluster-block gluster-block-debuginfo-0.2-3.el7rhgs.x86_64 gluster-block-0.2-3.el7rhgs.x86_64 rpm -qa | grep tcmu-runner tcmu-runner-1.2.0-3.el7rhgs.x86_64 tcmu-runner-debuginfo-1.2.0-3.el7rhgs.x86_64 With upgrading to latest build , following above steps, there is no crash seen for tcmu. Only there are errors in log messages regarding glfs_init failed which is there because glusterd is not running when we stop rpcbind. Works as expected.Marking the BZ verified. gluster-block-0.2.1-1.el7rhgs.x86_64 tcmu-runner-1.2.0-4.el7rhgs.x86_64 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2017:2773 |