Bug 1453160
| Summary: | [Bitrot]: Multiple bricks crash seen on a cifs setup with nl-cache and II-readdirp enabled volume | ||
|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Gluster Storage | Reporter: | Sweta Anandpara <sanandpa> |
| Component: | bitrot | Assignee: | Kotresh HR <khiremat> |
| Status: | CLOSED ERRATA | QA Contact: | Sweta Anandpara <sanandpa> |
| Severity: | high | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | rhgs-3.3 | CC: | amukherj, rhinduja, rhs-bugs, sanandpa, storage-qa-internal |
| Target Milestone: | --- | ||
| Target Release: | RHGS 3.3.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | glusterfs-3.8.4-27 | Doc Type: | If docs needed, set a value |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2017-09-21 04:45:37 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | |||
| Bug Blocks: | 1417151 | ||
|
Description
Sweta Anandpara
2017-05-22 09:42:23 UTC
[qe@rhsqe-repo 1453160]$ [qe@rhsqe-repo 1453160]$ hostname rhsqe-repo.lab.eng.blr.redhat.com [qe@rhsqe-repo 1453160]$ [qe@rhsqe-repo 1453160]$ pwd /home/repo/sosreports/1453160 [qe@rhsqe-repo 1453160]$ [qe@rhsqe-repo 1453160]$ ll total 980952 -rwxr-xr-x. 1 qe qe 3473 May 22 15:03 client_logs -rwxr-xr-x. 1 qe qe 239718400 May 22 15:00 core.13011 -rwxr-xr-x. 1 qe qe 233590784 May 22 15:00 core.22469 -rwxr-xr-x. 1 qe qe 222420992 May 22 15:00 core.22484 -rwxr-xr-x. 1 qe qe 199450624 May 22 15:00 core.3758 -rwxr-xr-x. 1 qe qe 30375496 May 22 14:54 sosreport-sysreg-prod-20170522090552_dhcp_47_127.tar.xz -rwxr-xr-x. 1 qe qe 26819980 May 22 14:54 sosreport-sysreg-prod-20170522090554_dhcp_46_181.tar.xz -rwxr-xr-x. 1 qe qe 26213468 May 22 14:54 sosreport-sysreg-prod-20170522090556_dhcp_46_47.tar.xz -rwxr-xr-x. 1 qe qe 25884564 May 22 14:54 sosreport-sysreg-prod-20170522090558_dhcp_47_140.tar.xz [qe@rhsqe-repo 1453160]$ upstream patch : https://review.gluster.org/17357 Backtrace:
#0 br_stub_need_versioning (this=this@entry=0x7fcda8012aa0, fd=fd@entry=0x7fcd94008480, versioning=versioning@entry=0x7fcda19a4058, modified=modified@entry=0x7fcda19a405c,
ctx=ctx@entry=0x7fcda19a4060) at bit-rot-stub.c:466
466 br_stub_inode_ctx_t *c = NULL;
Missing separate debuginfos, use: debuginfo-install glibc-2.17-157.el7_3.1.x86_64 keyutils-libs-1.5.8-3.el7.x86_64 krb5-libs-1.14.1-27.el7_3.x86_64 libacl-2.2.51-12.el7.x86_64 libaio-0.3.109-13.el7.x86_64 libattr-2.4.46-12.el7.x86_64 libcom_err-1.42.9-9.el7.x86_64 libgcc-4.8.5-11.el7.x86_64 libselinux-2.5-6.el7.x86_64 libuuid-2.23.2-33.el7_3.2.x86_64 openssl-libs-1.0.1e-60.el7_3.1.x86_64 pcre-8.32-15.el7_2.1.x86_64 sqlite-3.7.17-8.el7.x86_64 sssd-client-1.14.0-43.el7_3.14.x86_64 zlib-1.2.7-17.el7.x86_64
(gdb) bt
#0 br_stub_need_versioning (this=this@entry=0x7fcda8012aa0, fd=fd@entry=0x7fcd94008480, versioning=versioning@entry=0x7fcda19a4058, modified=modified@entry=0x7fcda19a405c,
ctx=ctx@entry=0x7fcda19a4060) at bit-rot-stub.c:466
#1 0x00007fcdae8465d8 in br_stub_writev (frame=frame@entry=0x7fcd6400b5f0, this=this@entry=0x7fcda8012aa0, fd=fd@entry=0x7fcd94008480, vector=vector@entry=0x7fcd94030a30,
count=count@entry=1, offset=offset@entry=1577648128, flags=flags@entry=0, iobref=iobref@entry=0x7fcd940086b0, xdata=xdata@entry=0x7fcd9402e710) at bit-rot-stub.c:1959
#2 0x00007fcdbd8955f9 in default_writev (frame=0x7fcd6400b5f0, this=<optimized out>, fd=0x7fcd94008480, vector=0x7fcd94030a30, count=1, off=1577648128, flags=0, iobref=0x7fcd940086b0,
xdata=0x7fcd9402e710) at defaults.c:2543
#3 0x00007fcdae411d24 in pl_writev (frame=frame@entry=0x7fcd6400b920, this=this@entry=0x7fcda8015980, fd=fd@entry=0x7fcd94008480, vector=vector@entry=0x7fcd94030a30, count=count@entry=1,
offset=offset@entry=1577648128, flags=flags@entry=0, iobref=iobref@entry=0x7fcd940086b0, xdata=xdata@entry=0x7fcd9402e710) at posix.c:2030
#4 0x00007fcdae1fc4c4 in worm_writev (frame=frame@entry=0x7fcd6400b920, this=this@entry=0x7fcda8016f60, fd=fd@entry=0x7fcd94008480, vector=vector@entry=0x7fcd94030a30,
count=count@entry=1, offset=offset@entry=1577648128, flags=flags@entry=0, iobref=iobref@entry=0x7fcd940086b0, xdata=xdata@entry=0x7fcd9402e710) at worm.c:386
#5 0x00007fcdadff1ea7 in ro_writev (frame=0x7fcd6400b920, this=<optimized out>, fd=0x7fcd94008480, vector=0x7fcd94030a30, count=1, off=1577648128, flags=0, iobref=0x7fcd940086b0,
xdata=0x7fcd9402e710) at read-only-common.c:383
#6 0x00007fcdadddd83d in leases_writev (frame=0x7fcd64006ce0, this=0x7fcda8019ef0, fd=0x7fcd94008480, vector=0x7fcd94030a30, count=1, off=1577648128, flags=0, iobref=0x7fcd940086b0,
xdata=0x7fcd9402e710) at leases.c:127
#7 0x00007fcdadbcc8ad in up_writev (frame=0x7fcd64006f00, this=0x7fcda801b630, fd=0x7fcd94008480, vector=0x7fcd94030a30, count=1, off=1577648128, flags=0, iobref=0x7fcd940086b0,
xdata=0x7fcd9402e710) at upcall.c:131
#8 0x00007fcdbd8ae736 in default_writev_resume (frame=0x7fcd94036c30, this=0x7fcda801cf60, fd=0x7fcd94008480, vector=0x7fcd94030a30, count=1, off=1577648128, flags=0,
iobref=0x7fcd940086b0, xdata=0x7fcd9402e710) at defaults.c:1849
#9 0x00007fcdbd83e698 in call_resume_wind (stub=0x7fcd9404de20) at call-stub.c:2045
#10 0x00007fcdbd83eb25 in call_resume (stub=0x7fcd9404de20) at call-stub.c:2508
#11 0x00007fcdad9b7957 in iot_worker (data=0x7fcda8056490) at io-threads.c:220
#12 0x00007fcdbc67bdc5 in start_thread () from /lib64/libpthread.so.0
#13 0x00007fcdbbfc073d in clone () from /lib64/libc.so.6
The fix sent for BZ 1451280 solves this crash as well. Keeping this open as the bt is different. Upstream Patch: https://review.gluster.org/17357 Upstream Patches: https://review.gluster.org/17357 (master) https://review.gluster.org/#/c/17406/ (release-3.11) Downstream Patches: https://code.engineering.redhat.com/gerrit/#/c/107534/ Tested and verified this on the build glusterfs-3.8.4-35. A round of testing has taken place on bitrot and have not seen this crash again anytime in my logs. Moving this bug to verified in 3.3.0. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2017:2774 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2017:2774 |