Bug 1230026
| Summary: | BVT: glusterd crashed and dumped during upgrade (on rhel7.1 server) | ||
|---|---|---|---|
| Product: | [Community] GlusterFS | Reporter: | Anand Nekkunti <anekkunt> |
| Component: | glusterd | Assignee: | bugs <bugs> |
| Status: | CLOSED CURRENTRELEASE | QA Contact: | |
| Severity: | medium | Docs Contact: | |
| Priority: | low | ||
| Version: | 3.7.0 | CC: | akhakhar, amukherj, anekkunt, bugs, gluster-bugs, kripper, nsathyan, sasundar, vbellur |
| Target Milestone: | --- | Keywords: | Triaged |
| Target Release: | --- | ||
| Hardware: | x86_64 | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | glusterfs-3.7.2 | Doc Type: | Bug Fix |
| Doc Text: | Story Points: | --- | |
| Clone Of: | 1209461 | Environment: | |
| Last Closed: | 2015-06-20 09:50:28 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | 1209461, 1230195 | ||
| Bug Blocks: | |||
|
Description
Anand Nekkunti
2015-06-10 07:05:19 UTC
COMMIT: http://review.gluster.org/11154 committed in release-3.7 by Atin Mukherjee (amukherj) ------ commit c58a15811a82c675a4cc20d664731239daa0c48c Author: anand <anekkunt> Date: Fri Apr 10 16:41:25 2015 +0530 glusterd: Stop tcp/ip listeners during glusterd exit Problem : Because of race between exit thread and rpc thread causing the glusterd crash while glusterd exiting/stoping. Fix : Stop tcp/ip socket listeners in cleanup_and_exit to avoid new rpc events. Backport of : >Change-Id: Ie9280c8c9d7c350a176529375d861432f3de94ac >BUG: 1209461 >Signed-off-by: anand <anekkunt> >Reviewed-on: http://review.gluster.org/10197 >Reviewed-by: Atin Mukherjee <amukherj> >Tested-by: NetBSD Build System <jenkins.org> >Reviewed-by: Kaushal M <kaushal> Change-Id: Ibb3d3669e248af8c5284801d7f18c6ee26fe2ef3 BUG: 1230026 Reviewed-on: http://review.gluster.org/11154 Tested-by: Gluster Build System <jenkins.com> Tested-by: NetBSD Build System <jenkins.org> Reviewed-by: Atin Mukherjee <amukherj> COMMIT: http://review.gluster.org/11155 committed in release-3.7 by Atin Mukherjee (amukherj) ------ commit 6724ae3b3becdf6be495e8b4f81f1fba302da69e Author: anand <anekkunt> Date: Fri May 22 18:18:11 2015 +0530 libglusterfs: Enabling the fini() in cleanup_and_exit() Problem 1 : glusterd was crashing due to race between clean up thread and rpc event thread. Scenario: As we can observed, X thread is in the process of exiting the process. It has already run the exit handlers, which cleanup things that require cleaning up. This includes liburcu resources. By the time Y thread called rcu_bp_register(), the liburcu resources have been cleaned up. rcu_bp_register() tries to access these non-existent resources, which leads to the segmentation fault. Note1: Crash happen when the process is almost at the point of stopping(exiting), it doesn't have any serious impact to functionality apart from creating the core dump file and the log message. Fix .Do proper clean up before calling exit(). Note2: Other xlator have clean up issues,so only glusterd clean up function invoked. Note3: This patch also solve the selinux issue. Problem 2 : glusterd runs as rpm_script_t when it's executed from the rpm scriptlet,files created in this context are set as rpm_script_t, so glusterd unable to access these files when it runs in glusterd_t context. Fix: Fini clean up the files while glusterd exiting, so files are recreated by glusterd while starting with proper SElinux context label. Backport of : >Change-Id: Idcfd087f51c18a729bdf44a146f9d294e2fca5e2 >BUG: 1209461 >Signed-off-by: anand <anekkunt> >Reviewed-on: http://review.gluster.org/10894 >Tested-by: Gluster Build System <jenkins.com> >Reviewed-by: Atin Mukherjee <amukherj> >Tested-by: NetBSD Build System <jenkins.org> >Reviewed-by: Raghavendra Bhat <raghavendra> >Reviewed-by: Vijay Bellur <vbellur> Change-Id: I59579e675bd73d7a19f7b965bd2c3c0fcd95d241 BUG: 1230026 Signed-off-by: anand <anekkunt> Reviewed-on: http://review.gluster.org/11155 Tested-by: Gluster Build System <jenkins.com> Tested-by: NetBSD Build System <jenkins.org> Reviewed-by: Atin Mukherjee <amukherj> This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.2, please reopen this bug report. glusterfs-3.7.2 has been announced on the Gluster Packaging mailinglist [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution. [1] http://www.gluster.org/pipermail/packaging/2015-June/000006.html [2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user |