Bug 1203637

Summary: Disperse volume: glfsheal crashed
Product: [Community] GlusterFS Reporter: Bhaskarakiran <byarlaga>
Component: snapshotAssignee: bugs <bugs>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: urgent Docs Contact:
Priority: unspecified    
Version: mainlineCC: bugs, byarlaga, gluster-bugs, mzywusko, pkarampu
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: glusterfs-3.7dev-0.869.gitf5e4c94.el6 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
: 1224139 (view as bug list) Environment:
Last Closed: 2015-05-14 17:26:54 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1186580, 1224139    
Attachments:
Description Flags
corefiles none

Description Bhaskarakiran 2015-03-19 10:12:05 UTC 
Description of problem:
=======================

Seen 5 glfsheal crashes. created a 1x(8+4) and 1x(8+3) disperse volumes, brought down the bricks while the IO is going on (files and directory creations) and brought them back up with gluster volume force after some time. Then trigger heal with gluster volume heal <volname> and seen the crashes. 

Converted plain 'dispersevol' to distributed disperse volume adding 11 bricks in a 1x(8+3) volume and triggered heal command. I guess 4 instances of the crash are due to that but not sure.

[root@ninja rhs]# file core.*
core.1025:  ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from '/usr/sbin/glfsheal dispersevol'
core.12832: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from '/usr/sbin/glfsheal dispersevol'
core.1872:  ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from '/usr/sbin/glfsheal testvol'
core.21034: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from '/usr/sbin/glfsheal dispersevol'
core.23908: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from '/usr/sbin/glfsheal dispersevol'
[root@ninja rhs]# 

Version-Release number of selected component (if applicable):
=============================================================

How reproducible:
=================
100%

Steps to Reproduce:
===================

As in description 


Additional info:
================
core files will be attached.
Comment 1 Bhaskarakiran 2015-03-19 10:14:04 UTC 
Created attachment 1003776 [details]
corefiles
Comment 2 Anand Avati 2015-03-26 07:12:20 UTC 
REVIEW: http://review.gluster.org/10004 (features/snapview-client: Don't free un-allocated memory) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu)
Comment 3 Anand Avati 2015-03-26 07:12:29 UTC 
REVIEW: http://review.gluster.org/10005 (glfsheal: Do not print pending heals for non-afr xls) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu)
Comment 4 Anand Avati 2015-03-26 11:12:25 UTC 
COMMIT: http://review.gluster.org/10005 committed in master by Pranith Kumar Karampuri (pkarampu) 
------
commit c54e546040a15d6f1751816f59bdfba430b5fde3
Author: Pranith Kumar K <pkarampu>
Date:   Thu Mar 26 12:38:36 2015 +0530

    glfsheal: Do not print pending heals for non-afr xls
    
    Change-Id: Ib9a1998b964af1435e86de2c861ecb1c0e9026c9
    BUG: 1203637
    Signed-off-by: Pranith Kumar K <pkarampu>
    Reviewed-on: http://review.gluster.org/10005
    Reviewed-by: Krutika Dhananjay <kdhananj>
    Reviewed-by: Anuradha Talur <atalur>
    Reviewed-by: Ravishankar N <ravishankar>
    Tested-by: Gluster Build System <jenkins.com>
    Reviewed-by: Kaleb KEITHLEY <kkeithle>
Comment 5 Anand Avati 2015-03-27 12:19:49 UTC 
COMMIT: http://review.gluster.org/10004 committed in master by Vijay Bellur (vbellur) 
------
commit 28c446a4eaaecfba8115dbaf66b3820b9d53257b
Author: Pranith Kumar K <pkarampu>
Date:   Thu Mar 26 12:24:02 2015 +0530

    features/snapview-client: Don't free un-allocated memory
    
    Change-Id: I8636ced27448dde4f2c11370fe2026067d4a7e74
    BUG: 1203637
    Signed-off-by: Pranith Kumar K <pkarampu>
    Reviewed-on: http://review.gluster.org/10004
    Reviewed-by: Raghavendra Bhat <raghavendra>
    Tested-by: Gluster Build System <jenkins.com>
    Reviewed-by: Vijay Bellur <vbellur>
Comment 6 Niels de Vos 2015-05-14 17:26:54 UTC 
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user
Comment 7 Niels de Vos 2015-05-14 17:28:29 UTC 
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user
Comment 8 Niels de Vos 2015-05-14 17:35:17 UTC 
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user