Bug 1554732

Summary: I can'nt get heal my gluster
Product: [Community] GlusterFS Reporter: JV <rosello>
Component: disperseAssignee: bugs <bugs>
Status: CLOSED WORKSFORME QA Contact:
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: mainlineCC: bugs, jahernan, rosello
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-10-25 10:01:52 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
glfsheal-glusterfs_vol.log, glustershd.log & rhev-data-center-mnt-glusterSD-nivoso-gs.cc.upv.es_glusterfs__vol.log none

Description JV 2018-03-13 09:05:33 UTC 
Description of problem:

Firstly, We configure the gluster in disperse mode. We stoped 1 of 3 servers to do maintenance, when the host was up, we had in the rest of the hosts 6 unsynced entries. We executed several times in the 3 servers:
# gluster volume heal myvolfs 
Some hours after, we had 3 unsynced entries.

Then we decided to configure it in distributed-disperse mode, we distributed the 3 unsynced entries and several hours later:

[root@nivoso glusterfs]# gluster v heal glusterfs_vol info
Brick nivoso-gs:/mnt/gluster_fs/brick1/brick1
Status: Connected
Number of entries: 0

Brick nivoso-gs:/mnt/gluster_fs/brick2/brick2
Status: Connected
Number of entries: 0

Brick ventoso-gs:/mnt/gluster_fs/brick1/brick1
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/fc221576-7424-487d-b20f-ffc5d7e8e711/f73cd154-89bf-4db9-bbb6-08ce74e0a79f
Status: Connected
Number of entries: 1

Brick ventoso-gs:/mnt/gluster_fs/brick2/brick2
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/fc221576-7424-487d-b20f-ffc5d7e8e711/f73cd154-89bf-4db9-bbb6-08ce74e0a79f
Status: Connected
Number of entries: 1

Brick pluvioso-gs:/mnt/gluster_fs/brick1/brick1
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/fc221576-7424-487d-b20f-ffc5d7e8e711/f73cd154-89bf-4db9-bbb6-08ce74e0a79f
Status: Connected
Number of entries: 1

Brick pluvioso-gs:/mnt/gluster_fs/brick2/brick2
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/fc221576-7424-487d-b20f-ffc5d7e8e711/f73cd154-89bf-4db9-bbb6-08ce74e0a79f
Status: Connected
Number of entries: 1

Brick nivoso-gs:/mnt/gluster_fs/brick3/brick3
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/488147e9-3585-471d-a207-cb52f7e2d11b/bbd64ccb-1601-4588-9b27-b6612b90dab5
Status: Connected
Number of entries: 1

Brick nivoso-gs:/mnt/gluster_fs/brick4/brick4
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/488147e9-3585-471d-a207-cb52f7e2d11b/bbd64ccb-1601-4588-9b27-b6612b90dab5
Status: Connected
Number of entries: 1

Brick ventoso-gs:/mnt/gluster_fs/brick3/brick3
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/488147e9-3585-471d-a207-cb52f7e2d11b/bbd64ccb-1601-4588-9b27-b6612b90dab5
Status: Connected
Number of entries: 1

Brick ventoso-gs:/mnt/gluster_fs/brick4/brick4
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/488147e9-3585-471d-a207-cb52f7e2d11b/bbd64ccb-1601-4588-9b27-b6612b90dab5
Status: Connected
Number of entries: 1

Brick pluvioso-gs:/mnt/gluster_fs/brick3/brick3
Status: Connected
Number of entries: 0

Brick pluvioso-gs:/mnt/gluster_fs/brick4/brick4
Status: Connected
Number of entries: 0

In this status, we carry serveral days. And we can't upgrade the hosts.
 

Version-Release number of selected component (if applicable):

[root@nivoso glusterfs]# gluster --version
glusterfs 3.8.15 built on Aug 16 2017 14:48:03
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.



How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:
root@nivoso glusterfs]# gluster v heal glusterfs_vol info
Brick nivoso-gs:/mnt/gluster_fs/brick1/brick1
Status: Connected
Number of entries: 0

Brick nivoso-gs:/mnt/gluster_fs/brick2/brick2
Status: Connected
Number of entries: 0

Brick ventoso-gs:/mnt/gluster_fs/brick1/brick1
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/fc221576-7424-487d-b20f-ffc5d7e8e711/f73cd154-89bf-4db9-bbb6-08ce74e0a79f
Status: Connected
Number of entries: 1

Brick ventoso-gs:/mnt/gluster_fs/brick2/brick2
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/fc221576-7424-487d-b20f-ffc5d7e8e711/f73cd154-89bf-4db9-bbb6-08ce74e0a79f
Status: Connected
Number of entries: 1

Brick pluvioso-gs:/mnt/gluster_fs/brick1/brick1
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/fc221576-7424-487d-b20f-ffc5d7e8e711/f73cd154-89bf-4db9-bbb6-08ce74e0a79f
Status: Connected
Number of entries: 1

Brick pluvioso-gs:/mnt/gluster_fs/brick2/brick2
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/fc221576-7424-487d-b20f-ffc5d7e8e711/f73cd154-89bf-4db9-bbb6-08ce74e0a79f
Status: Connected
Number of entries: 1

Brick nivoso-gs:/mnt/gluster_fs/brick3/brick3
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/488147e9-3585-471d-a207-cb52f7e2d11b/bbd64ccb-1601-4588-9b27-b6612b90dab5
Status: Connected
Number of entries: 1

Brick nivoso-gs:/mnt/gluster_fs/brick4/brick4
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/488147e9-3585-471d-a207-cb52f7e2d11b/bbd64ccb-1601-4588-9b27-b6612b90dab5
Status: Connected
Number of entries: 1

Brick ventoso-gs:/mnt/gluster_fs/brick3/brick3
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/488147e9-3585-471d-a207-cb52f7e2d11b/bbd64ccb-1601-4588-9b27-b6612b90dab5
Status: Connected
Number of entries: 1

Brick ventoso-gs:/mnt/gluster_fs/brick4/brick4
/628b6d2f-4ed7-4766-9d8d-1dfd884c2faf/images/488147e9-3585-471d-a207-cb52f7e2d11b/bbd64ccb-1601-4588-9b27-b6612b90dab5
Status: Connected
Number of entries: 1

Brick pluvioso-gs:/mnt/gluster_fs/brick3/brick3
Status: Connected
Number of entries: 0

Brick pluvioso-gs:/mnt/gluster_fs/brick4/brick4
Status: Connected
Number of entries: 0


Expected results:

We wish to resolve this unsync entries to upgrade the system.

Additional info:
Comment 1 JV 2018-03-13 10:42:47 UTC 
Created attachment 1407496 [details]
glfsheal-glusterfs_vol.log, glustershd.log & rhev-data-center-mnt-glusterSD-nivoso-gs.cc.upv.es_glusterfs__vol.log

7z format
Comment 2 Xavi Hernandez 2018-10-25 10:01:52 UTC 
I'm really sorry for the late answer. I guess you have already solved this issue one way or another, and this procedure seems to work fine with the latest versions, so I'm closing this bug as "works for me".

If you are still facing this problem, please, feel free to reopen it and I'll take a look.