Bug 1889966 - Volume status shows rebalance as not started on doing a replace-brick on dist-arbiter volume
Summary: Volume status shows rebalance as not started on doing a replace-brick on dist...
Keywords:
Status: ASSIGNED
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat
Component: distribute
Version: rhgs-3.5
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: ---
Assignee: Tamar Shacked
QA Contact: Upasana
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-10-21 06:12 UTC by Upasana
Modified: 2020-11-26 17:51 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:


Attachments (Terms of Use)

Description Upasana 2020-10-21 06:12:59 UTC
Provide version-Release number of selected component (if applicable):
=====================================================================
glusterfs-server-6.0-45.el7rhgs.x86_64 (3.5.3) && the HOTFIX build glusterfs-server-3.12.2-40.el7rhgs.2.HOTFIX.sfdc02762348.BZ1884244.x86_64

 
Have you searched the Bugzilla archives for same/similar issues reported.
=========================================================================
yes



Describe the issue:(please be detailed as possible and provide log snippets)
[Provide TimeStamp when the issue is seen]
==============================================================================
Steps -
1.create a arbiter volume
2.add-brick and rebalance
3.Wait for rebalance to complete (check if it shows completed on volume status)
4.replace brick 
5.the volume status shows rebalance as not started

logs
====
[root@dhcp35-100 ~]# gluster v create arbiter-vol replica 3 arbiter 1 dhcp35-202.lab.eng.blr.redhat.com:/gluster/brick1/test dhcp35-31.lab.eng.blr.redhat.com:/gluster/brick1/test dhcp35-104.lab.eng.blr.redhat.com:/gluster/brick1/test
volume create: arbiter-vol: success: please start the volume to access data
[root@dhcp35-100 ~]# gluster v start arbiter-vol
volume start: arbiter-vol: success
[root@dhcp35-100 ~]# gluster v status arbiter-vol
Status of volume: arbiter-vol
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick dhcp35-202.lab.eng.blr.redhat.com:/gl
uster/brick1/test                           49175     0          Y       7908 
Brick dhcp35-31.lab.eng.blr.redhat.com:/glu
ster/brick1/test                            49175     0          Y       29058
Brick dhcp35-104.lab.eng.blr.redhat.com:/gl
uster/brick1/test                           49175     0          Y       18812
Self-heal Daemon on localhost               N/A       N/A        Y       3306 
Self-heal Daemon on 10.70.35.31             N/A       N/A        Y       29201
Self-heal Daemon on 10.70.35.104            N/A       N/A        Y       18969
Self-heal Daemon on dhcp35-202.lab.eng.blr.
redhat.com                                  N/A       N/A        Y       7979 
 
Task Status of Volume arbiter-vol
------------------------------------------------------------------------------
There are no active volume tasks
 
[root@dhcp35-100 ~]# gluster v add-brick arbiter-vol dhcp35-202.lab.eng.blr.redhat.com:/gluster/brick1/test-add dhcp35-31.lab.eng.blr.redhat.com:/gluster/brick1/test-add dhcp35-104.lab.eng.blr.redhat.com:/gluster/brick1/test-add
volume add-brick: success
[root@dhcp35-100 ~]# gluster v rebalance arbiter-vol start 
volume rebalance: arbiter-vol: success: Rebalance on arbiter-vol has been started successfully. Use rebalance status command to check status of the rebalance process.
ID: ad76c0ac-1914-4df4-99d0-5bcb273beb65
[root@dhcp35-100 ~]# gluster v rebalance arbiter-vol status
                                    Node Rebalanced-files          size       scanned      failures       skipped               status  run time in h:m:s
                               ---------      -----------   -----------   -----------   -----------   -----------         ------------     --------------
       dhcp35-202.lab.eng.blr.redhat.com                0        0Bytes             0             0             0            completed        0:00:01
                             10.70.35.31                0        0Bytes             0             0             0            completed        0:00:01
                            10.70.35.104                0        0Bytes             0             0             0            completed        0:00:01
volume rebalance: arbiter-vol: success
[root@dhcp35-100 ~]# 
[root@dhcp35-100 ~]# 
[root@dhcp35-100 ~]# 
[root@dhcp35-100 ~]# 
[root@dhcp35-100 ~]# gluster v status arbiter-vol
Status of volume: arbiter-vol
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick dhcp35-202.lab.eng.blr.redhat.com:/gl
uster/brick1/test                           49175     0          Y       7908 
Brick dhcp35-31.lab.eng.blr.redhat.com:/glu
ster/brick1/test                            49175     0          Y       29058
Brick dhcp35-104.lab.eng.blr.redhat.com:/gl
uster/brick1/test                           49175     0          Y       18812
Brick dhcp35-202.lab.eng.blr.redhat.com:/gl
uster/brick1/test-add                       49176     0          Y       10504
Brick dhcp35-31.lab.eng.blr.redhat.com:/glu
ster/brick1/test-add                        49176     0          Y       31636
Brick dhcp35-104.lab.eng.blr.redhat.com:/gl
uster/brick1/test-add                       49176     0          Y       21198
Self-heal Daemon on localhost               N/A       N/A        Y       5664 
Self-heal Daemon on 10.70.35.104            N/A       N/A        Y       21227
Self-heal Daemon on 10.70.35.31             N/A       N/A        Y       31657
Self-heal Daemon on dhcp35-202.lab.eng.blr.
redhat.com                                  N/A       N/A        Y       10540
 
Task Status of Volume arbiter-vol
------------------------------------------------------------------------------
Task                 : Rebalance           
ID                   : ad76c0ac-1914-4df4-99d0-5bcb273beb65
Status               : completed           
 
[root@dhcp35-100 ~]# gluster v replace-brick arbiter-vol dhcp35-202.lab.eng.blr.redhat.com:/gluster/brick1/test dhcp35-202.lab.eng.blr.redhat.com:/gluster/brick1/test-replace commit force
volume replace-brick: success: replace-brick commit force operation successful
[root@dhcp35-100 ~]# gluster v status arbiter-vol
Status of volume: arbiter-vol
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick dhcp35-202.lab.eng.blr.redhat.com:/gl
uster/brick1/test-replace                   49175     0          Y       12915
Brick dhcp35-31.lab.eng.blr.redhat.com:/glu
ster/brick1/test                            49175     0          Y       29058
Brick dhcp35-104.lab.eng.blr.redhat.com:/gl
uster/brick1/test                           49175     0          Y       18812
Brick dhcp35-202.lab.eng.blr.redhat.com:/gl
uster/brick1/test-add                       49176     0          Y       10504
Brick dhcp35-31.lab.eng.blr.redhat.com:/glu
ster/brick1/test-add                        49176     0          Y       31636
Brick dhcp35-104.lab.eng.blr.redhat.com:/gl
uster/brick1/test-add                       49176     0          Y       21198
Self-heal Daemon on localhost               N/A       N/A        Y       7738 
Self-heal Daemon on 10.70.35.31             N/A       N/A        Y       1301 
Self-heal Daemon on 10.70.35.104            N/A       N/A        Y       23385
Self-heal Daemon on dhcp35-202.lab.eng.blr.
redhat.com                                  N/A       N/A        Y       12926
 
Task Status of Volume arbiter-vol
------------------------------------------------------------------------------
Task                 : Rebalance           
ID                   : ad76c0ac-1914-4df4-99d0-5bcb273beb65
Status               : not started        




Is this issue reproducible? If yes, share more details.:
-------------------------------------------------------------
yes


Actual results:
===============
The volume status shows rebalance as not started 
 
Expected results:
=================
The volume status should not show rebalance as not started 
 
[root@dhcp35-100 ~]# gluster v heal arbiter-vol info
Brick dhcp35-202.lab.eng.blr.redhat.com:/gluster/brick1/test-replace
Status: Connected
Number of entries: 0

Brick dhcp35-31.lab.eng.blr.redhat.com:/gluster/brick1/test
Status: Connected
Number of entries: 0

Brick dhcp35-104.lab.eng.blr.redhat.com:/gluster/brick1/test
Status: Connected
Number of entries: 0

Brick dhcp35-202.lab.eng.blr.redhat.com:/gluster/brick1/test-add
Status: Connected
Number of entries: 0

Brick dhcp35-31.lab.eng.blr.redhat.com:/gluster/brick1/test-add
Status: Connected
Number of entries: 0

Brick dhcp35-104.lab.eng.blr.redhat.com:/gluster/brick1/test-add
Status: Connected
Number of entries: 0



The issue is easily reproducible with or without IO's


Note You need to log in before you can comment on or make changes to this bug.