Bug 1279382

Summary: DHT: ls is listing same file twice (file which is failed in between rebalance migration)
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: RajeshReddy <rmekala>
Component: distributeAssignee: Nithya Balachandran <nbalacha>
Status: CLOSED WONTFIX QA Contact: storage-qa-internal <storage-qa-internal>
Severity: unspecified Docs Contact:
Priority: medium    
Version: rhgs-3.1CC: mzywusko, rgowdapp, rhs-bugs, spalai
Target Milestone: ---Keywords: ZStream
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: dht-rca-unknown, dht-failed-rebalance
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-03-27 08:43:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description RajeshReddy 2015-11-09 11:00:20 UTC
Description of problem:
==========
While during the file migration if rebalance fails in between file is getting displayed twice in the mount 


Version-Release number of selected component (if applicable):
==========
glusterfs-server-3.7.5-5.

How reproducible:


Steps to Reproduce:
1. Create 1x3 and mount it on client using fuse 
2. From the mount point create directory and 20k files, add 3 more bricks to the volume
3.Run the rebalance and while rebalance is going on bring down two of the source bricks 
4. Few files on source brick have Sticky bit (T) and mount shows same file twice 

Actual results:


Expected results:
===========
Mount should not show same file 


Additional info:
==========

[root@rhs-client19 ~]# gluster vol info afr_1x3
 
Volume Name: afr_1x3
Type: Distributed-Replicate
Volume ID: 299e6362-1e11-4ea4-ad11-f7ba0fee3ca8
Status: Started
Number of Bricks: 2 x 3 = 6
Transport-type: tcp
Bricks:
Brick1: rhs-client19.lab.eng.blr.redhat.com:/rhs/brick3/afr1x3
Brick2: rhs-client18.lab.eng.blr.redhat.com:/rhs/brick3/afr1x3
Brick3: rhs-client19.lab.eng.blr.redhat.com:/rhs/brick3/afr1x3_1
Brick4: rhs-client18.lab.eng.blr.redhat.com:/rhs/brick4/afr_1x3
Brick5: rhs-client19.lab.eng.blr.redhat.com:/rhs/brick4/afr_1x3
Brick6: rhs-client18.lab.eng.blr.redhat.com:/rhs/brick4/afr_1x3_1
Options Reconfigured:
cluster.rebal-throttle: lazy
features.scrub: Active
features.bitrot: on
cluster.self-heal-daemon: off
performance.readdir-ahead: on

[root@rhs-client18 ~]# ls -lrth /rhs/brick*/afr1x3/data | grep T
-rw-r-Sr-T. 2 root root  5 Nov  6 16:16 file2505
-rw-r-Sr-T. 2 root root  5 Nov  6 16:16 file2506
-rw-r-Sr-T. 2 root root  5 Nov  6 16:16 file2508
-rw-r-Sr-T. 2 root root 27 Nov  6 17:17 file2502

[root@rhs-client19 ~]# ls -lrth /rhs/brick*/afr1x3/data | grep T
-rw-r-Sr-T. 2 root root  5 Nov  6 16:42 file2505
-rw-r-Sr-T. 2 root root  5 Nov  6 16:42 file2506
-rw-r-Sr-T. 2 root root  5 Nov  6 16:42 file2508
-rw-r-Sr-T. 2 root root 27 Nov  6 17:42 file2502

From the mount point
=====================
[root@dht-rhs-23 data]# ls | grep file2506
file2506
file2506
[root@dht-rhs-23 data]# ls | grep file2508
file2508
file2508
[root@dht-rhs-23 data]# ls | grep file2502
file2502
file2502
[root@dht-rhs-23 data]# ls | grep file2505
file2505
file2505

Comment 2 RajeshReddy 2015-11-09 12:46:09 UTC
sos reports @ /home/repo/sosreports/bug.1279382 on rhsqe-repo.lab.eng.blr.redhat.com