Bug 1139677

Summary: File rename failed (I/O error) while "remove-brick commit" being performed on the volume
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Lalatendu Mohanty <lmohanty>
Component: distributionAssignee: Sayan Saha <ssaha>
Status: CLOSED WONTFIX QA Contact: storage-qa-internal <storage-qa-internal>
Severity: high Docs Contact:
Priority: unspecified    
Version: rhgs-3.0CC: dpal, nlevinki, rhs-bugs
Target Milestone: ---Keywords: ZStream
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-04-16 18:06:21 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
glusterlogs_from_samba_server_node
none
Samaba Server log none

Description Lalatendu Mohanty 2014-09-09 12:23:19 UTC
Description of problem:

When on the SMB mount point (Windows client) , rename operation was being performed on files, "remove-brick commit" operation caused failure for the rename operation.

The rename operations were done using Cygwin (application) in Windows7 client

e.g: mv old-file new-file, operation failed with below error

 for i in {2..1000}; do mv $file 2_${i}.docx; file="2_${i}.docx"; done
mv: cannot move ‘2_529.docx’ to a subdirectory of itself, ‘2_530.docx’
 


Version-Release number of selected component (if applicable):
samba-3.6.9-169.1.el6rhs.x86_64
glusterfs-server-3.6.0.28-1.el6rhs.x86_64

How reproducible:
Always

Steps to Reproduce:
1. Create a DHT volume, mount it on windows client, create ms office files on it
2. Perform add-brick and rebalance
3. Rename files in a loop. 
4. Perform remove-brick i.e. remove-brick start, status and once file migration is completed , perform remove-brick commit

Actual results:

Rename operation failed

Expected results:

Rename should not fail

Additional info:

From: glusterfs-testvol.10.70.35.48.log

[2014-09-09 11:50:59.986866] I [dht-rename.c:1345:dht_rename] 13-testvol-dht: renaming /rhsdata01/ms/2_527.docx (hash=testvol-client-1/cache=testvol-client-0) => /rhsdata01/ms/2_528.docx (hash=testvol-client-1/cache=<nul>)

[2014-09-09 11:51:14.324237] I [dht-rename.c:1345:dht_rename] 13-testvol-dht: renaming /rhsdata01/ms/2_528.docx (hash=testvol-client-1/cache=testvol-client-0) => /rhsdata01/ms/2_529.docx (hash=testvol-client-3/cache=<nul>)

[2014-09-09 11:51:14.324237] I [dht-rename.c:1345:dht_rename] 13-testvol-dht: renaming /rhsdata01/ms/2_528.docx (hash=testvol-client-1/cache=testvol-client-0) => /rhsdata01/ms/2_529.docx (hash=testvol-client-3/cache=<nul>)
[2014-09-09 11:51:20.142634] I [MSGID: 109030] [dht-rename.c:1292:dht_rename] 16-testvol-dht: No hashed subvolume in layout for path=/rhsdata01/ms/2_529.docx,(gfid = bfb762bc-4101-4027-a7e6-8f9634180a56)



# gluster v info
 
Volume Name: testvol
Type: Distribute
Volume ID: 2bfecc2a-7577-4ee8-866d-f60a25ac4b8c
Status: Started
Snap Volume: no
Number of Bricks: 5
Transport-type: tcp
Bricks:
Brick1: 10.70.40.140:/rhs/brick1/testvol-b1
Brick2: 10.70.40.141:/rhs/brick1/testvol-b2
Brick3: 10.70.36.252:/rhs/brick1/testvol-b3
Brick4: 10.70.36.252:/rhs/brick2/testvol-b4
Brick5: 10.70.36.252:/rhs/brick3/testvol-b5
Options Reconfigured:
performance.readdir-ahead: on
performance.stat-prefetch: off
server.allow-insecure: on
auto-delete: disable
snap-max-soft-limit: 90
snap-max-hard-limit: 256


# rpm -qa | grep glusterfs
glusterfs-api-3.6.0.28-1.el6rhs.x86_64
glusterfs-server-3.6.0.28-1.el6rhs.x86_64
glusterfs-libs-3.6.0.28-1.el6rhs.x86_64
glusterfs-3.6.0.28-1.el6rhs.x86_64
glusterfs-cli-3.6.0.28-1.el6rhs.x86_64
glusterfs-geo-replication-3.6.0.28-1.el6rhs.x86_64
glusterfs-fuse-3.6.0.28-1.el6rhs.x86_64
glusterfs-rdma-3.6.0.28-1.el6rhs.x86_64
samba-glusterfs-3.6.9-169.1.el6rhs.x86_64

# rpm -qa | grep samba
samba-winbind-clients-3.6.9-169.1.el6rhs.x86_64
samba-swat-3.6.9-169.1.el6rhs.x86_64
samba-doc-3.6.9-169.1.el6rhs.x86_64
samba-common-3.6.9-169.1.el6rhs.x86_64
samba-winbind-3.6.9-169.1.el6rhs.x86_64
samba-3.6.9-169.1.el6rhs.x86_64
samba-winbind-devel-3.6.9-169.1.el6rhs.x86_64
samba-domainjoin-gui-3.6.9-169.1.el6rhs.x86_64
samba-client-3.6.9-169.1.el6rhs.x86_64
samba-winbind-krb5-locator-3.6.9-169.1.el6rhs.x86_64
samba-glusterfs-3.6.9-169.1.el6rhs.x86_64

Comment 2 Lalatendu Mohanty 2014-09-09 12:41:50 UTC
Created attachment 935659 [details]
glusterlogs_from_samba_server_node

Comment 3 Lalatendu Mohanty 2014-09-09 12:43:24 UTC
Created attachment 935660 [details]
Samaba Server log