Bug 801332

Summary:	[5fdd65f5f4f5df1d28b0fb4f7efed226d5db1b3c] - After rebalance rm -rf on mountpoint gives errors
Product:	[Community] GlusterFS	Reporter:	M S Vishwanath Bhat <vbhat>
Component:	distribute	Assignee:	shishir gowda <sgowda>
Status:	CLOSED DUPLICATE	QA Contact:
Severity:	high	Docs Contact:
Priority:	high
Version:	pre-release	CC:	gluster-bugs, mzywusko, nsathyan, sgowda, vbellur
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2012-03-30 08:48:30 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description M S Vishwanath Bhat 2012-03-08 10:25:37 UTC

Description of problem:
After rebalance rm -rf on the mountpoint is giving 'Directory not empty errors'

Version-Release number of selected component (if applicable):
git master with head at 5fdd65f5f4f5df1d28b0fb4f7efed226d5db1b3c

How reproducible:
2/2

Steps to Reproduce:
1. Create and start a distribute volume.
2. Untar the linux kernel on the mountpoint.
3. Add one more brick and run rebalance.
4. Once the rebalance is completed run rm -rf * on the mountpoint.
  
Actual results:
I get errors like 

rm: cannot remove `kernel-source/linux-3.0.3/drivers/video/savage': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/firmware/dsp56k': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/firmware/radeon': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/fs/fuse': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/fs/lockd': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/fs/ocfs2/dlm': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/fs/romfs': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/fs/xfs/support': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/include/linux/decompress': Directory not empty
rm: cannot remove `kernel-source/linux-3.0.3/include/linux/isdn': Directory not empty


Expected results:
rm -rf * should succeed.

Additional info:

Entries from the client log.


[2012-03-08 05:03:26.592491] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-s5pc100/setup-i2c0.c on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.295951] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/barriers.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.296360] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/clkdev.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.297958] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/dma.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.298001] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/entry-macro.S on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.298032] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/gpio.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.298076] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/hardware.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.298108] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/kbc.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.298136] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/sdhci.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.298165] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/system.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:27.298221] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/arm/mach-tegra/include/mach/timex.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:30.180649] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/avr32/mm/cache.c on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:30.181269] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/avr32/mm/clear_page.S on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:30.181313] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/avr32/mm/copy_page.S on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:30.181362] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/avr32/mm/dma-coherent.c on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:30.181467] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/avr32/mm/init.c on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:30.181536] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/avr32/mm/tlb.c on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.037834] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/anomaly.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.038312] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/blackfin.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.038380] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/cdefBF534.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.038567] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/cdefBF537.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.038626] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/defBF537.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.038818] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/dma.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.038876] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/gpio.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.039055] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/irq.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.039113] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/blackfin/mach-bf537/include/mach/pll.h on hosdu-client-1 found to be not a linkfile (type=01)
[2012-03-08 05:03:31.633977] W [dht-common.c:4024:dht_rmdir_lookup_cbk] 1-hosdu-dht: /kernel-source/linux-3.0.3/arch/cris/arch-v32/drivers/mach-fs/nandflash.c on hosdu-client-1 found to be not a linkfile (type=01)


I have archived all the logs.

Comment 1 shishir gowda 2012-03-08 10:31:58 UTC

Can you do a remount and check if the issue still persists?

Comment 2 M S Vishwanath Bhat 2012-03-08 10:45:57 UTC

The issue still persists after the remount.

Comment 3 Amar Tumballi 2012-03-12 09:47:03 UTC

please update these bugs w.r.to 3.3.0qa27, need to work on it as per target milestone set.

Comment 4 M S Vishwanath Bhat 2012-03-15 14:52:55 UTC

I tried with qa28 and with git master at (5e50175f56d05ab6c1295b0e0f0c11695e49c277) The issue still persists, even after remount.

Comment 5 M S Vishwanath Bhat 2012-03-30 08:33:27 UTC

In the latest git master as of today morning (30-March-2012), I don't see the issue.

Comment 6 shishir gowda 2012-03-30 08:48:30 UTC


*** This bug has been marked as a duplicate of bug 807246 ***