Bug 765383 (GLUSTER-3651)

Summary:	[glusterfs-3.3.0qa11]: blocked locks in glusterfs server
Product:	[Community] GlusterFS	Reporter:	Raghavendra Bhat <rabhat>
Component:	locks	Assignee:	Pranith Kumar K <pkarampu>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Raghavendra Bhat <rabhat>
Severity:	high	Docs Contact:
Priority:	medium
Version:	pre-release	CC:	gluster-bugs, ujjwala, vijay
Target Milestone:	---
Target Release:	---
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:	glusterfs-3.4.0	Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2013-07-24 17:56:20 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:	glusterfs-3.3.0	Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	817967

Description Raghavendra Bhat 2011-09-28 05:50:14 UTC

Setup:
2 replica setup

1 fuse and 1 nfs client
 fuse client was executing iozone, brought a brick down, slept and then woke up the brick.

iozone hung and there are blocked locks in the server statedump on the iozoe.tmp file.

[xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1]
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.gfid=11867dc4-58e4-49c5-8e62-4208447f4feb
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.nlookup=1840
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.ref=7
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.ino=-756968973
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.ia_type=1
xlator.feature.locks.inode.-756968973.mandatory=0
xlator.feature.locks.entrylk-count.-756968973.entrylk-count=0
xlator.feature.locks.lock-dump.domain.domain=mirror-replicate-0
xlator.feature.locks.inodelk-count.-756968973.inodelk-count=4
xlator.feature.locks.lock-dump.domain.domain=mirror-replicate-0
xlator.feature.locks.lock-dump.domain.inodelk.inodelk[0](ACTIVE)=type=WRITE, start=16646144, len=131072, pid=0, lk-owner=139932939484664, tran
sport=0x1ce08ec0
xlator.feature.locks.lock-dump.domain.inodelk.inodelk[1](ACTIVE)=type=WRITE, start=0, len=4096, pid=0, lk-owner=139932939487508, transport=0x1
ce08ec0
xlator.feature.locks.lock-dump.domain.inodelk.inodelk[2](BLOCKED)=type=WRITE, start=0, len=0, pid=0, lk-owner=139932939487824, transport=0x1ce08ec0
xlator.feature.locks.lock-dump.domain.inodelk.inodelk[3](BLOCKED)=type=WRITE, start=0, len=0, pid=0, lk-owner=139932939484664, transport=0x1ce08ec0
xlator.feature.locks.posixlk-count.-756968973.posixlk-count=0


[xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1]
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.gfid=11867dc4-58e4-49c5-8e62-4208447f4feb
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.nlookup=1854
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.ref=5
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.ino=-756968973
xlator.protocol.server.conn.1.bound_xl./export/mirror.active.1.ia_type=1
xlator.feature.locks.inode.-756968973.mandatory=0
xlator.feature.locks.entrylk-count.-756968973.entrylk-count=0
xlator.feature.locks.lock-dump.domain.domain=mirror-replicate-0
xlator.feature.locks.inodelk-count.-756968973.inodelk-count=3
xlator.feature.locks.lock-dump.domain.domain=mirror-replicate-0
xlator.feature.locks.lock-dump.domain.inodelk.inodelk[0](ACTIVE)=type=WRITE, start=16646144, len=131072, pid=0, lk-owner=139932939484664, tran
sport=0x237eb4e0
xlator.feature.locks.lock-dump.domain.inodelk.inodelk[1](BLOCKED)=type=WRITE, start=0, len=0, pid=0, lk-owner=139932939485928, transport=0x237eb4e0
xlator.feature.locks.lock-dump.domain.inodelk.inodelk[2](BLOCKED)=type=WRITE, start=0, len=4096, pid=0, lk-owner=139932939487508, transport=0x237eb4e0
xlator.feature.locks.posixlk-count.-756968973.posixlk-count=0


getfattr -d -m . -e hex /export/mirror/playground/iozone.tmp
getfattr: Removing leading '/' from absolute path names
# file: export/mirror/playground/iozone.tmp
trusted.afr.mirror-client-0=0x000000000000000000000000
trusted.afr.mirror-client-1=0x000000000000000000000000
trusted.gfid=0x11867dc458e449c58e624208447f4feb


 getfattr -d -m . -e hex /export/mirror/playground/iozone.tmp
getfattr: Removing leading '/' from absolute path names
# file: export/mirror/playground/iozone.tmp
trusted.afr.mirror-client-0=0x000000000000000100000000
trusted.afr.mirror-client-1=0x000000000000000000000000
trusted.gfid=0x11867dc458e449c58e624208447f4feb

Comment 1 Pranith Kumar K 2012-06-11 11:19:01 UTC

Many patches in inodelk-bugs went in and this is not observed anymore. Moving it to modified state. Please re-open if you find again.

Comment 2 Raghavendra Bhat 2012-06-12 10:14:14 UTC

With glusterfs-3.3.0 its not observed. Ran ping_pong from 2 clients and it did  not hang.