Bug 672896

Summary: flood of pvs cmds can cause clvmd locking issues
Product: Red Hat Enterprise Linux 6 Reporter: Corey Marthaler <cmarthal>
Component: lvm2Assignee: LVM and device-mapper development team <lvm-team>
Status: CLOSED WORKSFORME QA Contact: Corey Marthaler <cmarthal>
Severity: medium Docs Contact:
Priority: medium    
Version: 6.0CC: agk, dwysocha, heinzm, jbrassow, joe.thornber, mbroz, prockai, zkabelac
Target Milestone: rc   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2011-09-20 21:09:32 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Corey Marthaler 2011-01-26 16:56:20 UTC
Description of problem:
Test output:

====================================================================
   Iter 231 started at Tue Jan 25 21:05:08 CST 2011
====================================================================
VOLUME CREATION: stripe_9_8848, convert= snap=

Cleanup any existing lvm volumes
[...]

creating lvm devices...
Create 9 PV(s) for stripe_9_8848 on grant-01
Create VG stripe_9_8848 on grant-01
make needed LVs on grant-02
lvcreate -l 94149 --stripes 9 --stripesize 256 -n stripe_9_88480 stripe_9_8848
[...]

VOLUME DISPLAY of stripe_9_8848
Executing the display opt combinations for
        pvs
display operations either failed or timed out, check in /tmp/lvm_config.27423

From output file:
<start name="pvs_pv_pe_count_pv_used_0PT5" pid="27852" time="Tue Jan 25 21:05:49 2011" type="cmd" />
[pvs_pv_pe_count_pv_used_0PT5]   EOF reading CLVMD
[pvs_pv_pe_count_pv_used_0PT5]   Unable to obtain global lock.
<fail name="pvs_pv_pe_count_pv_used_0PT5" pid="27852" time="Tue Jan 25 21:05:49 2011" type="cmd" duration="0" ec="5" />
PAN2: ALL STOP!!!

Note that clvmd did not segfault like in bug 596260. It's still running on all nodes in the cluster.

[root@grant-01 ~]# service clvmd status
clvmd (pid  18888) is running...
Clustered Volume Groups: stripe_9_8848
Active clustered Logical Volumes: /dev/stripe_9_8848/stripe_9_88480

[root@grant-02 ~]# service clvmd status
clvmd (pid  9776) is running...
Clustered Volume Groups: stripe_9_8848
Active clustered Logical Volumes: /dev/stripe_9_8848/stripe_9_88480

[root@grant-03 ~]# service clvmd status
clvmd (pid  9809) is running...
Clustered Volume Groups: stripe_9_8848
Active clustered Logical Volumes: /dev/stripe_9_8848/stripe_9_88480



Version-Release number of selected component (if applicable):
2.6.32-71.el6.x86_64

lvm2-2.02.72-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
lvm2-libs-2.02.72-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
lvm2-cluster-2.02.72-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
udev-147-2.29.el6    BUILT: Tue Aug 31 16:44:10 CDT 2010
device-mapper-1.02.53-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
device-mapper-libs-1.02.53-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
device-mapper-event-1.02.53-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
device-mapper-event-libs-1.02.53-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
cmirror-2.02.72-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010

Comment 1 Zdenek Kabelac 2011-01-27 16:15:10 UTC
Please can you attach logs for pvs -vvvv and   clvmd -d?

Comment 2 RHEL Program Management 2011-04-04 01:58:30 UTC
Since RHEL 6.1 External Beta has begun, and this bug remains
unresolved, it has been rejected as it is not proposed as
exception or blocker.

Red Hat invites you to ask your support representative to
propose this request, if appropriate and relevant, in the
next release of Red Hat Enterprise Linux.

Comment 4 Corey Marthaler 2011-09-20 21:09:32 UTC
QA has not seen this issue with any of the latest rpms, closing. Will reopen if seen again.

2.6.32-198.el6.x86_64

lvm2-2.02.87-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
lvm2-libs-2.02.87-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
lvm2-cluster-2.02.87-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
udev-147-2.38.el6    BUILT: Fri Sep  9 16:25:50 CDT 2011
device-mapper-1.02.66-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
device-mapper-libs-1.02.66-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
device-mapper-event-1.02.66-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
device-mapper-event-libs-1.02.66-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
cmirror-2.02.87-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011