Bug 672896 - flood of pvs cmds can cause clvmd locking issues
Summary: flood of pvs cmds can cause clvmd locking issues
Keywords:
Status: CLOSED WORKSFORME
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: lvm2
Version: 6.0
Hardware: x86_64
OS: Linux
medium
medium
Target Milestone: rc
: ---
Assignee: LVM and device-mapper development team
QA Contact: Corey Marthaler
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-01-26 16:56 UTC by Corey Marthaler
Modified: 2011-09-20 21:09 UTC (History)
8 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2011-09-20 21:09:32 UTC
Target Upstream Version:


Attachments (Terms of Use)

Description Corey Marthaler 2011-01-26 16:56:20 UTC
Description of problem:
Test output:

====================================================================
   Iter 231 started at Tue Jan 25 21:05:08 CST 2011
====================================================================
VOLUME CREATION: stripe_9_8848, convert= snap=

Cleanup any existing lvm volumes
[...]

creating lvm devices...
Create 9 PV(s) for stripe_9_8848 on grant-01
Create VG stripe_9_8848 on grant-01
make needed LVs on grant-02
lvcreate -l 94149 --stripes 9 --stripesize 256 -n stripe_9_88480 stripe_9_8848
[...]

VOLUME DISPLAY of stripe_9_8848
Executing the display opt combinations for
        pvs
display operations either failed or timed out, check in /tmp/lvm_config.27423

From output file:
<start name="pvs_pv_pe_count_pv_used_0PT5" pid="27852" time="Tue Jan 25 21:05:49 2011" type="cmd" />
[pvs_pv_pe_count_pv_used_0PT5]   EOF reading CLVMD
[pvs_pv_pe_count_pv_used_0PT5]   Unable to obtain global lock.
<fail name="pvs_pv_pe_count_pv_used_0PT5" pid="27852" time="Tue Jan 25 21:05:49 2011" type="cmd" duration="0" ec="5" />
PAN2: ALL STOP!!!

Note that clvmd did not segfault like in bug 596260. It's still running on all nodes in the cluster.

[root@grant-01 ~]# service clvmd status
clvmd (pid  18888) is running...
Clustered Volume Groups: stripe_9_8848
Active clustered Logical Volumes: /dev/stripe_9_8848/stripe_9_88480

[root@grant-02 ~]# service clvmd status
clvmd (pid  9776) is running...
Clustered Volume Groups: stripe_9_8848
Active clustered Logical Volumes: /dev/stripe_9_8848/stripe_9_88480

[root@grant-03 ~]# service clvmd status
clvmd (pid  9809) is running...
Clustered Volume Groups: stripe_9_8848
Active clustered Logical Volumes: /dev/stripe_9_8848/stripe_9_88480



Version-Release number of selected component (if applicable):
2.6.32-71.el6.x86_64

lvm2-2.02.72-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
lvm2-libs-2.02.72-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
lvm2-cluster-2.02.72-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
udev-147-2.29.el6    BUILT: Tue Aug 31 16:44:10 CDT 2010
device-mapper-1.02.53-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
device-mapper-libs-1.02.53-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
device-mapper-event-1.02.53-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
device-mapper-event-libs-1.02.53-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010
cmirror-2.02.72-8.el6_0.4    BUILT: Thu Dec  9 09:46:33 CST 2010

Comment 1 Zdenek Kabelac 2011-01-27 16:15:10 UTC
Please can you attach logs for pvs -vvvv and   clvmd -d?

Comment 2 RHEL Program Management 2011-04-04 01:58:30 UTC
Since RHEL 6.1 External Beta has begun, and this bug remains
unresolved, it has been rejected as it is not proposed as
exception or blocker.

Red Hat invites you to ask your support representative to
propose this request, if appropriate and relevant, in the
next release of Red Hat Enterprise Linux.

Comment 4 Corey Marthaler 2011-09-20 21:09:32 UTC
QA has not seen this issue with any of the latest rpms, closing. Will reopen if seen again.

2.6.32-198.el6.x86_64

lvm2-2.02.87-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
lvm2-libs-2.02.87-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
lvm2-cluster-2.02.87-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
udev-147-2.38.el6    BUILT: Fri Sep  9 16:25:50 CDT 2011
device-mapper-1.02.66-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
device-mapper-libs-1.02.66-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
device-mapper-event-1.02.66-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
device-mapper-event-libs-1.02.66-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011
cmirror-2.02.87-2.1.el6    BUILT: Wed Sep 14 09:44:16 CDT 2011


Note You need to log in before you can comment on or make changes to this bug.