RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 694164 - targets not resumed when creating multiple snapshots of mirrors
Summary: targets not resumed when creating multiple snapshots of mirrors
Keywords:
Status: CLOSED WORKSFORME
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: lvm2
Version: 6.1
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: rc
: ---
Assignee: LVM and device-mapper development team
QA Contact: Corey Marthaler
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-04-06 16:15 UTC by Nate Straz
Modified: 2011-09-06 18:36 UTC (History)
10 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2011-09-06 18:36:27 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
clvmd -d output during reproduction (14.51 KB, application/x-gzip)
2011-04-06 17:35 UTC, Nate Straz 		no flags Details
View All

Description Nate Straz 2011-04-06 16:15:45 UTC 
Description of problem:

The mirror_sanity scenario snaphot_exclusive_mirror hangs.  It attempts to create five snapshots of an exclusively activated cluster mirror but the third lvcreate hangs.  dmsetup info output shows that several devices are left in a suspended state.



Version-Release number of selected component (if applicable):
2.6.32-128.el6.x86_64

lvm2-2.02.83-3.el6    BUILT: Fri Mar 18 09:31:10 CDT 2011
lvm2-libs-2.02.83-3.el6    BUILT: Fri Mar 18 09:31:10 CDT 2011
lvm2-cluster-2.02.83-3.el6    BUILT: Fri Mar 18 09:31:10 CDT 2011
udev-147-2.35.el6    BUILT: Wed Mar 30 07:32:05 CDT 2011
device-mapper-1.02.62-3.el6    BUILT: Fri Mar 18 09:31:10 CDT 2011
device-mapper-libs-1.02.62-3.el6    BUILT: Fri Mar 18 09:31:10 CDT 2011
device-mapper-event-1.02.62-3.el6    BUILT: Fri Mar 18 09:31:10 CDT 2011
device-mapper-event-libs-1.02.62-3.el6    BUILT: Fri Mar 18 09:31:10 CDT 2011
cmirror-2.02.83-3.el6    BUILT: Fri Mar 18 09:31:10 CDT 2011


How reproducible:
easily

Steps to Reproduce:
lvcreate -m 1 -n exclusive_origin -L 100M mirror_sanity
lvchange -an /dev/mirror_sanity/exclusive_origin
lvchange -aye /dev/mirror_sanity/exclusive_origin
lvcreate -s mirror_sanity/exclusive_origin -n msnap_1 -L 20M
lvcreate -s mirror_sanity/exclusive_origin -n msnap_2 -L 20M
lvcreate -s mirror_sanity/exclusive_origin -n msnap_3 -L 20M  <-- hangs

Actual results:

 SCENARIO - [snaphot_exclusive_mirror]
 Snapshot an exclusively activated mirror
 buzz-01: lvcreate -m 1 -n exclusive_origin -L 100M mirror_sanity
 Deactivate and then exclusively activate mirror
 Taking multiple snapshots of exclusive mirror
        1 2 3   Error locking on node buzz-01: Command timed out
   Failed to suspend origin exclusive_origin
   Error locking on node buzz-01: Command timed out
   Attempt to drop cached metadata failed after reverted update for VG mirror_sanity.
   Error locking on node buzz-01: Command timed out
   Error locking on node buzz-01: Command timed out


[root@buzz-01 ~]# dmsetup info
Name:              mirror_sanity-msnap_2
State:             SUSPENDED
Read Ahead:        256
Tables present:    LIVE
Open count:        0
Event number:      0
Major, minor:      253, 10
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyu1BbbGrvMqVuOdQRuQJxupYP05yBXdJo

Name:              mirror_sanity-msnap_3-cow
State:             ACTIVE
Read Ahead:        256
Tables present:    LIVE
Open count:        1
Event number:      0
Major, minor:      253, 13
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyipNpM1jt8J0dC6L6O8UWgqF7GokXaRk2-cow

Name:              mirror_sanity-msnap_1
State:             SUSPENDED
Read Ahead:        256
Tables present:    LIVE
Open count:        0
Event number:      0
Major, minor:      253, 7
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyKsXBmpFgjrxz6TWxVuXmt6d9BhbjkcmD

Name:              mirror_sanity-exclusive_origin_mimage_1
State:             ACTIVE
Read Ahead:        256
Tables present:    LIVE
Open count:        1
Event number:      0
Major, minor:      253, 5
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMy9OXr1prrwVPscf5DWclfloAKBRfwKKzV

Name:              mirror_sanity-exclusive_origin_mimage_0
State:             ACTIVE
Read Ahead:        256
Tables present:    LIVE
Open count:        1
Event number:      0
Major, minor:      253, 4
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyAwD1WWxn1bt8kMNUYeBLrnegOQxOuHVE

Name:              mirror_sanity-msnap_1-cow
State:             ACTIVE
Read Ahead:        256
Tables present:    LIVE
Open count:        1
Event number:      0
Major, minor:      253, 9
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyKsXBmpFgjrxz6TWxVuXmt6d9BhbjkcmD-cow

Name:              mirror_sanity-exclusive_origin_mlog
State:             SUSPENDED
Read Ahead:        256
Tables present:    LIVE
Open count:        1
Event number:      0
Major, minor:      253, 3
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyYHQW6DNxDAINJw989Eel6hM8X5Zvapfw

Name:              mirror_sanity-exclusive_origin
State:             SUSPENDED
Read Ahead:        256
Tables present:    LIVE
Open count:        0
Event number:      0
Major, minor:      253, 6
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyReG9l74Dcqj0S69nYOYSnuLX6Ar2HUsL

Name:              mirror_sanity-exclusive_origin-real
State:             ACTIVE
Read Ahead:        256
Tables present:    LIVE
Open count:        4
Event number:      0
Major, minor:      253, 8
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyReG9l74Dcqj0S69nYOYSnuLX6Ar2HUsL-real

Name:              mirror_sanity-msnap_2-cow
State:             ACTIVE
Read Ahead:        256
Tables present:    LIVE
Open count:        1
Event number:      0
Major, minor:      253, 11
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyu1BbbGrvMqVuOdQRuQJxupYP05yBXdJo-cow

Name:              mirror_sanity-msnap_3
State:             ACTIVE
Read Ahead:        256
Tables present:    LIVE & INACTIVE
Open count:        0
Event number:      0
Major, minor:      253, 12
Number of targets: 1
UUID: LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyipNpM1jt8J0dC6L6O8UWgqF7GokXaRk2

[root@buzz-01 ~]# dmsetup table --target mirror
mirror_sanity-exclusive_origin-real: 0 204800 mirror userspace 4 LVM-9VZslOJx0ir7TWhvrbCpOc8deNDaMlMyYHQW6DNxDAINJw989Eel6hM8X5Zvapfw clustered-disk 253:3 1024 2 253:4 0 253:5 0 1 handle_errors



Expected results:


Additional info:
Comment 2 RHEL Program Management 2011-04-06 16:23:32 UTC 
Since RHEL 6.1 External Beta has begun, and this bug remains
unresolved, it has been rejected as it is not proposed as
exception or blocker.

Red Hat invites you to ask your support representative to
propose this request, if appropriate and relevant, in the
next release of Red Hat Enterprise Linux.
Comment 3 Nate Straz 2011-04-06 17:35:55 UTC 
Created attachment 490354 [details]
clvmd -d output during reproduction

I ran this through with debug on twice.  Once I typed the commands in by hand, which did not reproduce.  Then again by pasting all commands into the terminal, this did reproduce the hang.

The log contains all output from both runs with # comments between each stage.
Comment 4 Alasdair Kergon 2011-06-09 14:47:15 UTC 
should try to reproduce with upstream code to see if a recent fix helps
Comment 5 Corey Marthaler 2011-06-09 16:05:10 UTC 
Adding QA ack for 6.2. 

Devel will need to provide unit testing results however before this bug can be
ultimately verified by QA.
Comment 6 Tom Coughlan 2011-08-05 15:42:38 UTC 
Nate, are you able to re-try this with upstream code?
Comment 7 Nate Straz 2011-08-05 15:58:01 UTC 
No, I don't have the bandwidth to try this on upstream code.
Comment 8 Heinz Mauelshagen 2011-08-09 10:58:46 UTC 
Do we have test results with recent upstream code by now?
Comment 9 Peter Rajnoha 2011-08-25 10:42:15 UTC 
Is this reproducible with current 6.2 build (lvm2-2.02.87-1.el6)?
Comment 12 Corey Marthaler 2011-09-06 17:30:37 UTC 
It does not appear that this bug exists in the latest 6.2 rpms.

============================================================
Iteration 20 of 20 started at Tue Sep  6 12:25:28 CDT 2011
============================================================
SCENARIO - [snaphot_exclusive_mirror]
Snapshot an exclusively activated mirror
grant-03: lvcreate -m 1 -n exclusive_origin -L 100M mirror_sanity
Deactivate and then exclusively activate mirror
Taking multiple snapshots of exclusive mirror
        1 2 3 4 5 
Removing snapshots of exclusive mirror
        1 2 3 4 5 
Deactivating mirror exclusive_origin... and removing


2.6.32-192.el6.x86_64

lvm2-2.02.87-1.el6    BUILT: Fri Aug 12 06:11:57 CDT 2011
lvm2-libs-2.02.87-1.el6    BUILT: Fri Aug 12 06:11:57 CDT 2011
lvm2-cluster-2.02.87-1.el6    BUILT: Fri Aug 12 06:11:57 CDT 2011
udev-147-2.37.el6    BUILT: Wed Aug 10 07:48:15 CDT 2011
device-mapper-1.02.66-1.el6    BUILT: Fri Aug 12 06:11:57 CDT 2011
device-mapper-libs-1.02.66-1.el6    BUILT: Fri Aug 12 06:11:57 CDT 2011
device-mapper-event-1.02.66-1.el6    BUILT: Fri Aug 12 06:11:57 CDT 2011
device-mapper-event-libs-1.02.66-1.el6    BUILT: Fri Aug 12 06:11:57 CDT 2011
cmirror-2.02.87-1.el6    BUILT: Fri Aug 12 06:11:57 CDT 2011
Note You need to log in before you can comment on or make changes to this bug.