Bug 452121
| Summary: | cmirror fails to report fully synced after creation on one node in cluster | ||
|---|---|---|---|
| Product: | [Retired] Red Hat Cluster Suite | Reporter: | Corey Marthaler <cmarthal> |
| Component: | cmirror-kernel | Assignee: | Jonathan Earl Brassow <jbrassow> |
| Status: | CLOSED DEFERRED | QA Contact: | Cluster QE <mspqa-list> |
| Severity: | high | Docs Contact: | |
| Priority: | medium | ||
| Version: | 4 | CC: | cfeist, iannis |
| Target Milestone: | --- | ||
| Target Release: | --- | ||
| Hardware: | All | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2013-09-23 15:32:43 UTC | Type: | --- |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Attachments: | |||
|
Description
Corey Marthaler
2008-06-19 14:50:13 UTC
Created attachment 309850 [details]
log from taft-03
Hit this last night while attempting to reproduce bz 450939. Creating mirror(s) on taft-04... taft-04: lvcreate --corelog -m 1 -n syncd_primary_core_2legs_1 -L 800M helter_skelter /dev/sdf1:0-1000 /dev/sdh1:0-1000 taft-04: lvcreate --corelog -m 1 -n syncd_primary_core_2legs_2 -L 800M helter_skelter /dev/sdf1:0-1000 /dev/sdh1:0-1000 Waiting until all mirrors become fully syncd... 0/2 mirror(s) are fully synced: ( 1=11.00% 2=0.00% ) 0/2 mirror(s) are fully synced: ( 1=33.00% 2=22.00% ) 0/2 mirror(s) are fully synced: ( 1=53.50% 2=42.50% ) 0/2 mirror(s) are fully synced: ( 1=74.50% 2=63.50% ) 0/2 mirror(s) are fully synced: ( 1=95.50% 2=84.00% ) 2/2 mirror(s) are fully synced: ( 1=100.00% 2=100.00% ) syncd_primary_core_2legs_2 is not fully sync'ed on taft-01 (0.00%) [root@taft-01 ~]# lvs LV VG Attr LSize Origin Snap% Move Log Copy% Convert syncd_primary_core_2legs_1 helter_skelter mwi-a- 800.00M 100.00 syncd_primary_core_2legs_2 helter_skelter mwi-a- 800.00M 0.00 [root@taft-02 ~]# lvs LV VG Attr LSize Origin Snap% Move Log Copy% Convert syncd_primary_core_2legs_1 helter_skelter mwi-a- 800.00M 100.00 syncd_primary_core_2legs_2 helter_skelter mwi-a- 800.00M 100.00 [root@taft-03 ~]# lvs LV VG Attr LSize Origin Snap% Move Log Copy% Convert syncd_primary_core_2legs_1 helter_skelter mwi-a- 800.00M 100.00 syncd_primary_core_2legs_2 helter_skelter mwi-a- 800.00M 0.00 [root@taft-04 ~]# lvs LV VG Attr LSize Origin Snap% Move Log Copy% Convert syncd_primary_core_2legs_1 helter_skelter mwi-a- 800.00M 100.00 syncd_primary_core_2legs_2 helter_skelter mwi-a- 800.00M 100.00 Created attachment 310272 [details]
log (with extra debugging) from taft-03 when this happened
Created attachment 310273 [details]
log (with extra debugging) from taft-04 when this happened
Created attachment 310277 [details]
log (with extra debugging) from taft-01 when this happened
Created attachment 310279 [details]
log (with extra debugging) from taft-02 when this happened
Hit this after an upconvert.
Up converting linear(s) back to mirror(s) on taft-04...
taft-04: lvconvert --corelog -m 1 helter_skelter/nonsyncd_secondary_core_2legs_1
/dev/sde1:0-1000 /dev/sdf1:0-1000
taft-04: lvconvert --corelog -m 1 helter_skelter/nonsyncd_secondary_core_2legs_2
/dev/sde1:0-1000 /dev/sdf1:0-1000
[root@taft-01 sbin]# lvs
LV VG Attr LSize Origin Snap%
Move Log Copy% Convert
LogVol00 VolGroup00 -wi-ao 58.34G
LogVol01 VolGroup00 -wi-ao 9.75G
nonsyncd_secondary_core_2legs_1 helter_skelter mwi-ao 800.00M
100.00
nonsyncd_secondary_core_2legs_2 helter_skelter mwi-ao 800.00M
100.00
[root@taft-02 sbin]# lvs
LV VG Attr LSize Origin Snap%
Move Log Copy% Convert
LogVol00 VolGroup00 -wi-ao 58.34G
LogVol01 VolGroup00 -wi-ao 9.75G
nonsyncd_secondary_core_2legs_1 helter_skelter mwi-ao 800.00M
100.00
nonsyncd_secondary_core_2legs_2 helter_skelter mwi-ao 800.00M
0.00
[root@taft-03 sbin]# lvs
LV VG Attr LSize Origin Snap%
Move Log Copy% Convert
LogVol00 VolGroup00 -wi-ao 58.34G
LogVol01 VolGroup00 -wi-ao 9.75G
nonsyncd_secondary_core_2legs_1 helter_skelter mwi-ao 800.00M
100.00
nonsyncd_secondary_core_2legs_2 helter_skelter mwi-ao 800.00M
0.00
[root@taft-04 sbin]# lvs
LV VG Attr LSize Origin Snap%
Move Log Copy% Convert
LogVol00 VolGroup00 -wi-ao 58.34G
LogVol01 VolGroup00 -wi-ao 9.75G
nonsyncd_secondary_core_2legs_1 helter_skelter mwi-ao 800.00M
100.00
nonsyncd_secondary_core_2legs_2 helter_skelter mwi-ao 800.00M
0.00
These are the only "odd" messages during this failure, on taft-01 (the only node that reports the 2nd mirror as 100%): dm-cmirror: Told to clear recovery on wrong region 0/18446744073709551615 dm-cmirror: Unable to notify server of sync state change dm-cmirror: Told to clear recovery on wrong region 0/18446744073709551615 dm-cmirror: Unable to notify server of sync state change dm-cmirror: Told to clear recovery on wrong region 0/18446744073709551615 dm-cmirror: Unable to notify server of sync state change dm-cmirror: Told to clear recovery on wrong region 0/18446744073709551615 dm-cmirror: Unable to notify server of sync state change dm-cmirror: Told to clear recovery on wrong region 0/18446744073709551615 dm-cmirror: Unable to notify server of sync state change FWIW, this issue still exists and continues to cause basic cmirror regression tests to fail. 2.6.9-94.ELsmp lvm2-2.02.42-9.el4 BUILT: Thu Oct 21 15:49:57 CDT 2010 lvm2-cluster-2.02.42-9.el4 BUILT: Thu Oct 21 15:46:55 CDT 2010 device-mapper-1.02.28-3.el4 BUILT: Thu Mar 4 14:48:16 CST 2010 cmirror-1.0.2-1.el4 BUILT: Thu Feb 26 15:29:27 CST 2009 cmirror-kernel-2.6.9-43.14.el4 BUILT: Wed Dec 22 16:24:19 CST 2010 The Red Hat Cluster Suite product is past end-of-life; closing. |