This service will be undergoing maintenance at 00:00 UTC, 2017-10-23 It is expected to last about 30 minutes
Bug 1281525 - external origin raid volumes are not monitored
external origin raid volumes are not monitored
Status: POST
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: lvm2 (Show other bugs)
7.2
x86_64 Linux
unspecified Severity medium
: rc
: ---
Assigned To: Zdenek Kabelac
cluster-qe@redhat.com
:
Depends On:
Blocks: 1469559
  Show dependency treegraph
 
Reported: 2015-11-12 11:28 EST by Corey Marthaler
Modified: 2017-10-19 10:22 EDT (History)
9 users (show)

See Also:
Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed:
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)

  None (edit)
Description Corey Marthaler 2015-11-12 11:28:05 EST
Description of problem:
As a result device failures are not handled automatically. 


[root@host-109 ~]# lvs -a -o +devices
  LV                                      Attr       LSize   Pool Origin Data%  Meta% Cpy%Sync Devices
  POOL                                    twi-a-tz-- 500.00m             0.00   0.88           POOL_tdata(0)
  [POOL_tdata]                            Twi-ao---- 500.00m                                   /dev/sde1(127)
  [POOL_tmeta]                            ewi-ao----   4.00m                                   /dev/sde1(252)
  [lvol0_pmspare]                         ewi-------   4.00m                                   /dev/sde1(126)
  synced_primary_raid1_2legs_1            rwi-a-r--- 500.00m                          100.00   synced_primary_raid1_2legs_1_rimage_0(0),synced_primary_raid1_2legs_1_rimage_1(0),synced_primary_raid1_2legs_1_rimage_2(0)
  [synced_primary_raid1_2legs_1_rimage_0] iwi-aor--- 500.00m                                   /dev/sdg1(1)
  [synced_primary_raid1_2legs_1_rimage_1] iwi-aor--- 500.00m                                   /dev/sde1(1)
  [synced_primary_raid1_2legs_1_rimage_2] iwi-aor--- 500.00m                                   /dev/sdd1(1)
  [synced_primary_raid1_2legs_1_rmeta_0]  ewi-aor---   4.00m                                   /dev/sdg1(0)
  [synced_primary_raid1_2legs_1_rmeta_1]  ewi-aor---   4.00m                                   /dev/sde1(0)
  [synced_primary_raid1_2legs_1_rmeta_2]  ewi-aor---   4.00m                                   /dev/sdd1(0)

[root@host-109 ~]# lvconvert --thinpool black_bird/POOL --originname synced_primary_raid1_2legs_1_extorig -T synced_primary_raid1_2legs_1 --yes
  Logical volume "synced_primary_raid1_2legs_1_extorig" created.
  Converted black_bird/synced_primary_raid1_2legs_1 to thin volume with external origin black_bird/synced_primary_raid1_2legs_1_extorig.

[root@host-109 ~]# lvs -a -o +devices
  LV                                              Attr       LSize   Pool Origin                               Data%  Meta% Cpy%Sync Devices
  POOL                                            twi-aotz-- 500.00m                                           0.00   0.98           POOL_tdata(0)
  [POOL_tdata]                                    Twi-ao---- 500.00m                                                                 /dev/sde1(127)
  [POOL_tmeta]                                    ewi-ao----   4.00m                                                                 /dev/sde1(252)
  [lvol0_pmspare]                                 ewi-------   4.00m                                                                 /dev/sde1(126)
  synced_primary_raid1_2legs_1                    Vwi-a-tz-- 500.00m POOL synced_primary_raid1_2legs_1_extorig 0.0
  synced_primary_raid1_2legs_1_extorig            ori---r--- 500.00m                                                                 synced_primary_raid1_2legs_1_extorig_rimage_0(0),synced_primary_raid1_2legs_1_extorig_rimage_1(0),synced_primary_raid1_2legs_1_extorig_rimage_2(0)
  [synced_primary_raid1_2legs_1_extorig_rimage_0] Iwi-aor-r- 500.00m                                                                 /dev/sdg1(1)
  [synced_primary_raid1_2legs_1_extorig_rimage_1] Iwi-aor-r- 500.00m                                                                 /dev/sde1(1)
  [synced_primary_raid1_2legs_1_extorig_rimage_2] Iwi-aor-r- 500.00m                                                                 /dev/sdd1(1)
  [synced_primary_raid1_2legs_1_extorig_rmeta_0]  ewi-aor-r-   4.00m                                                                 /dev/sdg1(0)
  [synced_primary_raid1_2legs_1_extorig_rmeta_1]  ewi-aor-r-   4.00m                                                                 /dev/sde1(0)
  [synced_primary_raid1_2legs_1_extorig_rmeta_2]  ewi-aor-r-   4.00m                                                                 /dev/sdd1(0)


Nov 12 10:08:18 host-109 lvm[1240]: No longer monitoring RAID device black_bird-synced_primary_raid1_2legs_1 for events.



Version-Release number of selected component (if applicable):
3.10.0-327.el7.x86_64
lvm2-2.02.130-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
lvm2-libs-2.02.130-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
lvm2-cluster-2.02.130-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
device-mapper-1.02.107-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
device-mapper-libs-1.02.107-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
device-mapper-event-1.02.107-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
device-mapper-event-libs-1.02.107-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
device-mapper-persistent-data-0.5.5-1.el7    BUILT: Thu Aug 13 09:58:10 CDT 2015
cmirror-2.02.130-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
sanlock-3.2.4-1.el7    BUILT: Fri Jun 19 12:48:49 CDT 2015
sanlock-lib-3.2.4-1.el7    BUILT: Fri Jun 19 12:48:49 CDT 2015
lvm2-lockd-2.02.130-5.el7    BUILT: Wed Oct 14 08:27:29 CDT 2015
Comment 1 Corey Marthaler 2015-11-12 11:32:38 EST
[root@host-109 ~]# grep allocate /etc/lvm/lvm.conf 
            raid_fault_policy = "allocate"


A 'pvscan --cache' is required to even detect a failure...


Disabling device sdc on host-109.virt.lab.msp.redhat.com

Getting recovery check start time from /var/log/messages: Nov 12 09:41
Attempting I/O to cause mirror down conversion(s) on host-109.virt.lab.msp.redhat.com
dd if=/dev/zero of=/mnt/synced_primary_raid1_2legs_1/ddfile count=10 bs=4M
10+0 records in
10+0 records out
41943040 bytes (42 MB) copied, 0.0613936 s, 683 MB/s

rescan PVs
  /dev/sdc1: read failed after 0 of 4096 at 26838958080: Input/output error
  /dev/sdc1: read failed after 0 of 4096 at 26839048192: Input/output error
  /dev/sdc1: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdc1: read failed after 0 of 4096 at 4096: Input/output error

Current mirror/raid device structure(s):
  WARNING: Device for PV fj7JLI-3UcH-aFLI-DKKy-90hZ-342f-9zwEsg not found or rejected by a filter.
  LV                                              Attr       LSize   Cpy%Sync Devices
  POOL                                            twi-aotz-- 500.00m          POOL_tdata(0)
  [POOL_tdata]                                    Twi-ao---- 500.00m          /dev/sdd1(127)
  [POOL_tmeta]                                    ewi-ao----   4.00m          /dev/sdd1(252)
  [lvol0_pmspare]                                 ewi-------   4.00m          /dev/sdd1(126)
  snap1_synced_primary_raid1_2legs_1              Vwi-a-tzp- 500.00m
  snap2_synced_primary_raid1_2legs_1              Vwi-a-tzp- 500.00m
  snap3_synced_primary_raid1_2legs_1              Vwi-a-tzp- 500.00m
  synced_primary_raid1_2legs_1                    Vwi-aotzp- 500.00m
  synced_primary_raid1_2legs_1_extorig            ori---r-p- 500.00m          synced_primary_raid1_2legs_1_extorig_rimage_0(0),synced_primary_raid1_2legs_1_extorig_rimage_1(0),synced_primary_raid1_2legs_1_extorig_rimage_2(0)
  [synced_primary_raid1_2legs_1_extorig_rimage_0] Iwi-aor-p- 500.00m          unknown device(1)
  [synced_primary_raid1_2legs_1_extorig_rimage_1] Iwi-aor-r- 500.00m          /dev/sdd1(1)
  [synced_primary_raid1_2legs_1_extorig_rimage_2] Iwi-aor-r- 500.00m          /dev/sdg1(1)
  [synced_primary_raid1_2legs_1_extorig_rmeta_0]  ewi-aor-p-   4.00m          unknown device(0)
  [synced_primary_raid1_2legs_1_extorig_rmeta_1]  ewi-aor-r-   4.00m          /dev/sdd1(0)
  [synced_primary_raid1_2legs_1_extorig_rmeta_2]  ewi-aor-r-   4.00m          /dev/sdg1(0)

(ALLOCATE POLICY) there should not be an 'unknown' device associated with synced_primary_raid1_2legs_1_extorig_rimage_0 on host-109.virt.lab.msp.redhat.com

  synced_primary_raid1_2legs_1_extorig                     synced_primary_raid1_2legs_1_extorig_rimage_0(0),synced_primary_raid1_2legs_1_extorig_rimage_1(0),synced_primary_raid1_2legs_1_extorig_rimage_2(0)
   [synced_primary_raid1_2legs_1_extorig_rimage_0]          unknown device(1)
Comment 3 Jonathan Earl Brassow 2017-07-27 16:17:11 EDT
similar to bug 1280450, I suspect there is just something wrong with evaluating the type of LV (which is why sync % isn't printed right and why the LV isn't being monitored).
Comment 7 Zdenek Kabelac 2017-10-19 10:22:11 EDT
Fixed by upstream commit:

https://www.redhat.com/archives/lvm-devel/2017-October/msg00045.html

Note You need to log in before you can comment on or make changes to this bug.