Description of problem: Even with use_lvmetad=1 , pvcreate should bypass lvmetad, to catch and prevent issues arising out of incorrect cluster configurations where lvmetad is left enabled. For example, on 7.6 we can see this bad cluster configuration allows adding the same storage to different volume groups on different servers. #### RHEL 7.6 #### CONCLUSION: I am able to add one PV in two diferent VG. No error reported on second cluster node when same device added in differnt VG. TEST STEPS: I will try to add mpathd in two different VGs keeping lvmetad enabled. # CURRENT STATUS # - Current LVM device status (same on all cluster nodes): [root@clust-node1 ~]# vgs -ao+UUID VG #PV #LV #SN Attr VSize VFree VG UUID myvg 1 1 0 wz--n- 1020.00m 0 Eizu7J-5aZy-abGp-9gPT-4XQB-Dgtg-eVlvhl myvg1 1 1 0 wz--n- 1020.00m 0 tOR9o3-xiys-ZGTY-kB26-MxqL-6r5Z-HVer8i rhel 1 2 0 wz--n- 9.51g 40.00m Kr5TIy-2aP9-7Mvd-jECQ-ihub-vABR-NmO1Ri [root@clust-node1 ~]# lvs -ao+UUID LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert LV UUID mylv myvg -wi-ao---- 1020.00m amWg6N-kmJH-BU1Q-zbKK-1VoU-vFU6-Z2Tgge mylv1 myvg1 -wi------- 1020.00m 0i4lMU-2fNk-hBbI-KSOj-NZAO-OUQW-xdf82B root rhel -wi-ao---- 8.47g RBXRRO-Nk3l-IrhJ-sGe9-YWAI-rEIm-SjJEEj swap rhel -wi-ao---- 1.00g tK33Dn-yK1m-hU3p-yzx1-Ap3S-TJCL-8TqITl [root@clust-node1 ~]# pvs -o+UUID PV VG Fmt Attr PSize PFree PV UUID /dev/sda2 rhel lvm2 a-- 9.51g 40.00m ROQByT-EHhx-z7Kv-dgmH-eDUe-DdX2-lRsUYs /dev/vda1 myvg lvm2 a-- 1020.00m 0 6tSgXm-9pd1-dAPz-C2cj-vX5L-gpJK-WpGU9z /dev/vda2 myvg1 lvm2 a-- 1020.00m 0 4wQnSx-o2cN-ErSW-H1rj-Oi5E-bFBt-lJT4DU [root@clust-node1 ~]# [root@clust-node2 ~]# vgs -ao+UUID VG #PV #LV #SN Attr VSize VFree VG UUID myvg 1 1 0 wz--n- 1020.00m 0 Eizu7J-5aZy-abGp-9gPT-4XQB-Dgtg-eVlvhl myvg1 1 1 0 wz--n- 1020.00m 0 tOR9o3-xiys-ZGTY-kB26-MxqL-6r5Z-HVer8i rhel 1 2 0 wz--n- 9.51g 40.00m o4pIKX-cYFH-AKdF-q3R4-Qjay-Td3x-ZIxqo0 [root@clust-node2 ~]# lvs -ao+UUID LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert LV UUID mylv myvg -wi------- 1020.00m amWg6N-kmJH-BU1Q-zbKK-1VoU-vFU6-Z2Tgge mylv1 myvg1 -wi-ao---- 1020.00m 0i4lMU-2fNk-hBbI-KSOj-NZAO-OUQW-xdf82B root rhel -wi-ao---- 8.47g 1fAIAP-XO8H-phK6-8cNY-rmw2-RExF-fHP9uU swap rhel -wi-ao---- 1.00g 0gWvr1-ZQnl-NoBb-EDVx-Wfli-jR5u-BVWwQM [root@clust-node2 ~]# pvs -o+UUID PV VG Fmt Attr PSize PFree PV UUID /dev/sda2 rhel lvm2 a-- 9.51g 40.00m hR0rLp-UbbA-1w1o-aGeW-Ymeh-nQsh-kIpKRZ /dev/vda1 myvg lvm2 a-- 1020.00m 0 6tSgXm-9pd1-dAPz-C2cj-vX5L-gpJK-WpGU9z /dev/vda2 myvg1 lvm2 a-- 1020.00m 0 4wQnSx-o2cN-ErSW-H1rj-Oi5E-bFBt-lJT4DU [root@clust-node2 ~]# - Multipath device status: [root@clust-node1 ~]# multipath -ll mpathd (3600140592086e2fe9d947b48c119409f) dm-2 LIO-ORG ,3node size=1.0G features='0' hwhandler='0' wp=rw `-+- policy='service-time 0' prio=1 status=active |- 15:0:0:0 sdd 8:48 active ready running `- 14:0:0:0 sdb 8:16 active ready running mpathc (360014058285a0163e2843a1aad199e78) dm-3 LIO-ORG ,3node_gfs size=1.0G features='0' hwhandler='0' wp=rw `-+- policy='service-time 0' prio=1 status=active |- 15:0:0:1 sde 8:64 active ready running `- 14:0:0:1 sdc 8:32 active ready running [root@clust-node1 ~]# [root@clust-node2 ~]# multipath -ll mpathe (3600140592086e2fe9d947b48c119409f) dm-2 LIO-ORG ,3node size=1.0G features='0' hwhandler='0' wp=rw `-+- policy='service-time 0' prio=1 status=active |- 10:0:0:0 sdb 8:16 active ready running `- 11:0:0:0 sdc 8:32 active ready running mpathc (360014058285a0163e2843a1aad199e78) dm-3 LIO-ORG ,3node_gfs size=1.0G features='0' hwhandler='0' wp=rw `-+- policy='service-time 0' prio=1 status=active |- 10:0:0:1 sdd 8:48 active ready running `- 11:0:0:1 sde 8:64 active ready running [root@clust-node2 ~]# - lvmetad status: [root@clust-node1 ~]# cat /etc/lvm/lvm.conf | egrep 'volume_list|use_lvmetad|filter|locking_type' | grep -v "#" locking_type = 1 use_lvmetad = 1 volume_list = [ "rhel" ] [root@clust-node1 ~]# systemctl status lvm2-lvmetad ● lvm2-lvmetad.service - LVM2 metadata daemon Loaded: loaded (/usr/lib/systemd/system/lvm2-lvmetad.service; static; vendor preset: enabled) Active: active (running) since Mon 2020-05-04 13:01:03 IST; 17min ago Docs: man:lvmetad(8) Main PID: 568 (lvmetad) Tasks: 1 CGroup: /system.slice/lvm2-lvmetad.service └─568 /usr/sbin/lvmetad -f May 04 13:01:03 clust-node1 systemd[1]: Started LVM2 metadata daemon. [root@clust-node1 ~]# [root@clust-node2 ~]# cat /etc/lvm/lvm.conf | egrep 'volume_list|use_lvmetad|filter|locking_type' | grep -v "#" locking_type = 1 use_lvmetad = 1 volume_list = [ "rhel" ] [root@clust-node2 ~]# systemctl status lvm2-lvmetad ● lvm2-lvmetad.service - LVM2 metadata daemon Loaded: loaded (/usr/lib/systemd/system/lvm2-lvmetad.service; static; vendor preset: enabled) Active: active (running) since Mon 2020-05-04 13:01:04 IST; 17min ago Docs: man:lvmetad(8) Main PID: 566 (lvmetad) Tasks: 1 CGroup: /system.slice/lvm2-lvmetad.service └─566 /usr/sbin/lvmetad -f May 04 13:01:04 clust-node2 systemd[1]: Started LVM2 metadata daemon. [root@clust-node2 ~]# - Package version (same on all the cluster nodes): device-mapper-multipath-0.4.9-123.el7.x86_64 device-mapper-multipath-libs-0.4.9-123.el7.x86_64 kernel-3.10.0-693.21.1.el7.x86_64 kernel-3.10.0-862.14.4.el7.x86_64 kernel-3.10.0-957.27.2.el7.x86_64 kernel-tools-3.10.0-957.27.2.el7.x86_64 kernel-tools-libs-3.10.0-957.27.2.el7.x86_64 lvm2-2.02.180-10.el7_6.8.x86_64 lvm2-cluster-2.02.180-10.el7_6.8.x86_64 lvm2-libs-2.02.180-10.el7_6.8.x86_64 [root@clust-node1 ~]# ** Starting the test now to add mpathd in two separate VGs ** [root@clust-node1 ~]# pvcreate /dev/mapper/mpathd Physical volume "/dev/mapper/mpathd" successfully created. [root@clust-node1 ~]# vgextend myvg /dev/mapper/mpathd Volume group "myvg" successfully extended [root@clust-node1 ~]# lvextend myvg/mylv -l+100%FREE Size of logical volume myvg/mylv changed from 1020.00 MiB (255 extents) to 1.99 GiB (510 extents). Logical volume myvg/mylv successfully resized. [root@clust-node1 ~]# xfs_growfs /mnt/ meta-data=/dev/mapper/myvg-mylv isize=512 agcount=4, agsize=65280 blks = sectsz=512 attr=2, projid32bit=1 = crc=1 finobt=0 spinodes=0 data = bsize=4096 blocks=261120, imaxpct=25 = sunit=0 swidth=0 blks naming =version 2 bsize=4096 ascii-ci=0 ftype=1 log =internal bsize=4096 blocks=855, version=2 = sectsz=512 sunit=0 blks, lazy-count=1 realtime =none extsz=4096 blocks=0, rtextents=0 data blocks changed from 261120 to 522240 [root@clust-node1 ~]# df -Th /dev/mapper/myvg-mylv Filesystem Type Size Used Avail Use% Mounted on /dev/mapper/myvg-mylv xfs 2.0G 33M 2.0G 2% /mnt [root@clust-node1 ~]# cd /mnt/ [root@clust-node1 mnt]# touch testing [root@clust-node1 mnt]# - Same device mpathe added in a different VGs: [root@clust-node2 ~]# pvcreate /dev/mapper/mpathe Physical volume "/dev/mapper/mpathe" successfully created. [root@clust-node2 ~]# vgextend myvg1 /dev/mapper/mpathe Volume group "myvg1" successfully extended [root@clust-node2 ~]# lvextend myvg1/mylv1 -l+100%FREE Size of logical volume myvg1/mylv1 changed from 1020.00 MiB (255 extents) to 1.99 GiB (510 extents). Logical volume myvg1/mylv1 successfully resized. [root@clust-node2 ~]# xfs_growfs /mnt/ meta-data=/dev/mapper/myvg1-mylv1 isize=512 agcount=4, agsize=65280 blks = sectsz=512 attr=2, projid32bit=1 = crc=1 finobt=0 spinodes=0 data = bsize=4096 blocks=261120, imaxpct=25 = sunit=0 swidth=0 blks naming =version 2 bsize=4096 ascii-ci=0 ftype=1 log =internal bsize=4096 blocks=855, version=2 = sectsz=512 sunit=0 blks, lazy-count=1 realtime =none extsz=4096 blocks=0, rtextents=0 data blocks changed from 261120 to 522240 [root@clust-node2 ~]# df -Th /dev/mapper/myvg1-mylv1 Filesystem Type Size Used Avail Use% Mounted on /dev/mapper/myvg1-mylv1 xfs 2.0G 33M 2.0G 2% /mnt [root@clust-node2 ~]# cd /mnt/ [root@clust-node2 mnt]# touch test [root@clust-node2 mnt]# - Output for 'pvscan --cache -vvv' from both nodes: [root@clust-node1 ~]# pvscan --cache -vvv Parsing: pvscan --cache -vvv Recognised command pvscan_cache (id 107 / enum 88). devices/global_filter not found in config: defaulting to global_filter = [ "a|.*/|" ] global/lvmetad_update_wait_time not found in config: defaulting to 10 /run/lvm/lvmetad.socket: Opening daemon socket to lvmetad for protocol lvmetad version 1. Sending daemon lvmetad: hello Successfully connected to lvmetad on fd 3. Sysfs filter initialised. Internal filter initialised. LVM type filter initialised. Usable device filter initialised. mpath filter initialised. Partitioned filter initialised. MD filter initialised. Composite filter initialised. devices/filter not found in config: defaulting to filter = [ "a|.*/|" ] Regex filter initialised. Usable device filter initialised. Composite filter initialised. devices/cache not found in config: defaulting to /etc/lvm/cache/.cache Persistent filter initialised. Composite filter initialised. metadata/record_lvs_history not found in config: defaulting to 0 DEGRADED MODE. Incomplete RAID LVs will be processed. Processing command: pvscan --cache -vvv Command pid: 12607 System ID: O_DIRECT will be used File-based locking selected. Preparing SELinux context for /run/lock/lvm to system_u:object_r:lvm_lock_t:s0. Resetting SELinux context to default value. Locking /run/lock/lvm/P_global RB Preparing SELinux context for /run/lock/lvm/P_global to system_u:object_r:lvm_lock_t:s0. _do_flock /run/lock/lvm/P_global:aux WB _undo_flock /run/lock/lvm/P_global:aux _do_flock /run/lock/lvm/P_global RB Resetting SELinux context to default value. Scanning all devices. Sending lvmetad get_global_info Sending lvmetad token_update update in progress Scanning all devices to initialize lvmetad. Finding devices to scan Creating list of system devices. Found dev 8:0 /dev/sda - new. Found dev 8:0 /dev/disk/by-id/ata-QEMU_HARDDISK_QM00001 - new alias. Found dev 8:0 /dev/disk/by-path/pci-0000:00:01.1-ata-1.0 - new alias. Found dev 8:1 /dev/sda1 - new. Found dev 8:1 /dev/disk/by-id/ata-QEMU_HARDDISK_QM00001-part1 - new alias. Found dev 8:1 /dev/disk/by-path/pci-0000:00:01.1-ata-1.0-part1 - new alias. Found dev 8:1 /dev/disk/by-uuid/4b5a8149-f612-409d-82b7-95ba6342c6dc - new alias. Found dev 8:2 /dev/sda2 - new. Found dev 8:2 /dev/disk/by-id/ata-QEMU_HARDDISK_QM00001-part2 - new alias. Found dev 8:2 /dev/disk/by-id/lvm-pv-uuid-ROQByT-EHhx-z7Kv-dgmH-eDUe-DdX2-lRsUYs - new alias. Found dev 8:2 /dev/disk/by-path/pci-0000:00:01.1-ata-1.0-part2 - new alias. Found dev 11:0 /dev/sr0 - new. Found dev 11:0 /dev/cdrom - new alias. Found dev 11:0 /dev/disk/by-id/ata-QEMU_DVD-ROM_QM00002 - new alias. Found dev 11:0 /dev/disk/by-path/pci-0000:00:01.1-ata-1.1 - new alias. Found dev 252:0 /dev/vda - new. Found dev 252:0 /dev/disk/by-path/pci-0000:00:09.0 - new alias. Found dev 252:0 /dev/disk/by-path/virtio-pci-0000:00:09.0 - new alias. Found dev 252:1 /dev/vda1 - new. Found dev 252:1 /dev/disk/by-id/lvm-pv-uuid-6tSgXm-9pd1-dAPz-C2cj-vX5L-gpJK-WpGU9z - new alias. Found dev 252:1 /dev/disk/by-path/pci-0000:00:09.0-part1 - new alias. Found dev 252:1 /dev/disk/by-path/virtio-pci-0000:00:09.0-part1 - new alias. Found dev 252:2 /dev/vda2 - new. Found dev 252:2 /dev/disk/by-id/lvm-pv-uuid-4wQnSx-o2cN-ErSW-H1rj-Oi5E-bFBt-lJT4DU - new alias. Found dev 252:2 /dev/disk/by-path/pci-0000:00:09.0-part2 - new alias. Found dev 252:2 /dev/disk/by-path/virtio-pci-0000:00:09.0-part2 - new alias. Found dev 8:16 /dev/sdb - new. Found dev 8:16 /dev/disk/by-id/scsi-3600140592086e2fe9d947b48c119409f - new alias. Found dev 8:16 /dev/disk/by-id/wwn-0x600140592086e2fe9d947b48c119409f - new alias. Found dev 8:16 /dev/disk/by-path/ip-192.168.10.80:3260-iscsi-iqn.2018-07.csb.pnq:3node-lun-0 - new alias. Found dev 8:32 /dev/sdc - new. Found dev 8:32 /dev/disk/by-id/scsi-360014058285a0163e2843a1aad199e78 - new alias. Found dev 8:32 /dev/disk/by-id/wwn-0x60014058285a0163e2843a1aad199e78 - new alias. Found dev 8:32 /dev/disk/by-path/ip-192.168.10.80:3260-iscsi-iqn.2018-07.csb.pnq:3node-lun-1 - new alias. Found dev 8:48 /dev/sdd - new. Found dev 8:16 /dev/disk/by-id/scsi-3600140592086e2fe9d947b48c119409f - exists. Found dev 8:16 /dev/disk/by-id/wwn-0x600140592086e2fe9d947b48c119409f - exists. Found dev 8:48 /dev/disk/by-path/ip-192.168.20.80:3260-iscsi-iqn.2018-07.csb.pnq:3node-lun-0 - new alias. Found dev 8:64 /dev/sde - new. Found dev 8:32 /dev/disk/by-id/scsi-360014058285a0163e2843a1aad199e78 - exists. Found dev 8:32 /dev/disk/by-id/wwn-0x60014058285a0163e2843a1aad199e78 - exists. Found dev 8:64 /dev/disk/by-path/ip-192.168.20.80:3260-iscsi-iqn.2018-07.csb.pnq:3node-lun-1 - new alias. Found dev 253:0 /dev/dm-0 - new. Found dev 253:0 /dev/disk/by-id/dm-name-rhel-root - new alias. Found dev 253:0 /dev/disk/by-id/dm-uuid-LVM-Kr5TIy2aP97MvdjECQihubvABRNmO1RiRBXRRONk3lIrhJsGe9YWAIrEImSjJEEj - new alias. Found dev 253:0 /dev/disk/by-uuid/c09482f4-5c18-48b7-bf75-b76ff038d9c7 - new alias. Found dev 253:0 /dev/mapper/rhel-root - new alias. Found dev 253:0 /dev/rhel/root - new alias. Found dev 253:1 /dev/dm-1 - new. Found dev 253:1 /dev/disk/by-id/dm-name-rhel-swap - new alias. Found dev 253:1 /dev/disk/by-id/dm-uuid-LVM-Kr5TIy2aP97MvdjECQihubvABRNmO1RitK33DnyK1mhU3pyzx1Ap3STJCL8TqITl - new alias. Found dev 253:1 /dev/disk/by-uuid/1dd59421-cb9b-45e4-b1b2-95528326f7a2 - new alias. Found dev 253:1 /dev/mapper/rhel-swap - new alias. Found dev 253:1 /dev/rhel/swap - new alias. Found dev 253:2 /dev/dm-2 - new. Found dev 253:2 /dev/disk/by-id/dm-name-mpathd - new alias. Found dev 253:2 /dev/disk/by-id/dm-uuid-mpath-3600140592086e2fe9d947b48c119409f - new alias. Found dev 253:2 /dev/disk/by-id/lvm-pv-uuid-hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI - new alias. Found dev 253:2 /dev/mapper/mpathd - new alias. Found dev 253:3 /dev/dm-3 - new. Found dev 253:3 /dev/disk/by-id/dm-name-mpathc - new alias. Found dev 253:3 /dev/disk/by-id/dm-uuid-mpath-360014058285a0163e2843a1aad199e78 - new alias. Found dev 253:3 /dev/mapper/mpathc - new alias. Found dev 253:4 /dev/dm-4 - new. Found dev 253:4 /dev/disk/by-id/dm-name-myvg-mylv - new alias. Found dev 253:4 /dev/disk/by-id/dm-uuid-LVM-Eizu7J5aZyabGp9gPT4XQBDgtgeVlvhlamWg6NkmJHBU1QzbKK1VoUvFU6Z2Tgge - new alias. Found dev 253:4 /dev/disk/by-uuid/0cb4c830-280b-44d0-adc3-60ed3c929b6f - new alias. Found dev 253:4 /dev/mapper/myvg-mylv - new alias. Found dev 253:4 /dev/myvg/mylv - new alias. Opened /dev/sda RO O_DIRECT /dev/sda: size is 20971520 sectors Closed /dev/sda filter partitioned deferred /dev/sda filter md deferred /dev/sda filter caching good /dev/sda /dev/cdrom: Skipping: Unrecognised LVM device type 11 Opened /dev/vda RO O_DIRECT /dev/vda: size is 4194304 sectors Closed /dev/vda filter partitioned deferred /dev/vda filter md deferred /dev/vda filter caching good /dev/vda dm version [ opencount flush ] [16384] (*1) dm status (253:0) [ noopencount noflush ] [16384] (*1) Opened /dev/rhel/root RO O_DIRECT /dev/rhel/root: size is 17760256 sectors Closed /dev/rhel/root filter partitioned deferred /dev/rhel/root filter md deferred /dev/rhel/root dm status (253:0) [ noopencount noflush ] [16384] (*1) filter caching good /dev/rhel/root Opened /dev/sda1 RO O_DIRECT /dev/sda1: size is 1024000 sectors Closed /dev/sda1 /dev/sda1: Device is a partition, using primary device sda for mpath component detection filter partitioned deferred /dev/sda1 filter md deferred /dev/sda1 filter caching good /dev/sda1 Opened /dev/vda1 RO O_DIRECT /dev/vda1: size is 2097152 sectors Closed /dev/vda1 filter partitioned deferred /dev/vda1 filter md deferred /dev/vda1 filter caching good /dev/vda1 dm status (253:1) [ noopencount noflush ] [16384] (*1) Opened /dev/rhel/swap RO O_DIRECT /dev/rhel/swap: size is 2097152 sectors Closed /dev/rhel/swap filter partitioned deferred /dev/rhel/swap filter md deferred /dev/rhel/swap dm status (253:1) [ noopencount noflush ] [16384] (*1) filter caching good /dev/rhel/swap Opened /dev/sda2 RO O_DIRECT /dev/sda2: size is 19945472 sectors Closed /dev/sda2 /dev/sda2: Device is a partition, using primary device sda for mpath component detection filter partitioned deferred /dev/sda2 filter md deferred /dev/sda2 filter caching good /dev/sda2 Opened /dev/vda2 RO O_DIRECT /dev/vda2: size is 2095104 sectors Closed /dev/vda2 filter partitioned deferred /dev/vda2 filter md deferred /dev/vda2 filter caching good /dev/vda2 dm status (253:2) [ noopencount noflush ] [16384] (*1) Opened /dev/mapper/mpathd RO O_DIRECT /dev/mapper/mpathd: size is 2097152 sectors Closed /dev/mapper/mpathd filter partitioned deferred /dev/mapper/mpathd filter md deferred /dev/mapper/mpathd dm status (253:2) [ noopencount noflush ] [16384] (*1) filter caching good /dev/mapper/mpathd dm status (253:3) [ noopencount noflush ] [16384] (*1) Opened /dev/mapper/mpathc RO O_DIRECT /dev/mapper/mpathc: size is 2097152 sectors Closed /dev/mapper/mpathc filter partitioned deferred /dev/mapper/mpathc filter md deferred /dev/mapper/mpathc dm status (253:3) [ noopencount noflush ] [16384] (*1) filter caching good /dev/mapper/mpathc dm status (253:4) [ noopencount noflush ] [16384] (*1) Opened /dev/myvg/mylv RO O_DIRECT /dev/myvg/mylv: size is 4177920 sectors Closed /dev/myvg/mylv filter partitioned deferred /dev/myvg/mylv filter md deferred /dev/myvg/mylv dm status (253:4) [ noopencount noflush ] [16384] (*1) filter caching good /dev/myvg/mylv Opened /dev/sdb RO O_DIRECT /dev/sdb: size is 2097152 sectors Closed /dev/sdb dm status (253:2) [ opencount flush ] [16384] (*1) /dev/sdb: Skipping mpath component device Opened /dev/sdc RO O_DIRECT /dev/sdc: size is 2097152 sectors Closed /dev/sdc dm status (253:3) [ opencount flush ] [16384] (*1) /dev/sdc: Skipping mpath component device Opened /dev/sdd RO O_DIRECT /dev/sdd: size is 2097152 sectors Closed /dev/sdd dm status (253:2) [ opencount flush ] [16384] (*1) /dev/sdd: Skipping mpath component device Opened /dev/sde RO O_DIRECT /dev/sde: size is 2097152 sectors Closed /dev/sde dm status (253:3) [ opencount flush ] [16384] (*1) /dev/sde: Skipping mpath component device Found 11 devices to scan Scanning 11 devices for VG info Scanning submitted 11 reads Processing data from device /dev/sda 8:0 fd 6 block 0x5597bc20c2a0 /dev/sda: No lvm label detected Processing data from device /dev/vda 252:0 fd 7 block 0x5597bc20c2f0 /dev/vda: No lvm label detected Processing data from device /dev/rhel/root 253:0 fd 8 block 0x5597bc20c340 /dev/rhel/root: No lvm label detected Processing data from device /dev/sda1 8:1 fd 9 block 0x5597bc20c390 /dev/sda1: No lvm label detected Processing data from device /dev/vda1 252:1 fd 10 block 0x5597bc20c3e0 /dev/vda1: lvm2 label detected at sector 1 lvmcache /dev/vda1: now in VG #orphans_lvm2 (#orphans_lvm2) with 0 mda(s). /dev/vda1: PV header extension version 2 found Reading mda header sector from /dev/vda1 at 4096 Reading metadata summary from /dev/vda1 at 8192 size 1302 (+0) Found metadata summary on /dev/vda1 at 8192 size 1302 for VG myvg lvmcache has no info for vgname "myvg" with VGID Eizu7J5aZyabGp9gPT4XQBDgtgeVlvhl. lvmcache has no info for vgname "myvg". lvmcache /dev/vda1: now in VG myvg with 1 mda(s). lvmcache /dev/vda1: VG myvg: set VGID to Eizu7J5aZyabGp9gPT4XQBDgtgeVlvhl. lvmcache /dev/vda1: VG myvg: set seqno to 4 lvmcache /dev/vda1: VG myvg: set mda_checksum to 77637ad4 mda_size to 1302 lvmcache /dev/vda1: VG myvg: set creation host to clust-node1. Processing data from device /dev/rhel/swap 253:1 fd 11 block 0x5597bc20c430 /dev/rhel/swap: No lvm label detected Processing data from device /dev/sda2 8:2 fd 12 block 0x5597bc20c480 /dev/sda2: lvm2 label detected at sector 1 lvmcache /dev/sda2: now in VG #orphans_lvm2 (#orphans_lvm2) with 0 mda(s). /dev/sda2: PV header extension version 1 found Reading mda header sector from /dev/sda2 at 4096 Reading metadata summary from /dev/sda2 at 6656 size 1309 (+0) Found metadata summary on /dev/sda2 at 6656 size 1309 for VG rhel lvmcache has no info for vgname "rhel" with VGID Kr5TIy2aP97MvdjECQihubvABRNmO1Ri. lvmcache has no info for vgname "rhel". lvmcache /dev/sda2: now in VG rhel with 1 mda(s). lvmcache /dev/sda2: VG rhel: set VGID to Kr5TIy2aP97MvdjECQihubvABRNmO1Ri. lvmcache /dev/sda2: VG rhel: set seqno to 3 lvmcache /dev/sda2: VG rhel: set mda_checksum to b875ec mda_size to 1309 lvmcache /dev/sda2: VG rhel: set creation host to clust-node1. Processing data from device /dev/vda2 252:2 fd 13 block 0x5597bc20c4d0 /dev/vda2: lvm2 label detected at sector 1 lvmcache /dev/vda2: now in VG #orphans_lvm2 (#orphans_lvm2) with 0 mda(s). /dev/vda2: PV header extension version 2 found Reading mda header sector from /dev/vda2 at 4096 Reading metadata summary from /dev/vda2 at 8192 size 1304 (+0) Found metadata summary on /dev/vda2 at 8192 size 1304 for VG myvg1 lvmcache has no info for vgname "myvg1" with VGID tOR9o3xiysZGTYkB26MxqL6r5ZHVer8i. lvmcache has no info for vgname "myvg1". lvmcache /dev/vda2: now in VG myvg1 with 1 mda(s). lvmcache /dev/vda2: VG myvg1: set VGID to tOR9o3xiysZGTYkB26MxqL6r5ZHVer8i. lvmcache /dev/vda2: VG myvg1: set seqno to 4 lvmcache /dev/vda2: VG myvg1: set mda_checksum to 3d1765aa mda_size to 1304 lvmcache /dev/vda2: VG myvg1: set creation host to clust-node2. Processing data from device /dev/mapper/mpathd 253:2 fd 14 block 0x5597bc20c520 /dev/mapper/mpathd: lvm2 label detected at sector 1 lvmcache /dev/mapper/mpathd: now in VG #orphans_lvm2 (#orphans_lvm2) with 0 mda(s). /dev/mapper/mpathd: PV header extension version 2 found Reading mda header sector from /dev/mapper/mpathd at 4096 Reading metadata summary from /dev/mapper/mpathd at 6144 size 1304 (+0) Skipped parsing metadata on /dev/mapper/mpathd Found metadata summary on /dev/mapper/mpathd at 6144 size 1304 for VG myvg1 lvmcache /dev/mapper/mpathd: now in VG myvg1 (tOR9o3xiysZGTYkB26MxqL6r5ZHVer8i) with 1 mda(s). Processing data from device /dev/mapper/mpathc 253:3 fd 15 block 0x5597bc20c570 /dev/mapper/mpathc: No lvm label detected Processing data from device /dev/myvg/mylv 253:4 fd 16 block 0x5597bc20c5c0 /dev/myvg/mylv: No lvm label detected Scanned devices: read errors 0 process errors 0 failed 0 Telling lvmetad to clear its cache /dev/sda: using cached size 20971520 sectors /dev/sda: Skipping: Partition table signature found /dev/cdrom: Skipping: Unrecognised LVM device type 11 /dev/vda: using cached size 4194304 sectors /dev/vda: Skipping: Partition table signature found dm status (253:0) [ noopencount noflush ] [16384] (*1) /dev/rhel/root: using cached size 17760256 sectors /dev/rhel/root: using cached size 17760256 sectors Scan metadata from dev /dev/rhel/root No PV info found on /dev/rhel/root for PVID . Telling lvmetad to forget any PV on /dev/rhel/root Request to drop PV /dev/rhel/root in lvmetad did not find any matching object. /dev/sda1: using cached size 1024000 sectors /dev/sda1: Device is a partition, using primary device sda for mpath component detection /dev/sda1: using cached size 1024000 sectors Scan metadata from dev /dev/sda1 No PV info found on /dev/sda1 for PVID . Telling lvmetad to forget any PV on /dev/sda1 Request to drop PV /dev/sda1 in lvmetad did not find any matching object. /dev/vda1: using cached size 2097152 sectors /dev/vda1: using cached size 2097152 sectors Scan metadata from dev /dev/vda1 Reading mda header sector from /dev/vda1 at 4096 Reading metadata from /dev/vda1 at 8192 size 1302 (+0) Allocated VG myvg at 0x5597bc22bac0. No device with uuid hM2oHzBEbJ7XUVAfPfQdZg2NNqCvCYpI. Couldn't find device with uuid hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI. Importing logical volume myvg/mylv. Found metadata on /dev/vda1 at 8192 size 1302 for VG Reading mda header sector from /dev/vda1 at 4096 Telling lvmetad to store PV /dev/vda1 (6tSgXm-9pd1-dAPz-C2cj-vX5L-gpJK-WpGU9z) in VG myvg Freeing VG myvg at 0x5597bc22bac0. dm status (253:1) [ noopencount noflush ] [16384] (*1) /dev/rhel/swap: using cached size 2097152 sectors /dev/rhel/swap: using cached size 2097152 sectors Scan metadata from dev /dev/rhel/swap No PV info found on /dev/rhel/swap for PVID . Telling lvmetad to forget any PV on /dev/rhel/swap Request to drop PV /dev/rhel/swap in lvmetad did not find any matching object. /dev/sda2: using cached size 19945472 sectors /dev/sda2: Device is a partition, using primary device sda for mpath component detection /dev/sda2: using cached size 19945472 sectors Scan metadata from dev /dev/sda2 Reading mda header sector from /dev/sda2 at 4096 Reading metadata from /dev/sda2 at 6656 size 1309 (+0) Allocated VG rhel at 0x5597bc22bac0. Importing logical volume rhel/swap. Importing logical volume rhel/root. Found metadata on /dev/sda2 at 6656 size 1309 for VG Reading mda header sector from /dev/sda2 at 4096 Telling lvmetad to store PV /dev/sda2 (ROQByT-EHhx-z7Kv-dgmH-eDUe-DdX2-lRsUYs) in VG rhel Freeing VG rhel at 0x5597bc22bac0. /dev/vda2: using cached size 2095104 sectors /dev/vda2: using cached size 2095104 sectors Scan metadata from dev /dev/vda2 Reading mda header sector from /dev/vda2 at 4096 Reading metadata from /dev/vda2 at 8192 size 1304 (+0) Allocated VG myvg1 at 0x5597bc22bac0. Importing logical volume myvg1/mylv1. Found metadata on /dev/vda2 at 8192 size 1304 for VG Reading mda header sector from /dev/vda2 at 4096 Telling lvmetad to store PV /dev/vda2 (4wQnSx-o2cN-ErSW-H1rj-Oi5E-bFBt-lJT4DU) in VG myvg1 Freeing VG myvg1 at 0x5597bc22bac0. dm status (253:2) [ noopencount noflush ] [16384] (*1) /dev/mapper/mpathd: using cached size 2097152 sectors /dev/mapper/mpathd: using cached size 2097152 sectors Scan metadata from dev /dev/mapper/mpathd Reading mda header sector from /dev/mapper/mpathd at 4096 Reading metadata from /dev/mapper/mpathd at 6144 size 1304 (+0) Allocated VG myvg1 at 0x5597bc22bac0. Importing logical volume myvg1/mylv1. Found metadata on /dev/mapper/mpathd at 6144 size 1304 for VG Reading mda header sector from /dev/mapper/mpathd at 4096 Telling lvmetad to store PV /dev/mapper/mpathd (VGodsg-02KE-jjtY-zuGT-yg6o-Lzbt-VcNiAV) in VG myvg1 Freeing VG myvg1 at 0x5597bc22bac0. dm status (253:3) [ noopencount noflush ] [16384] (*1) /dev/mapper/mpathc: using cached size 2097152 sectors /dev/mapper/mpathc: using cached size 2097152 sectors Scan metadata from dev /dev/mapper/mpathc No PV info found on /dev/mapper/mpathc for PVID . Telling lvmetad to forget any PV on /dev/mapper/mpathc Request to drop PV /dev/mapper/mpathc in lvmetad did not find any matching object. dm status (253:4) [ noopencount noflush ] [16384] (*1) /dev/myvg/mylv: using cached size 4177920 sectors /dev/myvg/mylv: using cached size 4177920 sectors Scan metadata from dev /dev/myvg/mylv No PV info found on /dev/myvg/mylv for PVID . Telling lvmetad to forget any PV on /dev/myvg/mylv Request to drop PV /dev/myvg/mylv in lvmetad did not find any matching object. /dev/sdb: using cached size 2097152 sectors dm status (253:2) [ opencount flush ] [16384] (*1) /dev/sdb: Skipping mpath component device /dev/sdc: using cached size 2097152 sectors dm status (253:3) [ opencount flush ] [16384] (*1) /dev/sdc: Skipping mpath component device /dev/sdd: using cached size 2097152 sectors dm status (253:2) [ opencount flush ] [16384] (*1) /dev/sdd: Skipping mpath component device /dev/sde: using cached size 2097152 sectors dm status (253:3) [ opencount flush ] [16384] (*1) /dev/sde: Skipping mpath component device Sending lvmetad token_update filter:3239235440 Unlock: Memlock counters: prioritized:0 locked:0 critical:0 daemon:0 suspended:0 Syncing device names Unlocking /run/lock/lvm/P_global _undo_flock /run/lock/lvm/P_global global/notify_dbus not found in config: defaulting to 1 Dropping VG info lvmcache has no info for vgname "#orphans_lvm1" with VGID #orphans_lvm1. lvmcache has no info for vgname "#orphans_lvm1". lvmcache: Initialised VG #orphans_lvm1. lvmcache has no info for vgname "#orphans_pool" with VGID #orphans_pool. lvmcache has no info for vgname "#orphans_pool". lvmcache: Initialised VG #orphans_pool. lvmcache has no info for vgname "#orphans_lvm2" with VGID #orphans_lvm2. lvmcache has no info for vgname "#orphans_lvm2". lvmcache: Initialised VG #orphans_lvm2. Completed: pvscan --cache -vvv [root@clust-node1 ~]# [root@clust-node2 ~]# pvscan --cache -vvv Parsing: pvscan --cache -vvv Recognised command pvscan_cache (id 107 / enum 88). devices/global_filter not found in config: defaulting to global_filter = [ "a|.*/|" ] global/lvmetad_update_wait_time not found in config: defaulting to 10 /run/lvm/lvmetad.socket: Opening daemon socket to lvmetad for protocol lvmetad version 1. Sending daemon lvmetad: hello Successfully connected to lvmetad on fd 3. Sysfs filter initialised. Internal filter initialised. LVM type filter initialised. Usable device filter initialised. mpath filter initialised. Partitioned filter initialised. MD filter initialised. Composite filter initialised. devices/filter not found in config: defaulting to filter = [ "a|.*/|" ] Regex filter initialised. Usable device filter initialised. Composite filter initialised. devices/cache not found in config: defaulting to /etc/lvm/cache/.cache Persistent filter initialised. Composite filter initialised. metadata/record_lvs_history not found in config: defaulting to 0 DEGRADED MODE. Incomplete RAID LVs will be processed. Processing command: pvscan --cache -vvv Command pid: 12518 System ID: O_DIRECT will be used File-based locking selected. Preparing SELinux context for /run/lock/lvm to system_u:object_r:lvm_lock_t:s0. Resetting SELinux context to default value. Locking /run/lock/lvm/P_global RB Preparing SELinux context for /run/lock/lvm/P_global to system_u:object_r:lvm_lock_t:s0. _do_flock /run/lock/lvm/P_global:aux WB _undo_flock /run/lock/lvm/P_global:aux _do_flock /run/lock/lvm/P_global RB Resetting SELinux context to default value. Scanning all devices. Sending lvmetad get_global_info Sending lvmetad token_update update in progress Scanning all devices to initialize lvmetad. Finding devices to scan Creating list of system devices. Found dev 8:0 /dev/sda - new. Found dev 8:0 /dev/disk/by-id/ata-QEMU_HARDDISK_QM00001 - new alias. Found dev 8:0 /dev/disk/by-path/pci-0000:00:01.1-ata-1.0 - new alias. Found dev 8:1 /dev/sda1 - new. Found dev 8:1 /dev/disk/by-id/ata-QEMU_HARDDISK_QM00001-part1 - new alias. Found dev 8:1 /dev/disk/by-path/pci-0000:00:01.1-ata-1.0-part1 - new alias. Found dev 8:1 /dev/disk/by-uuid/98f70f9a-f2e9-4b0a-9a01-ba8b425a61ea - new alias. Found dev 8:2 /dev/sda2 - new. Found dev 8:2 /dev/disk/by-id/ata-QEMU_HARDDISK_QM00001-part2 - new alias. Found dev 8:2 /dev/disk/by-id/lvm-pv-uuid-hR0rLp-UbbA-1w1o-aGeW-Ymeh-nQsh-kIpKRZ - new alias. Found dev 8:2 /dev/disk/by-path/pci-0000:00:01.1-ata-1.0-part2 - new alias. Found dev 11:0 /dev/sr0 - new. Found dev 11:0 /dev/cdrom - new alias. Found dev 11:0 /dev/disk/by-id/ata-QEMU_DVD-ROM_QM00002 - new alias. Found dev 11:0 /dev/disk/by-path/pci-0000:00:01.1-ata-1.1 - new alias. Found dev 252:0 /dev/vda - new. Found dev 252:0 /dev/disk/by-path/pci-0000:00:09.0 - new alias. Found dev 252:0 /dev/disk/by-path/virtio-pci-0000:00:09.0 - new alias. Found dev 252:1 /dev/vda1 - new. Found dev 252:1 /dev/disk/by-id/lvm-pv-uuid-krcz6N-DguQ-Ijci-NGXu-VReM-7Qws-4GP1Wy - new alias. Found dev 252:1 /dev/disk/by-path/pci-0000:00:09.0-part1 - new alias. Found dev 252:1 /dev/disk/by-path/virtio-pci-0000:00:09.0-part1 - new alias. Found dev 252:2 /dev/vda2 - new. Found dev 252:2 /dev/disk/by-id/lvm-pv-uuid-4wQnSx-o2cN-ErSW-H1rj-Oi5E-bFBt-lJT4DU - new alias. Found dev 252:2 /dev/disk/by-path/pci-0000:00:09.0-part2 - new alias. Found dev 252:2 /dev/disk/by-path/virtio-pci-0000:00:09.0-part2 - new alias. Found dev 8:16 /dev/sdb - new. Found dev 8:32 /dev/disk/by-id/scsi-3600140592086e2fe9d947b48c119409f - new. Found dev 8:32 /dev/disk/by-id/wwn-0x600140592086e2fe9d947b48c119409f - new alias. Found dev 8:16 /dev/disk/by-path/ip-192.168.10.80:3260-iscsi-iqn.2018-07.csb.pnq:3node-lun-0 - new alias. Found dev 8:48 /dev/sdd - new. Found dev 8:64 /dev/disk/by-id/scsi-360014058285a0163e2843a1aad199e78 - new. Found dev 8:64 /dev/disk/by-id/wwn-0x60014058285a0163e2843a1aad199e78 - new alias. Found dev 8:48 /dev/disk/by-path/ip-192.168.10.80:3260-iscsi-iqn.2018-07.csb.pnq:3node-lun-1 - new alias. Found dev 8:32 /dev/sdc - new alias. Found dev 8:32 /dev/disk/by-id/scsi-3600140592086e2fe9d947b48c119409f - exists. Found dev 8:32 /dev/disk/by-id/wwn-0x600140592086e2fe9d947b48c119409f - exists. Found dev 8:32 /dev/disk/by-path/ip-192.168.20.80:3260-iscsi-iqn.2018-07.csb.pnq:3node-lun-0 - new alias. Found dev 8:64 /dev/sde - new alias. Found dev 8:64 /dev/disk/by-id/scsi-360014058285a0163e2843a1aad199e78 - exists. Found dev 8:64 /dev/disk/by-id/wwn-0x60014058285a0163e2843a1aad199e78 - exists. Found dev 8:64 /dev/disk/by-path/ip-192.168.20.80:3260-iscsi-iqn.2018-07.csb.pnq:3node-lun-1 - new alias. Found dev 253:0 /dev/dm-0 - new. Found dev 253:0 /dev/disk/by-id/dm-name-rhel-root - new alias. Found dev 253:0 /dev/disk/by-id/dm-uuid-LVM-o4pIKXcYFHAKdFq3R4QjayTd3xZIxqo01fAIAPXO8HphK68cNYrmw2RExFfHP9uU - new alias. Found dev 253:0 /dev/disk/by-uuid/8e56a825-cf77-42ba-97c0-2ff2bbcfe61d - new alias. Found dev 253:0 /dev/mapper/rhel-root - new alias. Found dev 253:0 /dev/rhel/root - new alias. Found dev 253:1 /dev/dm-1 - new. Found dev 253:1 /dev/disk/by-id/dm-name-rhel-swap - new alias. Found dev 253:1 /dev/disk/by-id/dm-uuid-LVM-o4pIKXcYFHAKdFq3R4QjayTd3xZIxqo00gWvr1ZQnlNoBbEDVxWflijR5uBVWwQM - new alias. Found dev 253:1 /dev/disk/by-uuid/86d66daa-d985-4e7a-9403-37e4b7aded39 - new alias. Found dev 253:1 /dev/mapper/rhel-swap - new alias. Found dev 253:1 /dev/rhel/swap - new alias. Found dev 253:2 /dev/dm-2 - new. Found dev 253:2 /dev/disk/by-id/dm-name-mpathe - new alias. Found dev 253:2 /dev/disk/by-id/dm-uuid-mpath-3600140592086e2fe9d947b48c119409f - new alias. Found dev 253:2 /dev/disk/by-id/lvm-pv-uuid-VGodsg-02KE-jjtY-zuGT-yg6o-Lzbt-VcNiAV - new alias. Found dev 253:2 /dev/mapper/mpathe - new alias. Found dev 253:3 /dev/dm-3 - new. Found dev 253:3 /dev/disk/by-id/dm-name-mpathc - new alias. Found dev 253:3 /dev/disk/by-id/dm-uuid-mpath-360014058285a0163e2843a1aad199e78 - new alias. Found dev 253:3 /dev/mapper/mpathc - new alias. Found dev 253:4 /dev/dm-4 - new. Found dev 253:4 /dev/disk/by-id/dm-name-myvg1-mylv1 - new alias. Found dev 253:4 /dev/disk/by-id/dm-uuid-LVM-tOR9o3xiysZGTYkB26MxqL6r5ZHVer8i0i4lMU2fNkhBbIKSOjNZAOOUQWxdf82B - new alias. Found dev 253:4 /dev/disk/by-uuid/dc91b89e-9b7c-4330-91ea-6bc33243dc57 - new alias. Found dev 253:4 /dev/mapper/myvg1-mylv1 - new alias. Found dev 253:4 /dev/myvg1/mylv1 - new alias. Opened /dev/sda RO O_DIRECT /dev/sda: size is 20971520 sectors Closed /dev/sda filter partitioned deferred /dev/sda filter md deferred /dev/sda filter caching good /dev/sda /dev/cdrom: Skipping: Unrecognised LVM device type 11 Opened /dev/vda RO O_DIRECT /dev/vda: size is 4194304 sectors Closed /dev/vda filter partitioned deferred /dev/vda filter md deferred /dev/vda filter caching good /dev/vda dm version [ opencount flush ] [16384] (*1) dm status (253:0) [ noopencount noflush ] [16384] (*1) Opened /dev/rhel/root RO O_DIRECT /dev/rhel/root: size is 17760256 sectors Closed /dev/rhel/root filter partitioned deferred /dev/rhel/root filter md deferred /dev/rhel/root dm status (253:0) [ noopencount noflush ] [16384] (*1) filter caching good /dev/rhel/root Opened /dev/sda1 RO O_DIRECT /dev/sda1: size is 1024000 sectors Closed /dev/sda1 /dev/sda1: Device is a partition, using primary device sda for mpath component detection filter partitioned deferred /dev/sda1 filter md deferred /dev/sda1 filter caching good /dev/sda1 Opened /dev/vda1 RO O_DIRECT /dev/vda1: size is 2097152 sectors Closed /dev/vda1 filter partitioned deferred /dev/vda1 filter md deferred /dev/vda1 filter caching good /dev/vda1 dm status (253:1) [ noopencount noflush ] [16384] (*1) Opened /dev/rhel/swap RO O_DIRECT /dev/rhel/swap: size is 2097152 sectors Closed /dev/rhel/swap filter partitioned deferred /dev/rhel/swap filter md deferred /dev/rhel/swap dm status (253:1) [ noopencount noflush ] [16384] (*1) filter caching good /dev/rhel/swap Opened /dev/sda2 RO O_DIRECT /dev/sda2: size is 19945472 sectors Closed /dev/sda2 /dev/sda2: Device is a partition, using primary device sda for mpath component detection filter partitioned deferred /dev/sda2 filter md deferred /dev/sda2 filter caching good /dev/sda2 Opened /dev/vda2 RO O_DIRECT /dev/vda2: size is 2095104 sectors Closed /dev/vda2 filter partitioned deferred /dev/vda2 filter md deferred /dev/vda2 filter caching good /dev/vda2 dm status (253:2) [ noopencount noflush ] [16384] (*1) Opened /dev/mapper/mpathe RO O_DIRECT /dev/mapper/mpathe: size is 2097152 sectors Closed /dev/mapper/mpathe filter partitioned deferred /dev/mapper/mpathe filter md deferred /dev/mapper/mpathe dm status (253:2) [ noopencount noflush ] [16384] (*1) filter caching good /dev/mapper/mpathe dm status (253:3) [ noopencount noflush ] [16384] (*1) Opened /dev/mapper/mpathc RO O_DIRECT /dev/mapper/mpathc: size is 2097152 sectors Closed /dev/mapper/mpathc filter partitioned deferred /dev/mapper/mpathc filter md deferred /dev/mapper/mpathc dm status (253:3) [ noopencount noflush ] [16384] (*1) filter caching good /dev/mapper/mpathc dm status (253:4) [ noopencount noflush ] [16384] (*1) Opened /dev/myvg1/mylv1 RO O_DIRECT /dev/myvg1/mylv1: size is 4177920 sectors Closed /dev/myvg1/mylv1 filter partitioned deferred /dev/myvg1/mylv1 filter md deferred /dev/myvg1/mylv1 dm status (253:4) [ noopencount noflush ] [16384] (*1) filter caching good /dev/myvg1/mylv1 Opened /dev/sdb RO O_DIRECT /dev/sdb: size is 2097152 sectors Closed /dev/sdb dm status (253:2) [ opencount flush ] [16384] (*1) /dev/sdb: Skipping mpath component device Opened /dev/sdc RO O_DIRECT /dev/sdc: size is 2097152 sectors Closed /dev/sdc dm status (253:2) [ opencount flush ] [16384] (*1) /dev/sdc: Skipping mpath component device Opened /dev/sdd RO O_DIRECT /dev/sdd: size is 2097152 sectors Closed /dev/sdd dm status (253:3) [ opencount flush ] [16384] (*1) /dev/sdd: Skipping mpath component device Opened /dev/sde RO O_DIRECT /dev/sde: size is 2097152 sectors Closed /dev/sde dm status (253:3) [ opencount flush ] [16384] (*1) /dev/sde: Skipping mpath component device Found 11 devices to scan Scanning 11 devices for VG info Scanning submitted 11 reads Processing data from device /dev/sda 8:0 fd 6 block 0x55e1a33cc280 /dev/sda: No lvm label detected Processing data from device /dev/vda 252:0 fd 7 block 0x55e1a33cc2d0 /dev/vda: No lvm label detected Processing data from device /dev/rhel/root 253:0 fd 8 block 0x55e1a33cc320 /dev/rhel/root: No lvm label detected Processing data from device /dev/sda1 8:1 fd 9 block 0x55e1a33cc370 /dev/sda1: No lvm label detected Processing data from device /dev/vda1 252:1 fd 10 block 0x55e1a33cc3c0 /dev/vda1: lvm2 label detected at sector 1 lvmcache /dev/vda1: now in VG #orphans_lvm2 (#orphans_lvm2) with 0 mda(s). /dev/vda1: PV header extension version 2 found Reading mda header sector from /dev/vda1 at 4096 Reading metadata summary from /dev/vda1 at 8192 size 1302 (+0) Found metadata summary on /dev/vda1 at 8192 size 1302 for VG myvg lvmcache has no info for vgname "myvg" with VGID Eizu7J5aZyabGp9gPT4XQBDgtgeVlvhl. lvmcache has no info for vgname "myvg". lvmcache /dev/vda1: now in VG myvg with 1 mda(s). lvmcache /dev/vda1: VG myvg: set VGID to Eizu7J5aZyabGp9gPT4XQBDgtgeVlvhl. lvmcache /dev/vda1: VG myvg: set seqno to 4 lvmcache /dev/vda1: VG myvg: set mda_checksum to 77637ad4 mda_size to 1302 lvmcache /dev/vda1: VG myvg: set creation host to clust-node1. Processing data from device /dev/rhel/swap 253:1 fd 11 block 0x55e1a33cc410 /dev/rhel/swap: No lvm label detected Processing data from device /dev/sda2 8:2 fd 12 block 0x55e1a33cc460 /dev/sda2: lvm2 label detected at sector 1 lvmcache /dev/sda2: now in VG #orphans_lvm2 (#orphans_lvm2) with 0 mda(s). /dev/sda2: PV header extension version 1 found Reading mda header sector from /dev/sda2 at 4096 Reading metadata summary from /dev/sda2 at 8192 size 1309 (+0) Found metadata summary on /dev/sda2 at 8192 size 1309 for VG rhel lvmcache has no info for vgname "rhel" with VGID o4pIKXcYFHAKdFq3R4QjayTd3xZIxqo0. lvmcache has no info for vgname "rhel". lvmcache /dev/sda2: now in VG rhel with 1 mda(s). lvmcache /dev/sda2: VG rhel: set VGID to o4pIKXcYFHAKdFq3R4QjayTd3xZIxqo0. lvmcache /dev/sda2: VG rhel: set seqno to 4 lvmcache /dev/sda2: VG rhel: set mda_checksum to 9f361bc1 mda_size to 1309 lvmcache /dev/sda2: VG rhel: set creation host to clust-node2. Processing data from device /dev/vda2 252:2 fd 13 block 0x55e1a33cc4b0 /dev/vda2: lvm2 label detected at sector 1 lvmcache /dev/vda2: now in VG #orphans_lvm2 (#orphans_lvm2) with 0 mda(s). /dev/vda2: PV header extension version 2 found Reading mda header sector from /dev/vda2 at 4096 Reading metadata summary from /dev/vda2 at 8192 size 1304 (+0) Found metadata summary on /dev/vda2 at 8192 size 1304 for VG myvg1 lvmcache has no info for vgname "myvg1" with VGID tOR9o3xiysZGTYkB26MxqL6r5ZHVer8i. lvmcache has no info for vgname "myvg1". lvmcache /dev/vda2: now in VG myvg1 with 1 mda(s). lvmcache /dev/vda2: VG myvg1: set VGID to tOR9o3xiysZGTYkB26MxqL6r5ZHVer8i. lvmcache /dev/vda2: VG myvg1: set seqno to 4 lvmcache /dev/vda2: VG myvg1: set mda_checksum to 3d1765aa mda_size to 1304 lvmcache /dev/vda2: VG myvg1: set creation host to clust-node2. Processing data from device /dev/mapper/mpathe 253:2 fd 14 block 0x55e1a33cc500 /dev/mapper/mpathe: lvm2 label detected at sector 1 lvmcache /dev/mapper/mpathe: now in VG #orphans_lvm2 (#orphans_lvm2) with 0 mda(s). /dev/mapper/mpathe: PV header extension version 2 found Reading mda header sector from /dev/mapper/mpathe at 4096 Reading metadata summary from /dev/mapper/mpathe at 6144 size 1304 (+0) Skipped parsing metadata on /dev/mapper/mpathe Found metadata summary on /dev/mapper/mpathe at 6144 size 1304 for VG myvg1 lvmcache /dev/mapper/mpathe: now in VG myvg1 (tOR9o3xiysZGTYkB26MxqL6r5ZHVer8i) with 1 mda(s). Processing data from device /dev/mapper/mpathc 253:3 fd 15 block 0x55e1a33cc550 /dev/mapper/mpathc: No lvm label detected Processing data from device /dev/myvg1/mylv1 253:4 fd 16 block 0x55e1a33cc5a0 /dev/myvg1/mylv1: No lvm label detected Scanned devices: read errors 0 process errors 0 failed 0 Telling lvmetad to clear its cache /dev/sda: using cached size 20971520 sectors /dev/sda: Skipping: Partition table signature found /dev/cdrom: Skipping: Unrecognised LVM device type 11 /dev/vda: using cached size 4194304 sectors /dev/vda: Skipping: Partition table signature found dm status (253:0) [ noopencount noflush ] [16384] (*1) /dev/rhel/root: using cached size 17760256 sectors /dev/rhel/root: using cached size 17760256 sectors Scan metadata from dev /dev/rhel/root No PV info found on /dev/rhel/root for PVID . Telling lvmetad to forget any PV on /dev/rhel/root Request to drop PV /dev/rhel/root in lvmetad did not find any matching object. /dev/sda1: using cached size 1024000 sectors /dev/sda1: Device is a partition, using primary device sda for mpath component detection /dev/sda1: using cached size 1024000 sectors Scan metadata from dev /dev/sda1 No PV info found on /dev/sda1 for PVID . Telling lvmetad to forget any PV on /dev/sda1 Request to drop PV /dev/sda1 in lvmetad did not find any matching object. /dev/vda1: using cached size 2097152 sectors /dev/vda1: using cached size 2097152 sectors Scan metadata from dev /dev/vda1 Reading mda header sector from /dev/vda1 at 4096 Reading metadata from /dev/vda1 at 8192 size 1302 (+0) Allocated VG myvg at 0x55e1a33ebac0. No device with uuid hM2oHzBEbJ7XUVAfPfQdZg2NNqCvCYpI. Couldn't find device with uuid hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI. Importing logical volume myvg/mylv. Found metadata on /dev/vda1 at 8192 size 1302 for VG Reading mda header sector from /dev/vda1 at 4096 Telling lvmetad to store PV /dev/vda1 (6tSgXm-9pd1-dAPz-C2cj-vX5L-gpJK-WpGU9z) in VG myvg Freeing VG myvg at 0x55e1a33ebac0. dm status (253:1) [ noopencount noflush ] [16384] (*1) /dev/rhel/swap: using cached size 2097152 sectors /dev/rhel/swap: using cached size 2097152 sectors Scan metadata from dev /dev/rhel/swap No PV info found on /dev/rhel/swap for PVID . Telling lvmetad to forget any PV on /dev/rhel/swap Request to drop PV /dev/rhel/swap in lvmetad did not find any matching object. /dev/sda2: using cached size 19945472 sectors /dev/sda2: Device is a partition, using primary device sda for mpath component detection /dev/sda2: using cached size 19945472 sectors Scan metadata from dev /dev/sda2 Reading mda header sector from /dev/sda2 at 4096 Reading metadata from /dev/sda2 at 8192 size 1309 (+0) Allocated VG rhel at 0x55e1a33ebac0. Importing logical volume rhel/swap. Importing logical volume rhel/root. Found metadata on /dev/sda2 at 8192 size 1309 for VG Reading mda header sector from /dev/sda2 at 4096 Telling lvmetad to store PV /dev/sda2 (hR0rLp-UbbA-1w1o-aGeW-Ymeh-nQsh-kIpKRZ) in VG rhel Freeing VG rhel at 0x55e1a33ebac0. /dev/vda2: using cached size 2095104 sectors /dev/vda2: using cached size 2095104 sectors Scan metadata from dev /dev/vda2 Reading mda header sector from /dev/vda2 at 4096 Reading metadata from /dev/vda2 at 8192 size 1304 (+0) Allocated VG myvg1 at 0x55e1a33ec2c0. Importing logical volume myvg1/mylv1. Found metadata on /dev/vda2 at 8192 size 1304 for VG Reading mda header sector from /dev/vda2 at 4096 Telling lvmetad to store PV /dev/vda2 (4wQnSx-o2cN-ErSW-H1rj-Oi5E-bFBt-lJT4DU) in VG myvg1 Freeing VG myvg1 at 0x55e1a33ec2c0. dm status (253:2) [ noopencount noflush ] [16384] (*1) /dev/mapper/mpathe: using cached size 2097152 sectors /dev/mapper/mpathe: using cached size 2097152 sectors Scan metadata from dev /dev/mapper/mpathe Reading mda header sector from /dev/mapper/mpathe at 4096 Reading metadata from /dev/mapper/mpathe at 6144 size 1304 (+0) Allocated VG myvg1 at 0x55e1a33ebac0. Importing logical volume myvg1/mylv1. Found metadata on /dev/mapper/mpathe at 6144 size 1304 for VG Reading mda header sector from /dev/mapper/mpathe at 4096 Telling lvmetad to store PV /dev/mapper/mpathe (VGodsg-02KE-jjtY-zuGT-yg6o-Lzbt-VcNiAV) in VG myvg1 Freeing VG myvg1 at 0x55e1a33ebac0. dm status (253:3) [ noopencount noflush ] [16384] (*1) /dev/mapper/mpathc: using cached size 2097152 sectors /dev/mapper/mpathc: using cached size 2097152 sectors Scan metadata from dev /dev/mapper/mpathc No PV info found on /dev/mapper/mpathc for PVID . Telling lvmetad to forget any PV on /dev/mapper/mpathc Request to drop PV /dev/mapper/mpathc in lvmetad did not find any matching object. dm status (253:4) [ noopencount noflush ] [16384] (*1) /dev/myvg1/mylv1: using cached size 4177920 sectors /dev/myvg1/mylv1: using cached size 4177920 sectors Scan metadata from dev /dev/myvg1/mylv1 No PV info found on /dev/myvg1/mylv1 for PVID . Telling lvmetad to forget any PV on /dev/myvg1/mylv1 Request to drop PV /dev/myvg1/mylv1 in lvmetad did not find any matching object. /dev/sdb: using cached size 2097152 sectors dm status (253:2) [ opencount flush ] [16384] (*1) /dev/sdb: Skipping mpath component device /dev/sdc: using cached size 2097152 sectors dm status (253:2) [ opencount flush ] [16384] (*1) /dev/sdc: Skipping mpath component device /dev/sdd: using cached size 2097152 sectors dm status (253:3) [ opencount flush ] [16384] (*1) /dev/sdd: Skipping mpath component device /dev/sde: using cached size 2097152 sectors dm status (253:3) [ opencount flush ] [16384] (*1) /dev/sde: Skipping mpath component device Sending lvmetad token_update filter:3239235440 Unlock: Memlock counters: prioritized:0 locked:0 critical:0 daemon:0 suspended:0 Syncing device names Unlocking /run/lock/lvm/P_global _undo_flock /run/lock/lvm/P_global global/notify_dbus not found in config: defaulting to 1 Dropping VG info lvmcache has no info for vgname "#orphans_lvm1" with VGID #orphans_lvm1. lvmcache has no info for vgname "#orphans_lvm1". lvmcache: Initialised VG #orphans_lvm1. lvmcache has no info for vgname "#orphans_pool" with VGID #orphans_pool. lvmcache has no info for vgname "#orphans_pool". lvmcache: Initialised VG #orphans_pool. lvmcache has no info for vgname "#orphans_lvm2" with VGID #orphans_lvm2. lvmcache has no info for vgname "#orphans_lvm2". lvmcache: Initialised VG #orphans_lvm2. Completed: pvscan --cache -vvv [root@clust-node2 ~]# [root@clust-node1 ~]# vgs -ao+UUID WARNING: Device for PV hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI not found or rejected by a filter. Couldn't find device with uuid hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI. WARNING: Couldn't find all devices for LV myvg/mylv while checking used and assumed devices. VG #PV #LV #SN Attr VSize VFree VG UUID myvg 2 1 0 wz-pn- 1.99g 0 Eizu7J-5aZy-abGp-9gPT-4XQB-Dgtg-eVlvhl myvg1 2 1 0 wz--n- 1.99g 0 tOR9o3-xiys-ZGTY-kB26-MxqL-6r5Z-HVer8i rhel 1 2 0 wz--n- 9.51g 40.00m Kr5TIy-2aP9-7Mvd-jECQ-ihub-vABR-NmO1Ri [root@clust-node1 ~]# lvs -ao+UUID WARNING: Device for PV hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI not found or rejected by a filter. Couldn't find device with uuid hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI. WARNING: Couldn't find all devices for LV myvg/mylv while checking used and assumed devices. LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert LV UUID mylv myvg -wi-ao--p- 1.99g amWg6N-kmJH-BU1Q-zbKK-1VoU-vFU6-Z2Tgge mylv1 myvg1 -wi------- 1.99g 0i4lMU-2fNk-hBbI-KSOj-NZAO-OUQW-xdf82B root rhel -wi-ao---- 8.47g RBXRRO-Nk3l-IrhJ-sGe9-YWAI-rEIm-SjJEEj swap rhel -wi-ao---- 1.00g tK33Dn-yK1m-hU3p-yzx1-Ap3S-TJCL-8TqITl [root@clust-node1 ~]# pvs -o+UUID WARNING: Device for PV hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI not found or rejected by a filter. Couldn't find device with uuid hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI. WARNING: Couldn't find all devices for LV myvg/mylv while checking used and assumed devices. PV VG Fmt Attr PSize PFree PV UUID /dev/mapper/mpathd myvg1 lvm2 a-- 1020.00m 0 VGodsg-02KE-jjtY-zuGT-yg6o-Lzbt-VcNiAV /dev/sda2 rhel lvm2 a-- 9.51g 40.00m ROQByT-EHhx-z7Kv-dgmH-eDUe-DdX2-lRsUYs /dev/vda1 myvg lvm2 a-- 1020.00m 0 6tSgXm-9pd1-dAPz-C2cj-vX5L-gpJK-WpGU9z /dev/vda2 myvg1 lvm2 a-- 1020.00m 0 4wQnSx-o2cN-ErSW-H1rj-Oi5E-bFBt-lJT4DU [unknown] myvg lvm2 a-m 1020.00m 0 hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI [root@clust-node1 ~]# [root@clust-node2 ~]# vgs -ao+UUID WARNING: Device for PV hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI not found or rejected by a filter. Couldn't find device with uuid hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI. VG #PV #LV #SN Attr VSize VFree VG UUID myvg 2 1 0 wz-pn- 1.99g 0 Eizu7J-5aZy-abGp-9gPT-4XQB-Dgtg-eVlvhl myvg1 2 1 0 wz--n- 1.99g 0 tOR9o3-xiys-ZGTY-kB26-MxqL-6r5Z-HVer8i rhel 1 2 0 wz--n- 9.51g 40.00m o4pIKX-cYFH-AKdF-q3R4-Qjay-Td3x-ZIxqo0 [root@clust-node2 ~]# lvs -ao+UUID WARNING: Device for PV hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI not found or rejected by a filter. Couldn't find device with uuid hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI. LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert LV UUID mylv myvg -wi-----p- 1.99g amWg6N-kmJH-BU1Q-zbKK-1VoU-vFU6-Z2Tgge mylv1 myvg1 -wi-ao---- 1.99g 0i4lMU-2fNk-hBbI-KSOj-NZAO-OUQW-xdf82B root rhel -wi-ao---- 8.47g 1fAIAP-XO8H-phK6-8cNY-rmw2-RExF-fHP9uU swap rhel -wi-ao---- 1.00g 0gWvr1-ZQnl-NoBb-EDVx-Wfli-jR5u-BVWwQM [root@clust-node2 ~]# pvs -o+UUID WARNING: Device for PV hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI not found or rejected by a filter. Couldn't find device with uuid hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI. PV VG Fmt Attr PSize PFree PV UUID /dev/mapper/mpathe myvg1 lvm2 a-- 1020.00m 0 VGodsg-02KE-jjtY-zuGT-yg6o-Lzbt-VcNiAV /dev/sda2 rhel lvm2 a-- 9.51g 40.00m hR0rLp-UbbA-1w1o-aGeW-Ymeh-nQsh-kIpKRZ /dev/vda1 myvg lvm2 a-- 1020.00m 0 6tSgXm-9pd1-dAPz-C2cj-vX5L-gpJK-WpGU9z /dev/vda2 myvg1 lvm2 a-- 1020.00m 0 4wQnSx-o2cN-ErSW-H1rj-Oi5E-bFBt-lJT4DU [unknown] myvg lvm2 a-m 1020.00m 0 hM2oHz-BEbJ-7XUV-AfPf-QdZg-2NNq-CvCYpI Version-Release number of selected component (if applicable): RHEL 7 How reproducible: In description Steps to Reproduce: In description Additional info: This was discussed during the gss+engineering call and we decided to open this bz for brainstorming, and a possible solution for this problem. Note we realize its an incorrect cluster configuration. However, this bz is to check if anything can be done from the LVM side for better protection against data corruption in such situations.
Created attachment 1689602 [details] patch patch I wrote some weeks ago when this first came up
A somewhat invasive change in a late stage release to catch a problem with a mis-configured system. Setting as WONTFIX. If this does turn out to be a frequent occurrence, we could revisit; but better to have users with correct settings.