Attachment 1487823 Details for Bug 1633583 – output of 10 iteration test run

output of 10 iteration test run

mda_panic (text/plain), 15.57 KB, created by Corey Marthaler on 2018-09-27 16:08:21 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Corey Marthaler

Created: 2018-09-27 16:08:21 UTC

Size: 15.57 KB

patch

obsolete

>3.10.0-954.el7.x86_64
>
>lvm2-2.02.180-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>lvm2-libs-2.02.180-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>lvm2-cluster-2.02.180-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>lvm2-lockd-2.02.180-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>lvm2-python-boom-0.9-11.el7    BUILT: Mon Sep 10 04:49:22 CDT 2018
>cmirror-2.02.180-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>device-mapper-1.02.149-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>device-mapper-libs-1.02.149-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>device-mapper-event-1.02.149-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>device-mapper-event-libs-1.02.149-8.el7    BUILT: Mon Sep 10 04:45:22 CDT 2018
>device-mapper-persistent-data-0.7.3-3.el7    BUILT: Tue Nov 14 05:07:18 CST 2017
>
>
>[root@harding-03 ~]# pcs status
>Cluster name: HARDING
>Stack: corosync
>Current DC: harding-02 (version 1.1.19-7.el7-c3c624ea3d) - partition with quorum
>Last updated: Thu Sep 27 10:43:04 2018
>Last change: Wed Sep 26 14:11:49 2018 by root via cibadmin on harding-02
>
>2 nodes configured
>5 resources configured
>
>Online: [ harding-02 harding-03 ]
>
>Full list of resources:
>
> smoke-apc      (stonith:fence_apc):    Started harding-02
> Clone Set: dlm-clone [dlm]
>     Started: [ harding-02 harding-03 ]
> Clone Set: clvmd-clone [clvmd]
>     Started: [ harding-02 harding-03 ]
>
>Daemon Status:
>  corosync: active/disabled
>  pacemaker: active/disabled
>  pcsd: active/enabled
>
>
>============================================================
>Iteration 10 of 10 started at Thu Sep 27 10:53:30 CDT 2018
>============================================================
>SCENARIO - [verify_thin_io_between_offline_mda_corruptions_repair]
>Create a snapshot and then verify it's io contents in between ONLINE pool mda corruptions and repairs
>Making pool volume
>lvcreate --activate ey --thinpool POOL -L 5G --profile thin-performance --zero n --poolmetadatasize 4M snapper_thinp
>
>Sanity checking pool device (POOL) metadata
>thin_check /dev/mapper/snapper_thinp-meta_swap.276
>examining superblock
>examining devices tree
>examining mapping tree
>checking space map counts
>
>Making origin volume
>lvcreate --activate ey --virtualsize 1G -T snapper_thinp/POOL -n origin
>lvcreate --activate ey --virtualsize 1G -T snapper_thinp/POOL -n other1
>lvcreate --activate ey --virtualsize 1G -T snapper_thinp/POOL -n other2
>lvcreate --activate ey --virtualsize 1G -T snapper_thinp/POOL -n other3
>lvcreate --activate ey -V 1G -T snapper_thinp/POOL -n other4
>lvcreate --activate ey -V 1G -T snapper_thinp/POOL -n other5
>  WARNING: Sum of all thin volume sizes (6.00 GiB) exceeds the size of thin pool snapper_thinp/POOL (5.00 GiB).
>Placing an XFS filesystem on origin volume
>warning: device is not properly aligned /dev/snapper_thinp/origin
>Mounting origin volume
>
>Writing files to /mnt/origin
>
>Checking files on /mnt/origin
>
>*** Pool MDA Corrupt/Restore iteration 1/5 ***
>syncing before snap creation...
>Creating thin snapshot of origin volume
>lvcreate --activate ey -y -k n -s /dev/snapper_thinp/origin -n snap1
>Mounting thin snapshot volume and origin
>mkdir -p /mnt/snap1
>mount -o nouuid /dev/snapper_thinp/snap1 /mnt/snap1
>Checking files on /mnt/snap1
>
>Writing files to /mnt/origin
>Checking files on /mnt/origin
>Swapping the current meta device table (snapper_thinp-POOL_tmeta: 0 8192 linear 253:11 65543) for an error target
>dmsetup suspend snapper_thinp-POOL_tmeta
>Loading in new meta device table (0 8192 error 253:11 65543)
>dmsetup load snapper_thinp-POOL_tmeta --table " 0 8192 error 253:11 65543"
>dmsetup resume snapper_thinp-POOL_tmeta
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>attr=twi-aot-F-
>vgchange -an snapper_thinp
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>lvconvert --yes --repair snapper_thinp/POOL
>  WARNING: Disabling lvmetad cache for repair command.
>  WARNING: Not using lvmetad because of repair.
>  WARNING: Sum of all thin volume sizes (7.00 GiB) exceeds the size of thin pools (5.00 GiB).
>  WARNING: LV snapper_thinp/POOL_meta0 holds a backup of the unrepaired metadata. Use lvremove when no longer required.
>  WARNING: New metadata LV snapper_thinp/POOL_tmeta might use different PVs.  Move it with pvmove if required.
>vgchange -ay snapper_thinp
>
>*** Pool MDA Corrupt/Restore iteration 2/5 ***
>syncing before snap creation...
>Creating thin snapshot of origin volume
>lvcreate --activate ey -y -k n -s /dev/snapper_thinp/origin -n snap2
>Mounting thin snapshot volume and origin
>mkdir -p /mnt/snap2
>mount -o nouuid /dev/snapper_thinp/snap2 /mnt/snap2
>Checking files on /mnt/snap2
>
>Writing files to /mnt/origin
>Checking files on /mnt/origin
>Swapping the current meta device table (snapper_thinp-POOL_tmeta: 0 8192 linear 253:3 65543) for an error target
>dmsetup suspend snapper_thinp-POOL_tmeta
>Loading in new meta device table (0 8192 error 253:3 65543)
>dmsetup load snapper_thinp-POOL_tmeta --table " 0 8192 error 253:3 65543"
>dmsetup resume snapper_thinp-POOL_tmeta
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:31.
>attr=twi-aot-F-
>vgchange -an snapper_thinp
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:31.
>lvconvert --yes --repair snapper_thinp/POOL
>  WARNING: Disabling lvmetad cache for repair command.
>  WARNING: Not using lvmetad because of repair.
>  WARNING: Sum of all thin volume sizes (8.00 GiB) exceeds the size of thin pools (5.00 GiB).
>  WARNING: LV snapper_thinp/POOL_meta1 holds a backup of the unrepaired metadata. Use lvremove when no longer required.
>  WARNING: New metadata LV snapper_thinp/POOL_tmeta might use different PVs.  Move it with pvmove if required.
>vgchange -ay snapper_thinp
>
>*** Pool MDA Corrupt/Restore iteration 3/5 ***
>syncing before snap creation...
>Creating thin snapshot of origin volume
>lvcreate --activate ey -y -k n -s /dev/snapper_thinp/origin -n snap3
>Mounting thin snapshot volume and origin
>mkdir -p /mnt/snap3
>mount -o nouuid /dev/snapper_thinp/snap3 /mnt/snap3
>Checking files on /mnt/snap3
>
>Writing files to /mnt/origin
>Checking files on /mnt/origin
>Swapping the current meta device table (snapper_thinp-POOL_tmeta: 0 8192 linear 253:3 10559495) for an error target
>dmsetup suspend snapper_thinp-POOL_tmeta
>Loading in new meta device table (0 8192 error 253:3 10559495)
>dmsetup load snapper_thinp-POOL_tmeta --table " 0 8192 error 253:3 10559495"
>dmsetup resume snapper_thinp-POOL_tmeta
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:31.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:33.
>attr=twi-aot-F-
>vgchange -an snapper_thinp
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:31.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:33.
>lvconvert --yes --repair snapper_thinp/POOL
>  WARNING: Disabling lvmetad cache for repair command.
>  WARNING: Not using lvmetad because of repair.
>  WARNING: Sum of all thin volume sizes (9.00 GiB) exceeds the size of thin pools (5.00 GiB).
>  WARNING: LV snapper_thinp/POOL_meta2 holds a backup of the unrepaired metadata. Use lvremove when no longer required.
>  WARNING: New metadata LV snapper_thinp/POOL_tmeta might use different PVs.  Move it with pvmove if required.
>vgchange -ay snapper_thinp
>
>*** Pool MDA Corrupt/Restore iteration 4/5 ***
>syncing before snap creation...
>Creating thin snapshot of origin volume
>lvcreate --activate ey -y -k n -s /dev/snapper_thinp/origin -n snap4
>Mounting thin snapshot volume and origin
>mkdir -p /mnt/snap4
>mount -o nouuid /dev/snapper_thinp/snap4 /mnt/snap4
>Checking files on /mnt/snap4
>
>Writing files to /mnt/origin
>Checking files on /mnt/origin
>Swapping the current meta device table (snapper_thinp-POOL_tmeta: 0 8192 linear 253:3 10567687) for an error target
>dmsetup suspend snapper_thinp-POOL_tmeta
>Loading in new meta device table (0 8192 error 253:3 10567687)
>dmsetup load snapper_thinp-POOL_tmeta --table " 0 8192 error 253:3 10567687"
>dmsetup resume snapper_thinp-POOL_tmeta
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:31.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:33.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:35.
>attr=twi-aot-F-
>vgchange -an snapper_thinp
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:31.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:33.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:35.
>lvconvert --yes --repair snapper_thinp/POOL
>  WARNING: Disabling lvmetad cache for repair command.
>  WARNING: Not using lvmetad because of repair.
>  WARNING: Sum of all thin volume sizes (10.00 GiB) exceeds the size of thin pools (5.00 GiB).
>  WARNING: LV snapper_thinp/POOL_meta3 holds a backup of the unrepaired metadata. Use lvremove when no longer required.
>  WARNING: New metadata LV snapper_thinp/POOL_tmeta might use different PVs.  Move it with pvmove if required.
>vgchange -ay snapper_thinp
>
>*** Pool MDA Corrupt/Restore iteration 5/5 ***
>syncing before snap creation...
>Creating thin snapshot of origin volume
>lvcreate --activate ey -y -k n -s /dev/snapper_thinp/origin -n snap5
>Mounting thin snapshot volume and origin
>mkdir -p /mnt/snap5
>mount -o nouuid /dev/snapper_thinp/snap5 /mnt/snap5
>Checking files on /mnt/snap5
>
>Writing files to /mnt/origin
>Checking files on /mnt/origin
>Swapping the current meta device table (snapper_thinp-POOL_tmeta: 0 8192 linear 253:3 10575879) for an error target
>dmsetup suspend snapper_thinp-POOL_tmeta
>Loading in new meta device table (0 8192 error 253:3 10575879)
>dmsetup load snapper_thinp-POOL_tmeta --table " 0 8192 error 253:3 10575879"
>dmsetup resume snapper_thinp-POOL_tmeta
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:31.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:33.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:35.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:37.
>attr=twi-aot-F-
>vgchange -an snapper_thinp
>  WARNING: Cannot get thin-pool major:minor for thin device 253:23.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:24.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:25.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:26.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:27.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:28.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:29.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:31.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:33.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:35.
>  WARNING: Cannot get thin-pool major:minor for thin device 253:37.
>lvconvert --yes --repair snapper_thinp/POOL
>  WARNING: Disabling lvmetad cache for repair command.
>  WARNING: Not using lvmetad because of repair.
>  WARNING: Sum of all thin volume sizes (11.00 GiB) exceeds the size of thin pools (5.00 GiB).
>  WARNING: LV snapper_thinp/POOL_meta4 holds a backup of the unrepaired metadata. Use lvremove when no longer required.
>  WARNING: New metadata LV snapper_thinp/POOL_tmeta might use different PVs.  Move it with pvmove if required.
>vgchange -ay snapper_thinp
>
>
>Checking files on /mnt/snap1
>Removing snap volume snapper_thinp/snap1
>lvremove -f /dev/snapper_thinp/snap1
>Checking files on /mnt/snap2
>Removing snap volume snapper_thinp/snap2
>lvremove -f /dev/snapper_thinp/snap2
>Checking files on /mnt/snap3
>Removing snap volume snapper_thinp/snap3
>lvremove -f /dev/snapper_thinp/snap3
>Checking files on /mnt/snap4
>Removing snap volume snapper_thinp/snap4
>lvremove -f /dev/snapper_thinp/snap4
>Checking files on /mnt/snap5
>Removing snap volume snapper_thinp/snap5
>lvremove -f /dev/snapper_thinp/snap5
>Removing thin origin and other virtual thin volumes
>Removing pool snapper_thinp/POOL
>
>
>

Actions: View

Attachments on bug 1633583: 1487720 | 1487721 | 1487823