Attachment 1876518 Details for Bug 2073920 – rook osd prepare pod logs

rook osd prepare pod logs

rook-osd-prepare.log (text/plain), 7.72 KB, created by Tal Yichye on 2022-05-02 14:14:06 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Tal Yichye

Created: 2022-05-02 14:14:06 UTC

Size: 7.72 KB

patch

obsolete

>2022-05-02 10:24:58.679036 I | cephcmd: desired devices to configure osds: [{Name:/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc OSDsPerDevice:1 MetadataDevice: DatabaseSizeMB:0 DeviceClass: InitialWeight: IsFilter:false IsDevicePathFilter:false}]
>2022-05-02 10:24:58.682102 I | rookcmd: starting Rook v4.10.1-0.cd3b4232da09a72357233b5dcad1b76a4969c5de with arguments '/rook/rook ceph osd provision'
>2022-05-02 10:24:58.682126 I | rookcmd: flag values: --cluster-id=fa3d2bde-54ca-4d38-a081-7b8ea5dceb85, --cluster-name=ocs-storagecluster-cephcluster, --data-device-filter=, --data-device-path-filter=, --data-devices=[{"id":"/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc","storeConfig":{"osdsPerDevice":1}}], --encrypted-device=false, --force-format=false, --help=false, --location=, --log-level=DEBUG, --metadata-device=, --node-name=ocs-deviceset-ibm-odf-test-1-data-0xx8fc, --operator-image=, --osd-crush-device-class=, --osd-crush-initial-weight=, --osd-database-size=0, --osd-wal-size=576, --osds-per-device=1, --pvc-backed-osd=true, --service-account=
>2022-05-02 10:24:58.682132 I | op-mon: parsing mon endpoints: a=172.30.62.126:6789,b=172.30.121.98:6789,c=172.30.130.90:6789
>2022-05-02 10:24:58.702004 I | op-osd: CRUSH location=root=default host=ocs-deviceset-ibm-odf-test-1-data-0xx8fc rack=rack2
>2022-05-02 10:24:58.702049 I | cephcmd: crush location of osd: root=default host=ocs-deviceset-ibm-odf-test-1-data-0xx8fc rack=rack2
>2022-05-02 10:24:58.702075 D | exec: Running command: dmsetup version
>2022-05-02 10:24:58.707948 I | cephosd: Library version:   1.02.177-RHEL8 (2021-05-19)
>Driver version:    4.43.0
>2022-05-02 10:24:58.721731 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config
>2022-05-02 10:24:58.722009 I | cephclient: generated admin config in /var/lib/rook/openshift-storage
>2022-05-02 10:24:58.722293 D | cephclient: config file @ /etc/ceph/ceph.conf:
>[global]
>fsid                        = 55c4dc64-f525-46ec-88fc-4b14c8d33b1a
>mon initial members         = b c a
>mon host                    = [v2:172.30.121.98:3300,v1:172.30.121.98:6789],[v2:172.30.130.90:3300,v1:172.30.130.90:6789],[v2:172.30.62.126:3300,v1:172.30.62.126:6789]
>bdev_flock_retry            = 20
>mon_osd_full_ratio          = .85
>mon_osd_backfillfull_ratio  = .8
>mon_osd_nearfull_ratio      = .75
>mon_max_pg_per_osd          = 600
>mon_pg_warn_max_object_skew = 0
>mon_data_avail_warn         = 15
>
>[osd]
>osd_memory_target_cgroup_limit_ratio = 0.8
>
>[client.admin]
>keyring = /var/lib/rook/openshift-storage/client.admin.keyring
>
>2022-05-02 10:24:58.722323 I | cephosd: discovering hardware
>2022-05-02 10:24:58.722338 D | exec: Running command: lsblk /mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc --bytes --nodeps --pairs --paths --output SIZE,ROTA,RO,TYPE,PKNAME,NAME,KNAME
>2022-05-02 10:24:58.727981 D | exec: Running command: sgdisk --print /mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc
>2022-05-02 10:24:58.733364 D | exec: Running command: udevadm info --query=property /dev/dm-3
>2022-05-02 10:24:58.743886 I | cephosd: creating and starting the osds
>2022-05-02 10:24:58.743920 D | cephosd: desiredDevices are [{Name:/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc OSDsPerDevice:1 MetadataDevice: DatabaseSizeMB:0 DeviceClass: InitialWeight: IsFilter:false IsDevicePathFilter:false}]
>2022-05-02 10:24:58.743925 D | cephosd: context.Devices are:
>2022-05-02 10:24:58.743947 D | cephosd: &{Name:/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc Parent: HasChildren:false DevLinks:/dev/disk/by-id/scsi-36005076810810128480000000000384b /dev/disk/by-id/dm-name-mpathau /dev/mapper/mpathau /dev/disk/by-id/dm-uuid-mpath-36005076810810128480000000000384b /dev/disk/by-id/wwn-0x6005076810810128480000000000384b Size:549755813888 UUID:25291d52-b634-4117-8f29-3de3813b5826 Serial: Type:data Rotational:true Readonly:false Partitions:[] Filesystem: Vendor: Model: WWN: WWNVendorExtension: Empty:false CephVolumeData: RealPath:/dev/mapper/mpathau KernelName:dm-3 Encrypted:false}
>2022-05-02 10:24:58.743955 D | exec: Running command: cryptsetup luksDump /mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc
>2022-05-02 10:24:58.759564 E | cephosd: failed to determine if the encrypted block "/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc" is from our cluster. failed to dump LUKS header for disk "/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc". Device /mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc is not a valid LUKS device.
>WARNING: Locking directory /run/cryptsetup is missing!: exit status 1
>2022-05-02 10:24:58.759744 D | exec: Running command: stdbuf -oL ceph-volume --log-path /tmp/ceph-log raw list /mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc --format json
>2022-05-02 10:24:59.181241 D | cephosd: {}
>2022-05-02 10:24:59.181329 I | cephosd: 0 ceph-volume raw osd devices configured on this node
>2022-05-02 10:24:59.181350 I | cephosd: device "/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc" is available.
>2022-05-02 10:24:59.181361 I | cephosd: "/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc" found in the desired devices
>2022-05-02 10:24:59.181399 I | cephosd: device "/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc" is selected by the device filter/name "/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc"
>2022-05-02 10:24:59.203134 I | cephosd: configuring osd devices: {"Entries":{"data":{"Data":-1,"Metadata":null,"Config":{"Name":"/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc","OSDsPerDevice":1,"MetadataDevice":"","DatabaseSizeMB":0,"DeviceClass":"hdd","InitialWeight":"","IsFilter":false,"IsDevicePathFilter":false},"PersistentDevicePaths":["/dev/disk/by-id/scsi-36005076810810128480000000000384b","/dev/disk/by-id/dm-name-mpathau","/dev/mapper/mpathau","/dev/disk/by-id/dm-uuid-mpath-36005076810810128480000000000384b","/dev/disk/by-id/wwn-0x6005076810810128480000000000384b"],"DeviceInfo":{"name":"/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc","parent":"","hasChildren":false,"devLinks":"/dev/disk/by-id/scsi-36005076810810128480000000000384b /dev/disk/by-id/dm-name-mpathau /dev/mapper/mpathau /dev/disk/by-id/dm-uuid-mpath-36005076810810128480000000000384b /dev/disk/by-id/wwn-0x6005076810810128480000000000384b","size":549755813888,"uuid":"25291d52-b634-4117-8f29-3de3813b5826","serial":"","type":"data","rotational":true,"readOnly":false,"Partitions":null,"filesystem":"","vendor":"","model":"","wwn":"","wwnVendorExtension":"","empty":false,"real-path":"/dev/mapper/mpathau","kernel-name":"dm-3"}}}}
>2022-05-02 10:24:59.203239 I | cephclient: getting or creating ceph auth key "client.bootstrap-osd"
>2022-05-02 10:24:59.203259 D | exec: Running command: ceph auth get-or-create-key client.bootstrap-osd mon allow profile bootstrap-osd --connect-timeout=15 --cluster=openshift-storage --conf=/var/lib/rook/openshift-storage/openshift-storage.config --name=client.admin --keyring=/var/lib/rook/openshift-storage/client.admin.keyring --format json
>2022-05-02 10:24:59.797955 D | exec: Running command: lsblk /mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc --bytes --nodeps --pairs --paths --output SIZE,ROTA,RO,TYPE,PKNAME,NAME,KNAME
>2022-05-02 10:24:59.803457 I | cephosd: configuring new device "/mnt/ocs-deviceset-ibm-odf-test-1-data-0xx8fc"
>2022-05-02 10:24:59.803498 I | cephosd: devlink names:
>2022-05-02 10:24:59.803515 I | cephosd: /dev/disk/by-id/scsi-36005076810810128480000000000384b
>2022-05-02 10:24:59.803527 I | cephosd: /dev/disk/by-id/dm-name-mpathau
>2022-05-02 10:24:59.803537 I | cephosd: /dev/mapper/mpathau
>2022-05-02 10:24:59.803546 I | cephosd: /dev/disk/by-id/dm-uuid-mpath-36005076810810128480000000000384b
>2022-05-02 10:24:59.803556 I | cephosd: /dev/disk/by-id/wwn-0x6005076810810128480000000000384b
>2022-05-02 10:24:59.803582 D | exec: Running command: stdbuf -oL ceph-volume --log-path /var/log/ceph/ocs-deviceset-ibm-odf-test-1-data-0xx8fc raw prepare --bluestore --data /dev/mapper/mpathau

Actions: View

Attachments on bug 2073920: 1871709 | 1871768 | 1871769 | 1876518 | 1876691 | 1876693