Attachment 1481330 Details for Bug 1626073 – ceph-volume encrypted log

ceph-volume encrypted log

ceph-volume_encrypted.log (text/plain), 100.79 KB, created by Parikshith on 2018-09-06 14:09:37 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Parikshith

Created: 2018-09-06 14:09:37 UTC

Size: 100.79 KB

patch

obsolete

>[2018-09-06 12:06:15,581][ceph_volume.main][INFO  ] Running command: ceph-volume  simple scan /var/lib/ceph/osd/master-2
>[2018-09-06 12:06:15,582][ceph_volume.main][ERROR ] ignoring inability to load ceph.conf
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 145, in main
>    conf.ceph = configuration.load(conf.path)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/configuration.py", line 36, in load
>    raise exceptions.ConfigurationError(abspath=abspath)
>ConfigurationError: Unable to load expected Ceph config at: /etc/ceph/ceph.conf
>[2018-09-06 12:06:15,583][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-2
>[2018-09-06 12:06:15,587][ceph_volume.process][INFO  ] stderr lsblk: /var/lib/ceph/osd/master-2: not a block device
>[2018-09-06 12:06:15,587][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-2
>[2018-09-06 12:06:15,591][ceph_volume.process][INFO  ] stderr lsblk: /var/lib/ceph/osd/master-2: not a block device
>[2018-09-06 12:06:15,603][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:06:15,622][ceph_volume.process][INFO  ] stdout /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f is active and is in use.
>[2018-09-06 12:06:15,622][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:06:15,622][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:06:15,622][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:06:15,622][ceph_volume.process][INFO  ] stdout device:  /dev/sdb1
>[2018-09-06 12:06:15,622][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:06:15,622][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:06:15,622][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:06:15,623][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb1
>[2018-09-06 12:06:15,628][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" KNAME="/dev/sdb1" MAJ:MIN="8:17" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="f9ca1dfa-840d-4a25-bd2d-326893a5218d" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph data"
>[2018-09-06 12:06:15,629][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:06:15,634][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:06:15,634][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:06:15,634][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:06:15,635][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:06:15,635][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:06:15,635][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:06:15,635][ceph_volume.devices.simple.scan][INFO  ] detecting if argument is a device or a directory: /var/lib/ceph/osd/master-2
>[2018-09-06 12:06:15,635][ceph_volume.devices.simple.scan][INFO  ] will scan directly, path is a directory
>[2018-09-06 12:06:15,635][ceph_volume.devices.simple.scan][INFO  ] will scan encrypted OSD directory at path: /var/lib/ceph/osd/master-2
>[2018-09-06 12:06:15,635][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb1
>[2018-09-06 12:06:15,639][ceph_volume.process][INFO  ] stdout 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:06:15,639][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:06:15,645][ceph_volume.process][INFO  ] stdout /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f is active and is in use.
>[2018-09-06 12:06:15,645][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:06:15,645][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:06:15,645][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:06:15,645][ceph_volume.process][INFO  ] stdout device:  /dev/sdb1
>[2018-09-06 12:06:15,645][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:06:15,645][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:06:15,646][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:06:15,650][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdb3
>[2018-09-06 12:06:15,654][ceph_volume.process][INFO  ] stderr Device sdb3 not found
>[2018-09-06 12:06:15,655][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:06:15,655][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdb3
>[2018-09-06 12:06:15,658][ceph_volume.process][INFO  ] stdout ID_FS_UUID=19d732b3-3d1f-4b72-9445-0f150e544b76
>[2018-09-06 12:06:15,658][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=19d732b3-3d1f-4b72-9445-0f150e544b76
>[2018-09-06 12:06:15,658][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1.0
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=ext4
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=filesystem
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20lockbox
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=00000000-0000-0000-0000-000000000000
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=fb3aabf9-d25f-47cc-bf5e-721d1816496b
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=3
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=2048
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=20480
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:16
>[2018-09-06 12:06:15,659][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb3
>[2018-09-06 12:06:15,664][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" KNAME="/dev/sdb3" MAJ:MIN="8:19" FSTYPE="ext4" MOUNTPOINT="/var/lib/ceph/osd-lockbox/4eb40aad-c132-4846-882c-74794cc8e66f" LABEL="" UUID="19d732b3-3d1f-4b72-9445-0f150e544b76" RO="0" RM="0" MODEL="" SIZE="10M" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph lockbox"
>[2018-09-06 12:06:15,665][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:06:15,670][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:06:15,670][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:06:15,670][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:06:15,670][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:06:15,670][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:06:15,670][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:06:15,671][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb3
>[2018-09-06 12:06:15,674][ceph_volume.process][INFO  ] stdout 00000000-0000-0000-0000-000000000000
>[2018-09-06 12:06:15,675][ceph_volume.process][INFO  ] Running command: /bin/ceph --cluster ceph --name client.osd-lockbox.4eb40aad-c132-4846-882c-74794cc8e66f --keyring /var/lib/ceph/osd-lockbox/4eb40aad-c132-4846-882c-74794cc8e66f/keyring config-key get dm-crypt/osd/4eb40aad-c132-4846-882c-74794cc8e66f/luks
>[2018-09-06 12:06:15,785][ceph_volume.process][INFO  ] stderr 2018-09-06 12:06:15.775322 7f798d1d2700 -1 Errors while parsing config file!
>[2018-09-06 12:06:15,786][ceph_volume.process][INFO  ] stderr 2018-09-06 12:06:15.775326 7f798d1d2700 -1 parse_file: cannot open /etc/ceph/ceph.conf: (2) No such file or directory
>[2018-09-06 12:06:15,786][ceph_volume.process][INFO  ] stderr 2018-09-06 12:06:15.775327 7f798d1d2700 -1 parse_file: cannot open ~/.ceph/ceph.conf: (2) No such file or directory
>[2018-09-06 12:06:15,786][ceph_volume.process][INFO  ] stderr 2018-09-06 12:06:15.775328 7f798d1d2700 -1 parse_file: cannot open ceph.conf: (2) No such file or directory
>[2018-09-06 12:06:15,786][ceph_volume.process][INFO  ] stderr Error initializing cluster client: ObjectNotFound('error calling conf_read_file',)
>[2018-09-06 12:06:15,786][ceph_volume][ERROR ] exception caught by decorator
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 59, in newfunc
>    return f(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 153, in main
>    terminal.dispatch(self.mapper, subcommand_args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/main.py", line 33, in main
>    terminal.dispatch(self.mapper, self.argv)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 350, in main
>    self.scan(args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 16, in is_root
>    return func(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 243, in scan
>    osd_metadata = self.scan_encrypted(osd_path)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 165, in scan_encrypted
>    os.path.join(lockbox_path, 'keyring')
>  File "/usr/lib/python2.7/site-packages/ceph_volume/util/encryption.py", line 131, in get_dmcrypt_key
>    raise RuntimeError('Unable to retrieve dmcrypt secret')
>RuntimeError: Unable to retrieve dmcrypt secret
>[2018-09-06 12:07:10,733][ceph_volume.main][INFO  ] Running command: ceph-volume  simple scan /var/lib/ceph/osd/master-2 --cluster master
>[2018-09-06 12:07:10,733][ceph_volume.main][ERROR ] ignoring inability to load ceph.conf
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 145, in main
>    conf.ceph = configuration.load(conf.path)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/configuration.py", line 36, in load
>    raise exceptions.ConfigurationError(abspath=abspath)
>ConfigurationError: Unable to load expected Ceph config at: /etc/ceph/ceph.conf
>[2018-09-06 12:07:10,734][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-2
>[2018-09-06 12:07:10,738][ceph_volume.process][INFO  ] stderr lsblk: /var/lib/ceph/osd/master-2: not a block device
>[2018-09-06 12:08:07,407][ceph_volume.main][INFO  ] Running command: ceph-volume  simple scan /dev/sdb1
>[2018-09-06 12:08:07,407][ceph_volume.main][ERROR ] ignoring inability to load ceph.conf
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 145, in main
>    conf.ceph = configuration.load(conf.path)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/configuration.py", line 36, in load
>    raise exceptions.ConfigurationError(abspath=abspath)
>ConfigurationError: Unable to load expected Ceph config at: /etc/ceph/ceph.conf
>[2018-09-06 12:08:07,408][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb1
>[2018-09-06 12:08:07,413][ceph_volume.process][INFO  ] stdout NAME="sdb1" KNAME="sdb1" MAJ:MIN="8:17" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="f9ca1dfa-840d-4a25-bd2d-326893a5218d" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdb" PARTLABEL="ceph data"
>[2018-09-06 12:08:07,414][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb1
>[2018-09-06 12:08:07,418][ceph_volume.process][INFO  ] stdout NAME="sdb1" KNAME="sdb1" MAJ:MIN="8:17" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="f9ca1dfa-840d-4a25-bd2d-326893a5218d" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdb" PARTLABEL="ceph data"
>[2018-09-06 12:08:07,419][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb1
>[2018-09-06 12:08:07,423][ceph_volume.process][INFO  ] stdout NAME="sdb1" KNAME="sdb1" MAJ:MIN="8:17" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="f9ca1dfa-840d-4a25-bd2d-326893a5218d" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdb" PARTLABEL="ceph data"
>[2018-09-06 12:08:07,431][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdb1
>[2018-09-06 12:08:07,436][ceph_volume.process][INFO  ] stderr Device sdb1 not found
>[2018-09-06 12:08:07,436][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:08:07,436][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdb1
>[2018-09-06 12:08:07,439][ceph_volume.process][INFO  ] stdout ID_FS_UUID=f9ca1dfa-840d-4a25-bd2d-326893a5218d
>[2018-09-06 12:08:07,439][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=f9ca1dfa-840d-4a25-bd2d-326893a5218d
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=crypto_LUKS
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=crypto
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20data
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=4fbd7e29-9d25-41b8-afd0-35865ceff05d
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=1
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=10508288
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=1943016847
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:16
>[2018-09-06 12:08:07,440][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb1
>[2018-09-06 12:08:07,445][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" KNAME="/dev/sdb1" MAJ:MIN="8:17" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="f9ca1dfa-840d-4a25-bd2d-326893a5218d" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph data"
>[2018-09-06 12:08:07,445][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:08:07,451][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:08:07,451][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:08:07,451][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:08:07,451][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:08:07,451][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:08:07,451][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:08:07,451][ceph_volume.devices.simple.scan][INFO  ] detecting if argument is a device or a directory: /dev/sdb1
>[2018-09-06 12:08:07,451][ceph_volume.devices.simple.scan][INFO  ] path is not a directory, will check if mounted
>[2018-09-06 12:08:07,458][ceph_volume.util.system][INFO  ] %s was not found as mounted
>[2018-09-06 12:08:07,458][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb1
>[2018-09-06 12:08:07,462][ceph_volume.process][INFO  ] stdout 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:08:07,462][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:08:07,467][ceph_volume.process][INFO  ] stdout /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f is active and is in use.
>[2018-09-06 12:08:07,468][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:08:07,468][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:08:07,468][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:08:07,468][ceph_volume.process][INFO  ] stdout device:  /dev/sdb1
>[2018-09-06 12:08:07,468][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:08:07,468][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:08:07,468][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:08:07,472][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdb3
>[2018-09-06 12:08:07,477][ceph_volume.process][INFO  ] stderr Device sdb3 not found
>[2018-09-06 12:08:07,477][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:08:07,477][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdb3
>[2018-09-06 12:08:07,480][ceph_volume.process][INFO  ] stdout ID_FS_UUID=19d732b3-3d1f-4b72-9445-0f150e544b76
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=19d732b3-3d1f-4b72-9445-0f150e544b76
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1.0
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=ext4
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=filesystem
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20lockbox
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=00000000-0000-0000-0000-000000000000
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=fb3aabf9-d25f-47cc-bf5e-721d1816496b
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=3
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=2048
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=20480
>[2018-09-06 12:08:07,481][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:16
>[2018-09-06 12:08:07,482][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb3
>[2018-09-06 12:08:07,487][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" KNAME="/dev/sdb3" MAJ:MIN="8:19" FSTYPE="ext4" MOUNTPOINT="/var/lib/ceph/osd-lockbox/4eb40aad-c132-4846-882c-74794cc8e66f" LABEL="" UUID="19d732b3-3d1f-4b72-9445-0f150e544b76" RO="0" RM="0" MODEL="" SIZE="10M" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph lockbox"
>[2018-09-06 12:08:07,487][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:08:07,492][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:08:07,493][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:08:07,493][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:08:07,493][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:08:07,493][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:08:07,493][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:08:07,493][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb3
>[2018-09-06 12:08:07,497][ceph_volume.process][INFO  ] stdout 00000000-0000-0000-0000-000000000000
>[2018-09-06 12:08:07,497][ceph_volume.process][INFO  ] Running command: /bin/ceph --cluster ceph --name client.osd-lockbox.4eb40aad-c132-4846-882c-74794cc8e66f --keyring /var/lib/ceph/osd-lockbox/4eb40aad-c132-4846-882c-74794cc8e66f/keyring config-key get dm-crypt/osd/4eb40aad-c132-4846-882c-74794cc8e66f/luks
>[2018-09-06 12:08:07,608][ceph_volume.process][INFO  ] stderr 2018-09-06 12:08:07.597354 7f1bf2f5e700 -1 Errors while parsing config file!
>[2018-09-06 12:08:07,608][ceph_volume.process][INFO  ] stderr 2018-09-06 12:08:07.597359 7f1bf2f5e700 -1 parse_file: cannot open /etc/ceph/ceph.conf: (2) No such file or directory
>[2018-09-06 12:08:07,608][ceph_volume.process][INFO  ] stderr 2018-09-06 12:08:07.597359 7f1bf2f5e700 -1 parse_file: cannot open ~/.ceph/ceph.conf: (2) No such file or directory
>[2018-09-06 12:08:07,608][ceph_volume.process][INFO  ] stderr 2018-09-06 12:08:07.597360 7f1bf2f5e700 -1 parse_file: cannot open ceph.conf: (2) No such file or directory
>[2018-09-06 12:08:07,608][ceph_volume.process][INFO  ] stderr Error initializing cluster client: ObjectNotFound('error calling conf_read_file',)
>[2018-09-06 12:08:07,609][ceph_volume][ERROR ] exception caught by decorator
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 59, in newfunc
>    return f(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 153, in main
>    terminal.dispatch(self.mapper, subcommand_args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/main.py", line 33, in main
>    terminal.dispatch(self.mapper, self.argv)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 350, in main
>    self.scan(args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 16, in is_root
>    return func(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 235, in scan
>    osd_metadata = self.scan_encrypted()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 165, in scan_encrypted
>    os.path.join(lockbox_path, 'keyring')
>  File "/usr/lib/python2.7/site-packages/ceph_volume/util/encryption.py", line 131, in get_dmcrypt_key
>    raise RuntimeError('Unable to retrieve dmcrypt secret')
>RuntimeError: Unable to retrieve dmcrypt secret
>[2018-09-06 12:18:02,151][ceph_volume.main][INFO  ] Running command: ceph-volume  simple scan /var/lib/ceph/osd/master-2
>[2018-09-06 12:18:02,151][ceph_volume.main][ERROR ] ignoring inability to load ceph.conf
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 145, in main
>    conf.ceph = configuration.load(conf.path)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/configuration.py", line 36, in load
>    raise exceptions.ConfigurationError(abspath=abspath)
>ConfigurationError: Unable to load expected Ceph config at: /etc/ceph/ceph.conf
>[2018-09-06 12:18:02,153][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-2
>[2018-09-06 12:18:02,157][ceph_volume.process][INFO  ] stderr lsblk: /var/lib/ceph/osd/master-2: not a block device
>[2018-09-06 12:18:02,157][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-2
>[2018-09-06 12:18:02,161][ceph_volume.process][INFO  ] stderr lsblk: /var/lib/ceph/osd/master-2: not a block device
>[2018-09-06 12:18:02,172][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:18:02,192][ceph_volume.process][INFO  ] stdout /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f is active and is in use.
>[2018-09-06 12:18:02,192][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:18:02,192][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:18:02,192][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:18:02,192][ceph_volume.process][INFO  ] stdout device:  /dev/sdb1
>[2018-09-06 12:18:02,192][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:18:02,192][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:18:02,192][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:18:02,193][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb1
>[2018-09-06 12:18:02,198][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" KNAME="/dev/sdb1" MAJ:MIN="8:17" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="f9ca1dfa-840d-4a25-bd2d-326893a5218d" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph data"
>[2018-09-06 12:18:02,199][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:18:02,204][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:18:02,204][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:18:02,204][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:18:02,204][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:18:02,204][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:18:02,205][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:18:02,205][ceph_volume.devices.simple.scan][INFO  ] detecting if argument is a device or a directory: /var/lib/ceph/osd/master-2
>[2018-09-06 12:18:02,205][ceph_volume.devices.simple.scan][INFO  ] will scan directly, path is a directory
>[2018-09-06 12:18:02,205][ceph_volume.devices.simple.scan][INFO  ] will scan encrypted OSD directory at path: /var/lib/ceph/osd/master-2
>[2018-09-06 12:18:02,205][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb1
>[2018-09-06 12:18:02,209][ceph_volume.process][INFO  ] stdout 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:18:02,209][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:18:02,214][ceph_volume.process][INFO  ] stdout /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f is active and is in use.
>[2018-09-06 12:18:02,215][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:18:02,215][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:18:02,215][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:18:02,215][ceph_volume.process][INFO  ] stdout device:  /dev/sdb1
>[2018-09-06 12:18:02,215][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:18:02,215][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:18:02,215][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:18:02,219][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdb3
>[2018-09-06 12:18:02,224][ceph_volume.process][INFO  ] stderr Device sdb3 not found
>[2018-09-06 12:18:02,224][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:18:02,224][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdb3
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_FS_UUID=19d732b3-3d1f-4b72-9445-0f150e544b76
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=19d732b3-3d1f-4b72-9445-0f150e544b76
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1.0
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=ext4
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=filesystem
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20lockbox
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=00000000-0000-0000-0000-000000000000
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=fb3aabf9-d25f-47cc-bf5e-721d1816496b
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=3
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=2048
>[2018-09-06 12:18:02,228][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=20480
>[2018-09-06 12:18:02,229][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:16
>[2018-09-06 12:18:02,229][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb3
>[2018-09-06 12:18:02,234][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" KNAME="/dev/sdb3" MAJ:MIN="8:19" FSTYPE="ext4" MOUNTPOINT="/var/lib/ceph/osd-lockbox/4eb40aad-c132-4846-882c-74794cc8e66f" LABEL="" UUID="19d732b3-3d1f-4b72-9445-0f150e544b76" RO="0" RM="0" MODEL="" SIZE="10M" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph lockbox"
>[2018-09-06 12:18:02,234][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:18:02,240][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:18:02,240][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:18:02,240][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:18:02,240][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:18:02,240][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:18:02,240][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:18:02,240][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb3
>[2018-09-06 12:18:02,244][ceph_volume.process][INFO  ] stdout 00000000-0000-0000-0000-000000000000
>[2018-09-06 12:18:02,244][ceph_volume.process][INFO  ] Running command: /bin/ceph --cluster ceph --name client.osd-lockbox.4eb40aad-c132-4846-882c-74794cc8e66f --keyring /var/lib/ceph/osd-lockbox/4eb40aad-c132-4846-882c-74794cc8e66f/keyring config-key get dm-crypt/osd/4eb40aad-c132-4846-882c-74794cc8e66f/luks
>[2018-09-06 12:18:02,357][ceph_volume.process][INFO  ] stderr 2018-09-06 12:18:02.347025 7f1b47259700 -1 Errors while parsing config file!
>[2018-09-06 12:18:02,358][ceph_volume.process][INFO  ] stderr 2018-09-06 12:18:02.347030 7f1b47259700 -1 parse_file: cannot open /etc/ceph/ceph.conf: (2) No such file or directory
>[2018-09-06 12:18:02,358][ceph_volume.process][INFO  ] stderr 2018-09-06 12:18:02.347031 7f1b47259700 -1 parse_file: cannot open ~/.ceph/ceph.conf: (2) No such file or directory
>[2018-09-06 12:18:02,358][ceph_volume.process][INFO  ] stderr 2018-09-06 12:18:02.347032 7f1b47259700 -1 parse_file: cannot open ceph.conf: (2) No such file or directory
>[2018-09-06 12:18:02,358][ceph_volume.process][INFO  ] stderr Error initializing cluster client: ObjectNotFound('error calling conf_read_file',)
>[2018-09-06 12:18:02,358][ceph_volume][ERROR ] exception caught by decorator
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 59, in newfunc
>    return f(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 153, in main
>    terminal.dispatch(self.mapper, subcommand_args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/main.py", line 33, in main
>    terminal.dispatch(self.mapper, self.argv)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 350, in main
>    self.scan(args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 16, in is_root
>    return func(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 243, in scan
>    osd_metadata = self.scan_encrypted(osd_path)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/scan.py", line 165, in scan_encrypted
>    os.path.join(lockbox_path, 'keyring')
>  File "/usr/lib/python2.7/site-packages/ceph_volume/util/encryption.py", line 131, in get_dmcrypt_key
>    raise RuntimeError('Unable to retrieve dmcrypt secret')
>RuntimeError: Unable to retrieve dmcrypt secret
>[2018-09-06 12:57:57,463][ceph_volume.main][INFO  ] Running command: ceph-volume  simple scan /var/lib/ceph/osd/master-2
>[2018-09-06 12:57:57,465][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-2
>[2018-09-06 12:57:57,469][ceph_volume.process][INFO  ] stderr lsblk: /var/lib/ceph/osd/master-2: not a block device
>[2018-09-06 12:57:57,469][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-2
>[2018-09-06 12:57:57,473][ceph_volume.process][INFO  ] stderr lsblk: /var/lib/ceph/osd/master-2: not a block device
>[2018-09-06 12:57:57,485][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:57:57,504][ceph_volume.process][INFO  ] stdout /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f is active and is in use.
>[2018-09-06 12:57:57,504][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:57:57,504][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:57:57,504][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:57:57,504][ceph_volume.process][INFO  ] stdout device:  /dev/sdb1
>[2018-09-06 12:57:57,504][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:57:57,505][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:57:57,505][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:57:57,505][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb1
>[2018-09-06 12:57:57,510][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" KNAME="/dev/sdb1" MAJ:MIN="8:17" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="f9ca1dfa-840d-4a25-bd2d-326893a5218d" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph data"
>[2018-09-06 12:57:57,511][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:57:57,516][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:57:57,516][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:57:57,516][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:57,517][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:57:57,517][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:57,517][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:57:57,517][ceph_volume.devices.simple.scan][INFO  ] detecting if argument is a device or a directory: /var/lib/ceph/osd/master-2
>[2018-09-06 12:57:57,517][ceph_volume.devices.simple.scan][INFO  ] will scan directly, path is a directory
>[2018-09-06 12:57:57,517][ceph_volume.devices.simple.scan][INFO  ] will scan encrypted OSD directory at path: /var/lib/ceph/osd/master-2
>[2018-09-06 12:57:57,517][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb1
>[2018-09-06 12:57:57,521][ceph_volume.process][INFO  ] stdout 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:57:57,521][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:57:57,527][ceph_volume.process][INFO  ] stdout /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f is active and is in use.
>[2018-09-06 12:57:57,527][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:57:57,527][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:57:57,527][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:57:57,527][ceph_volume.process][INFO  ] stdout device:  /dev/sdb1
>[2018-09-06 12:57:57,527][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:57:57,527][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:57:57,527][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:57:57,532][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdb3
>[2018-09-06 12:57:57,536][ceph_volume.process][INFO  ] stderr Device sdb3 not found
>[2018-09-06 12:57:57,536][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:57:57,537][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdb3
>[2018-09-06 12:57:57,540][ceph_volume.process][INFO  ] stdout ID_FS_UUID=19d732b3-3d1f-4b72-9445-0f150e544b76
>[2018-09-06 12:57:57,540][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=19d732b3-3d1f-4b72-9445-0f150e544b76
>[2018-09-06 12:57:57,540][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1.0
>[2018-09-06 12:57:57,540][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=ext4
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=filesystem
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20lockbox
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=00000000-0000-0000-0000-000000000000
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=fb3aabf9-d25f-47cc-bf5e-721d1816496b
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=3
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=2048
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=20480
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:16
>[2018-09-06 12:57:57,541][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb3
>[2018-09-06 12:57:57,546][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" KNAME="/dev/sdb3" MAJ:MIN="8:19" FSTYPE="ext4" MOUNTPOINT="/var/lib/ceph/osd-lockbox/4eb40aad-c132-4846-882c-74794cc8e66f" LABEL="" UUID="19d732b3-3d1f-4b72-9445-0f150e544b76" RO="0" RM="0" MODEL="" SIZE="10M" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph lockbox"
>[2018-09-06 12:57:57,547][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:57:57,552][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:57:57,552][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:57:57,552][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:57,552][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:57:57,552][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:57,553][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:57:57,553][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb3
>[2018-09-06 12:57:57,557][ceph_volume.process][INFO  ] stdout 00000000-0000-0000-0000-000000000000
>[2018-09-06 12:57:57,557][ceph_volume.process][INFO  ] Running command: /bin/ceph --cluster ceph --name client.osd-lockbox.4eb40aad-c132-4846-882c-74794cc8e66f --keyring /var/lib/ceph/osd-lockbox/4eb40aad-c132-4846-882c-74794cc8e66f/keyring config-key get dm-crypt/osd/4eb40aad-c132-4846-882c-74794cc8e66f/luks
>[2018-09-06 12:57:57,931][ceph_volume.process][INFO  ] stdout hK7ycTkUfLzv67DKeV0o9KcEcQx/B8ugECbGp0Ib6xqg0Pyia/cirOGe5rqZguwmxrpT5TNHz3Vc5lbTtOpnPhtnqilWF+eV4c059beV+6lDtAQR+fhTtN+1MI1Nar7JJ2Td/EgsddU2olpXLAukhrx2n59JYlpUNZxnFCYAyrQ=
>[2018-09-06 12:57:57,932][ceph_volume.process][INFO  ] stderr obtained 'dm-crypt/osd/4eb40aad-c132-4846-882c-74794cc8e66f/luks'
>[2018-09-06 12:57:57,932][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /var/lib/ceph/osd/master-2/journal
>[2018-09-06 12:57:57,946][ceph_volume.process][INFO  ] stdout /var/lib/ceph/osd/master-2/journal is active and is in use.
>[2018-09-06 12:57:57,946][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:57:57,946][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:57:57,946][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:57:57,946][ceph_volume.process][INFO  ] stdout device:  /dev/sdb2
>[2018-09-06 12:57:57,946][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:57:57,946][ceph_volume.process][INFO  ] stdout size:    10481664 sectors
>[2018-09-06 12:57:57,946][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:57:57,947][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb2
>[2018-09-06 12:57:57,951][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" KNAME="/dev/sdb2" MAJ:MIN="8:18" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="12615579-dd41-4888-977b-725fef388d6e" RO="0" RM="0" MODEL="" SIZE="5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph journal"
>[2018-09-06 12:57:57,952][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:57:57,957][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:57:57,957][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:57:57,957][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:57,957][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:57:57,957][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:57,957][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:57:57,958][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb2
>[2018-09-06 12:57:57,961][ceph_volume.process][INFO  ] stdout 68fe83a2-529c-4f7b-acec-a9096595a9e2
>[2018-09-06 12:57:57,962][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-2/journal
>[2018-09-06 12:57:57,962][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /var/lib/ceph/osd/master-2/journal_dmcrypt
>[2018-09-06 12:57:57,966][ceph_volume.process][INFO  ] stderr Device journal_dmcrypt not found
>[2018-09-06 12:57:57,966][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:57:57,967][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /var/lib/ceph/osd/master-2/journal_dmcrypt
>[2018-09-06 12:57:57,970][ceph_volume.process][INFO  ] stdout ID_FS_UUID=12615579-dd41-4888-977b-725fef388d6e
>[2018-09-06 12:57:57,970][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=12615579-dd41-4888-977b-725fef388d6e
>[2018-09-06 12:57:57,970][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1
>[2018-09-06 12:57:57,970][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=crypto_LUKS
>[2018-09-06 12:57:57,970][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=crypto
>[2018-09-06 12:57:57,970][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:57:57,970][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20journal
>[2018-09-06 12:57:57,970][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=68fe83a2-529c-4f7b-acec-a9096595a9e2
>[2018-09-06 12:57:57,971][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=45b0969e-9b03-4f30-b4c6-35865ceff106
>[2018-09-06 12:57:57,971][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=2
>[2018-09-06 12:57:57,971][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=22528
>[2018-09-06 12:57:57,971][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=10485760
>[2018-09-06 12:57:57,971][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:16
>[2018-09-06 12:57:57,971][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-2/journal_dmcrypt
>[2018-09-06 12:57:57,976][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" KNAME="/dev/sdb2" MAJ:MIN="8:18" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="12615579-dd41-4888-977b-725fef388d6e" RO="0" RM="0" MODEL="" SIZE="5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph journal"
>[2018-09-06 12:57:57,976][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:57:57,981][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:57:57,981][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:57:57,982][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:57,982][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:57:57,982][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:57,982][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:57:57,982][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /var/lib/ceph/osd/master-2/journal_dmcrypt
>[2018-09-06 12:57:57,985][ceph_volume.process][INFO  ] stdout 68fe83a2-529c-4f7b-acec-a9096595a9e2
>[2018-09-06 12:57:57,985][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-2/journal_dmcrypt
>[2018-09-06 12:57:57,986][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-2/activate.monmap
>[2018-09-06 12:57:57,986][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-2/store_version
>[2018-09-06 12:57:57,986][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-2/superblock
>[2018-09-06 12:57:57,990][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:57:57,995][ceph_volume.process][INFO  ] stdout /dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f is active and is in use.
>[2018-09-06 12:57:57,995][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:57:57,995][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:57:57,995][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:57:57,995][ceph_volume.process][INFO  ] stdout device:  /dev/sdb1
>[2018-09-06 12:57:57,995][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:57:57,996][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:57:57,996][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:57:57,996][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb1
>[2018-09-06 12:57:58,000][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" KNAME="/dev/sdb1" MAJ:MIN="8:17" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="f9ca1dfa-840d-4a25-bd2d-326893a5218d" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdb" PARTLABEL="ceph data"
>[2018-09-06 12:57:58,001][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdb
>[2018-09-06 12:57:58,006][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:57:58,006][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:57:58,006][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/4eb40aad-c132-4846-882c-74794cc8e66f" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:58,006][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:57:58,007][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/68fe83a2-529c-4f7b-acec-a9096595a9e2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:57:58,007][ceph_volume.process][INFO  ] stdout NAME="/dev/sdb3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:57:58,007][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdb1
>[2018-09-06 12:57:58,010][ceph_volume.process][INFO  ] stdout 4eb40aad-c132-4846-882c-74794cc8e66f
>[2018-09-06 12:58:13,919][ceph_volume.main][INFO  ] Running command: ceph-volume  simple scan /dev/sdc1
>[2018-09-06 12:58:13,920][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdc1
>[2018-09-06 12:58:13,925][ceph_volume.process][INFO  ] stdout NAME="sdc1" KNAME="sdc1" MAJ:MIN="8:33" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="9940c1e0-76b3-4d6f-92cb-cf480d2ff7b2" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdc" PARTLABEL="ceph data"
>[2018-09-06 12:58:13,925][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdc1
>[2018-09-06 12:58:13,930][ceph_volume.process][INFO  ] stdout NAME="sdc1" KNAME="sdc1" MAJ:MIN="8:33" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="9940c1e0-76b3-4d6f-92cb-cf480d2ff7b2" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdc" PARTLABEL="ceph data"
>[2018-09-06 12:58:13,930][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdc1
>[2018-09-06 12:58:13,935][ceph_volume.process][INFO  ] stdout NAME="sdc1" KNAME="sdc1" MAJ:MIN="8:33" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="9940c1e0-76b3-4d6f-92cb-cf480d2ff7b2" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdc" PARTLABEL="ceph data"
>[2018-09-06 12:58:13,942][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdc1
>[2018-09-06 12:58:13,946][ceph_volume.process][INFO  ] stderr Device sdc1 not found
>[2018-09-06 12:58:13,946][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:58:13,946][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdc1
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_FS_UUID=9940c1e0-76b3-4d6f-92cb-cf480d2ff7b2
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=9940c1e0-76b3-4d6f-92cb-cf480d2ff7b2
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=crypto_LUKS
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=crypto
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20data
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=22d96b9f-a939-48c9-9687-350df84cb0d2
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=4fbd7e29-9d25-41b8-afd0-35865ceff05d
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=1
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=10508288
>[2018-09-06 12:58:13,950][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=1943016847
>[2018-09-06 12:58:13,951][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:32
>[2018-09-06 12:58:13,951][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdc1
>[2018-09-06 12:58:13,955][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc1" KNAME="/dev/sdc1" MAJ:MIN="8:33" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="9940c1e0-76b3-4d6f-92cb-cf480d2ff7b2" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdc" PARTLABEL="ceph data"
>[2018-09-06 12:58:13,956][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdc
>[2018-09-06 12:58:13,961][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:13,961][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:13,961][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/22d96b9f-a939-48c9-9687-350df84cb0d2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:13,961][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:13,961][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9996a923-f0f0-4a0a-89d8-0e30747f57ba" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:13,961][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:13,962][ceph_volume.devices.simple.scan][INFO  ] detecting if argument is a device or a directory: /dev/sdc1
>[2018-09-06 12:58:13,962][ceph_volume.devices.simple.scan][INFO  ] path is not a directory, will check if mounted
>[2018-09-06 12:58:13,968][ceph_volume.util.system][INFO  ] %s was not found as mounted
>[2018-09-06 12:58:13,968][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdc1
>[2018-09-06 12:58:13,972][ceph_volume.process][INFO  ] stdout 22d96b9f-a939-48c9-9687-350df84cb0d2
>[2018-09-06 12:58:13,972][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status 22d96b9f-a939-48c9-9687-350df84cb0d2
>[2018-09-06 12:58:13,990][ceph_volume.process][INFO  ] stdout /dev/mapper/22d96b9f-a939-48c9-9687-350df84cb0d2 is active and is in use.
>[2018-09-06 12:58:13,990][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:58:13,990][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:58:13,990][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:58:13,990][ceph_volume.process][INFO  ] stdout device:  /dev/sdc1
>[2018-09-06 12:58:13,990][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:58:13,991][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:58:13,991][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:58:13,995][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdc3
>[2018-09-06 12:58:14,000][ceph_volume.process][INFO  ] stderr Device sdc3 not found
>[2018-09-06 12:58:14,000][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:58:14,000][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdc3
>[2018-09-06 12:58:14,003][ceph_volume.process][INFO  ] stdout ID_FS_UUID=80a4d806-5f14-4318-b8fe-a92f1709714a
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=80a4d806-5f14-4318-b8fe-a92f1709714a
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1.0
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=ext4
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=filesystem
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20lockbox
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=00000000-0000-0000-0000-000000000000
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=fb3aabf9-d25f-47cc-bf5e-721d1816496b
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=3
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=2048
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=20480
>[2018-09-06 12:58:14,004][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:32
>[2018-09-06 12:58:14,005][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdc3
>[2018-09-06 12:58:14,010][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc3" KNAME="/dev/sdc3" MAJ:MIN="8:35" FSTYPE="ext4" MOUNTPOINT="/var/lib/ceph/osd-lockbox/22d96b9f-a939-48c9-9687-350df84cb0d2" LABEL="" UUID="80a4d806-5f14-4318-b8fe-a92f1709714a" RO="0" RM="0" MODEL="" SIZE="10M" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdc" PARTLABEL="ceph lockbox"
>[2018-09-06 12:58:14,010][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdc
>[2018-09-06 12:58:14,015][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:14,015][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:14,015][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/22d96b9f-a939-48c9-9687-350df84cb0d2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:14,015][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:14,016][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9996a923-f0f0-4a0a-89d8-0e30747f57ba" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:14,016][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:14,016][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdc3
>[2018-09-06 12:58:14,020][ceph_volume.process][INFO  ] stdout 00000000-0000-0000-0000-000000000000
>[2018-09-06 12:58:14,020][ceph_volume.process][INFO  ] Running command: /bin/ceph --cluster ceph --name client.osd-lockbox.22d96b9f-a939-48c9-9687-350df84cb0d2 --keyring /var/lib/ceph/osd-lockbox/22d96b9f-a939-48c9-9687-350df84cb0d2/keyring config-key get dm-crypt/osd/22d96b9f-a939-48c9-9687-350df84cb0d2/luks
>[2018-09-06 12:58:14,363][ceph_volume.process][INFO  ] stdout TqoI7YOF/v23s9W8wdsZ+9eyCCymZrBPLbk28vs/8bUqASSCr74VCoqqYHKjsor0imsGLI+lKLB/l2/1ZgTABkpPOMpacBLbGbi5U0uztx+Wv67h8ilIZwV3EK64BXnEpbVBcqUZAd11ddVEDHf8XPB6hZrG+VsZyFKk1CrMP0s=
>[2018-09-06 12:58:14,363][ceph_volume.process][INFO  ] stderr obtained 'dm-crypt/osd/22d96b9f-a939-48c9-9687-350df84cb0d2/luks'
>[2018-09-06 12:58:14,364][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /var/lib/ceph/osd/master-4/journal
>[2018-09-06 12:58:14,379][ceph_volume.process][INFO  ] stdout /var/lib/ceph/osd/master-4/journal is active and is in use.
>[2018-09-06 12:58:14,379][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:58:14,379][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:58:14,379][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:58:14,380][ceph_volume.process][INFO  ] stdout device:  /dev/sdc2
>[2018-09-06 12:58:14,380][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:58:14,380][ceph_volume.process][INFO  ] stdout size:    10481664 sectors
>[2018-09-06 12:58:14,380][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:58:14,380][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdc2
>[2018-09-06 12:58:14,385][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc2" KNAME="/dev/sdc2" MAJ:MIN="8:34" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="13e14a61-0688-4a02-9696-9e9e650d6c68" RO="0" RM="0" MODEL="" SIZE="5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdc" PARTLABEL="ceph journal"
>[2018-09-06 12:58:14,385][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdc
>[2018-09-06 12:58:14,390][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:14,391][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:14,391][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/22d96b9f-a939-48c9-9687-350df84cb0d2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:14,391][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:14,391][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9996a923-f0f0-4a0a-89d8-0e30747f57ba" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:14,391][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:14,391][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdc2
>[2018-09-06 12:58:14,395][ceph_volume.process][INFO  ] stdout 9996a923-f0f0-4a0a-89d8-0e30747f57ba
>[2018-09-06 12:58:14,395][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-4/journal
>[2018-09-06 12:58:14,396][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /var/lib/ceph/osd/master-4/journal_dmcrypt
>[2018-09-06 12:58:14,400][ceph_volume.process][INFO  ] stderr Device journal_dmcrypt not found
>[2018-09-06 12:58:14,400][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:58:14,400][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /var/lib/ceph/osd/master-4/journal_dmcrypt
>[2018-09-06 12:58:14,403][ceph_volume.process][INFO  ] stdout ID_FS_UUID=13e14a61-0688-4a02-9696-9e9e650d6c68
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=13e14a61-0688-4a02-9696-9e9e650d6c68
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=crypto_LUKS
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=crypto
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20journal
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=9996a923-f0f0-4a0a-89d8-0e30747f57ba
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=45b0969e-9b03-4f30-b4c6-35865ceff106
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=2
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=22528
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=10485760
>[2018-09-06 12:58:14,404][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:32
>[2018-09-06 12:58:14,405][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-4/journal_dmcrypt
>[2018-09-06 12:58:14,409][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc2" KNAME="/dev/sdc2" MAJ:MIN="8:34" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="13e14a61-0688-4a02-9696-9e9e650d6c68" RO="0" RM="0" MODEL="" SIZE="5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdc" PARTLABEL="ceph journal"
>[2018-09-06 12:58:14,410][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdc
>[2018-09-06 12:58:14,415][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:14,415][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:14,415][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/22d96b9f-a939-48c9-9687-350df84cb0d2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:14,415][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:14,415][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9996a923-f0f0-4a0a-89d8-0e30747f57ba" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:14,415][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:14,416][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /var/lib/ceph/osd/master-4/journal_dmcrypt
>[2018-09-06 12:58:14,419][ceph_volume.process][INFO  ] stdout 9996a923-f0f0-4a0a-89d8-0e30747f57ba
>[2018-09-06 12:58:14,419][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-4/journal_dmcrypt
>[2018-09-06 12:58:14,419][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-4/activate.monmap
>[2018-09-06 12:58:14,419][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-4/store_version
>[2018-09-06 12:58:14,420][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-4/superblock
>[2018-09-06 12:58:14,423][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/mapper/22d96b9f-a939-48c9-9687-350df84cb0d2
>[2018-09-06 12:58:14,429][ceph_volume.process][INFO  ] stdout /dev/mapper/22d96b9f-a939-48c9-9687-350df84cb0d2 is active and is in use.
>[2018-09-06 12:58:14,429][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:58:14,429][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:58:14,429][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:58:14,429][ceph_volume.process][INFO  ] stdout device:  /dev/sdc1
>[2018-09-06 12:58:14,429][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:58:14,429][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:58:14,430][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:58:14,430][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdc1
>[2018-09-06 12:58:14,434][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc1" KNAME="/dev/sdc1" MAJ:MIN="8:33" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="9940c1e0-76b3-4d6f-92cb-cf480d2ff7b2" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdc" PARTLABEL="ceph data"
>[2018-09-06 12:58:14,435][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdc
>[2018-09-06 12:58:14,440][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:14,440][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:14,440][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/22d96b9f-a939-48c9-9687-350df84cb0d2" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:14,440][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:14,441][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9996a923-f0f0-4a0a-89d8-0e30747f57ba" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:14,441][ceph_volume.process][INFO  ] stdout NAME="/dev/sdc3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:14,441][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdc1
>[2018-09-06 12:58:14,444][ceph_volume.process][INFO  ] stdout 22d96b9f-a939-48c9-9687-350df84cb0d2
>[2018-09-06 12:58:18,423][ceph_volume.main][INFO  ] Running command: ceph-volume  simple scan /dev/sdd1
>[2018-09-06 12:58:18,424][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdd1
>[2018-09-06 12:58:18,429][ceph_volume.process][INFO  ] stdout NAME="sdd1" KNAME="sdd1" MAJ:MIN="8:49" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="ece1da58-cb1d-4e22-8b91-e2712046a82a" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdd" PARTLABEL="ceph data"
>[2018-09-06 12:58:18,430][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdd1
>[2018-09-06 12:58:18,434][ceph_volume.process][INFO  ] stdout NAME="sdd1" KNAME="sdd1" MAJ:MIN="8:49" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="ece1da58-cb1d-4e22-8b91-e2712046a82a" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdd" PARTLABEL="ceph data"
>[2018-09-06 12:58:18,435][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdd1
>[2018-09-06 12:58:18,439][ceph_volume.process][INFO  ] stdout NAME="sdd1" KNAME="sdd1" MAJ:MIN="8:49" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="ece1da58-cb1d-4e22-8b91-e2712046a82a" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="sdd" PARTLABEL="ceph data"
>[2018-09-06 12:58:18,446][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdd1
>[2018-09-06 12:58:18,450][ceph_volume.process][INFO  ] stderr Device sdd1 not found
>[2018-09-06 12:58:18,450][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:58:18,451][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdd1
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_FS_UUID=ece1da58-cb1d-4e22-8b91-e2712046a82a
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=ece1da58-cb1d-4e22-8b91-e2712046a82a
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=crypto_LUKS
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=crypto
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20data
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=aed57116-15a2-46e0-a11f-3fa84fff2490
>[2018-09-06 12:58:18,454][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=4fbd7e29-9d25-41b8-afd0-35865ceff05d
>[2018-09-06 12:58:18,455][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=1
>[2018-09-06 12:58:18,455][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=10508288
>[2018-09-06 12:58:18,455][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=1943016847
>[2018-09-06 12:58:18,455][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:48
>[2018-09-06 12:58:18,455][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdd1
>[2018-09-06 12:58:18,460][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd1" KNAME="/dev/sdd1" MAJ:MIN="8:49" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="ece1da58-cb1d-4e22-8b91-e2712046a82a" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdd" PARTLABEL="ceph data"
>[2018-09-06 12:58:18,460][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdd
>[2018-09-06 12:58:18,465][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:18,466][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:18,466][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/aed57116-15a2-46e0-a11f-3fa84fff2490" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,466][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:18,466][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9cdee2f4-4124-478a-9c51-f8b7b61bb41e" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,466][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:18,466][ceph_volume.devices.simple.scan][INFO  ] detecting if argument is a device or a directory: /dev/sdd1
>[2018-09-06 12:58:18,466][ceph_volume.devices.simple.scan][INFO  ] path is not a directory, will check if mounted
>[2018-09-06 12:58:18,473][ceph_volume.util.system][INFO  ] %s was not found as mounted
>[2018-09-06 12:58:18,473][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdd1
>[2018-09-06 12:58:18,476][ceph_volume.process][INFO  ] stdout aed57116-15a2-46e0-a11f-3fa84fff2490
>[2018-09-06 12:58:18,477][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status aed57116-15a2-46e0-a11f-3fa84fff2490
>[2018-09-06 12:58:18,498][ceph_volume.process][INFO  ] stdout /dev/mapper/aed57116-15a2-46e0-a11f-3fa84fff2490 is active and is in use.
>[2018-09-06 12:58:18,498][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:58:18,498][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:58:18,498][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:58:18,498][ceph_volume.process][INFO  ] stdout device:  /dev/sdd1
>[2018-09-06 12:58:18,498][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:58:18,499][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:58:18,499][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:58:18,503][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/sdd3
>[2018-09-06 12:58:18,507][ceph_volume.process][INFO  ] stderr Device sdd3 not found
>[2018-09-06 12:58:18,508][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:58:18,508][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /dev/sdd3
>[2018-09-06 12:58:18,511][ceph_volume.process][INFO  ] stdout ID_FS_UUID=e85ba500-87e8-42df-af82-ffdf4a294744
>[2018-09-06 12:58:18,511][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=e85ba500-87e8-42df-af82-ffdf4a294744
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1.0
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=ext4
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=filesystem
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20lockbox
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=00000000-0000-0000-0000-000000000000
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=fb3aabf9-d25f-47cc-bf5e-721d1816496b
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=3
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=2048
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=20480
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:48
>[2018-09-06 12:58:18,512][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdd3
>[2018-09-06 12:58:18,518][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd3" KNAME="/dev/sdd3" MAJ:MIN="8:51" FSTYPE="ext4" MOUNTPOINT="/var/lib/ceph/osd-lockbox/aed57116-15a2-46e0-a11f-3fa84fff2490" LABEL="" UUID="e85ba500-87e8-42df-af82-ffdf4a294744" RO="0" RM="0" MODEL="" SIZE="10M" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdd" PARTLABEL="ceph lockbox"
>[2018-09-06 12:58:18,518][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdd
>[2018-09-06 12:58:18,523][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:18,523][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:18,524][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/aed57116-15a2-46e0-a11f-3fa84fff2490" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,524][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:18,524][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9cdee2f4-4124-478a-9c51-f8b7b61bb41e" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,524][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:18,524][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdd3
>[2018-09-06 12:58:18,528][ceph_volume.process][INFO  ] stdout 00000000-0000-0000-0000-000000000000
>[2018-09-06 12:58:18,528][ceph_volume.process][INFO  ] Running command: /bin/ceph --cluster ceph --name client.osd-lockbox.aed57116-15a2-46e0-a11f-3fa84fff2490 --keyring /var/lib/ceph/osd-lockbox/aed57116-15a2-46e0-a11f-3fa84fff2490/keyring config-key get dm-crypt/osd/aed57116-15a2-46e0-a11f-3fa84fff2490/luks
>[2018-09-06 12:58:18,870][ceph_volume.process][INFO  ] stdout 1ZAf8exSSsKywayjaCdtZHiPkiMUZbTg+D8S2PNNXYk0nsOZXzwTWTuj5tewy9KAw7WlwU53iNsfxGZMEYPK2y2u9NIMJip/2b9pla9+1pjdOXtmywVWEWipU7qnL6ItYAVGqr9dcdFYB49wLHsbEI6TBFVZU+se/ofT2vJTc+k=
>[2018-09-06 12:58:18,870][ceph_volume.process][INFO  ] stderr obtained 'dm-crypt/osd/aed57116-15a2-46e0-a11f-3fa84fff2490/luks'
>[2018-09-06 12:58:18,871][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /var/lib/ceph/osd/master-5/journal
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] stdout /var/lib/ceph/osd/master-5/journal is active and is in use.
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] stdout device:  /dev/sdd2
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] stdout size:    10481664 sectors
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:58:18,885][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdd2
>[2018-09-06 12:58:18,890][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd2" KNAME="/dev/sdd2" MAJ:MIN="8:50" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="252065fb-427f-411d-a36e-e491aafe64bc" RO="0" RM="0" MODEL="" SIZE="5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdd" PARTLABEL="ceph journal"
>[2018-09-06 12:58:18,891][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdd
>[2018-09-06 12:58:18,896][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:18,896][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:18,896][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/aed57116-15a2-46e0-a11f-3fa84fff2490" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,897][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:18,897][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9cdee2f4-4124-478a-9c51-f8b7b61bb41e" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,897][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:18,897][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdd2
>[2018-09-06 12:58:18,900][ceph_volume.process][INFO  ] stdout 9cdee2f4-4124-478a-9c51-f8b7b61bb41e
>[2018-09-06 12:58:18,901][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-5/journal
>[2018-09-06 12:58:18,901][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /var/lib/ceph/osd/master-5/journal_dmcrypt
>[2018-09-06 12:58:18,906][ceph_volume.process][INFO  ] stderr Device journal_dmcrypt not found
>[2018-09-06 12:58:18,906][ceph_volume.util.encryption][WARNING] failed to detect device mapper information
>[2018-09-06 12:58:18,906][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p -o udev /var/lib/ceph/osd/master-5/journal_dmcrypt
>[2018-09-06 12:58:18,909][ceph_volume.process][INFO  ] stdout ID_FS_UUID=252065fb-427f-411d-a36e-e491aafe64bc
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_FS_UUID_ENC=252065fb-427f-411d-a36e-e491aafe64bc
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_FS_VERSION=1
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_FS_TYPE=crypto_LUKS
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_FS_USAGE=crypto
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SCHEME=gpt
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NAME=ceph\x20journal
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_UUID=9cdee2f4-4124-478a-9c51-f8b7b61bb41e
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_TYPE=45b0969e-9b03-4f30-b4c6-35865ceff106
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_NUMBER=2
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_OFFSET=22528
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_SIZE=10485760
>[2018-09-06 12:58:18,910][ceph_volume.process][INFO  ] stdout ID_PART_ENTRY_DISK=8:48
>[2018-09-06 12:58:18,911][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /var/lib/ceph/osd/master-5/journal_dmcrypt
>[2018-09-06 12:58:18,915][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd2" KNAME="/dev/sdd2" MAJ:MIN="8:50" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="252065fb-427f-411d-a36e-e491aafe64bc" RO="0" RM="0" MODEL="" SIZE="5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdd" PARTLABEL="ceph journal"
>[2018-09-06 12:58:18,916][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdd
>[2018-09-06 12:58:18,921][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:18,921][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:18,922][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/aed57116-15a2-46e0-a11f-3fa84fff2490" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,922][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:18,922][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9cdee2f4-4124-478a-9c51-f8b7b61bb41e" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,922][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:18,922][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /var/lib/ceph/osd/master-5/journal_dmcrypt
>[2018-09-06 12:58:18,925][ceph_volume.process][INFO  ] stdout 9cdee2f4-4124-478a-9c51-f8b7b61bb41e
>[2018-09-06 12:58:18,926][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-5/journal_dmcrypt
>[2018-09-06 12:58:18,926][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-5/activate.monmap
>[2018-09-06 12:58:18,926][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-5/store_version
>[2018-09-06 12:58:18,926][ceph_volume.devices.simple.scan][INFO  ] skipping binary file: /var/lib/ceph/osd/master-5/superblock
>[2018-09-06 12:58:18,930][ceph_volume.process][INFO  ] Running command: /usr/sbin/cryptsetup status /dev/mapper/aed57116-15a2-46e0-a11f-3fa84fff2490
>[2018-09-06 12:58:18,935][ceph_volume.process][INFO  ] stdout /dev/mapper/aed57116-15a2-46e0-a11f-3fa84fff2490 is active and is in use.
>[2018-09-06 12:58:18,936][ceph_volume.process][INFO  ] stdout type:    LUKS1
>[2018-09-06 12:58:18,936][ceph_volume.process][INFO  ] stdout cipher:  aes-xts-plain64
>[2018-09-06 12:58:18,936][ceph_volume.process][INFO  ] stdout keysize: 256 bits
>[2018-09-06 12:58:18,936][ceph_volume.process][INFO  ] stdout device:  /dev/sdd1
>[2018-09-06 12:58:18,936][ceph_volume.process][INFO  ] stdout offset:  4096 sectors
>[2018-09-06 12:58:18,936][ceph_volume.process][INFO  ] stdout size:    1943012751 sectors
>[2018-09-06 12:58:18,936][ceph_volume.process][INFO  ] stdout mode:    read/write
>[2018-09-06 12:58:18,936][ceph_volume.process][INFO  ] Running command: /bin/lsblk --nodeps -P -p -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdd1
>[2018-09-06 12:58:18,941][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd1" KNAME="/dev/sdd1" MAJ:MIN="8:49" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL="" UUID="ece1da58-cb1d-4e22-8b91-e2712046a82a" RO="0" RM="0" MODEL="" SIZE="926.5G" STATE="" OWNER="ceph" GROUP="ceph" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="/dev/sdd" PARTLABEL="ceph data"
>[2018-09-06 12:58:18,941][ceph_volume.process][INFO  ] Running command: /bin/lsblk -P -p -o NAME,PARTLABEL,TYPE /dev/sdd
>[2018-09-06 12:58:18,947][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd" PARTLABEL="" TYPE="disk"
>[2018-09-06 12:58:18,947][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd1" PARTLABEL="ceph data" TYPE="part"
>[2018-09-06 12:58:18,947][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/aed57116-15a2-46e0-a11f-3fa84fff2490" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,947][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd2" PARTLABEL="ceph journal" TYPE="part"
>[2018-09-06 12:58:18,947][ceph_volume.process][INFO  ] stdout NAME="/dev/mapper/9cdee2f4-4124-478a-9c51-f8b7b61bb41e" PARTLABEL="" TYPE="crypt"
>[2018-09-06 12:58:18,947][ceph_volume.process][INFO  ] stdout NAME="/dev/sdd3" PARTLABEL="ceph lockbox" TYPE="part"
>[2018-09-06 12:58:18,947][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -s PARTUUID -o value /dev/sdd1
>[2018-09-06 12:58:18,950][ceph_volume.process][INFO  ] stdout aed57116-15a2-46e0-a11f-3fa84fff2490
>[2018-09-06 13:05:52,451][ceph_volume.main][INFO  ] Running command: ceph-volume  simple activate --file /etc/ceph/osd/2-4eb40aad-c132-4846-882c-74794cc8e66f.json
>[2018-09-06 13:05:52,453][ceph_volume.process][INFO  ] Running command: ceph-authtool /var/lib/ceph/osd/ceph-2/lockbox.keyring --create-keyring --name client.osd-lockbox.4eb40aad-c132-4846-882c-74794cc8e66f --add-key AQBh+YxbPYCdIhAAsIAfa0m26Ey458ESaJisgA==
>[2018-09-06 13:05:52,508][ceph_volume.process][INFO  ] stdout creating /var/lib/ceph/osd/ceph-2/lockbox.keyring
>[2018-09-06 13:05:52,508][ceph_volume.process][INFO  ] stdout added entity client.osd-lockbox.4eb40aad-c132-4846-882c-74794cc8e66f auth auth(auid = 18446744073709551615 key=AQBh+YxbPYCdIhAAsIAfa0m26Ey458ESaJisgA== with 0 caps)
>[2018-09-06 13:05:52,508][ceph_volume.process][INFO  ] stderr bufferlist::write_file(/var/lib/ceph/osd/ceph-2/lockbox.keyring): failed to open file: (2) No such file or directory
>could not write /var/lib/ceph/osd/ceph-2/lockbox.keyring
>[2018-09-06 13:05:52,509][ceph_volume][ERROR ] exception caught by decorator
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 59, in newfunc
>    return f(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 153, in main
>    terminal.dispatch(self.mapper, subcommand_args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/main.py", line 33, in main
>    terminal.dispatch(self.mapper, self.argv)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/activate.py", line 235, in main
>    self.activate(args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 16, in is_root
>    return func(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/activate.py", line 109, in activate
>    encryption_utils.write_lockbox_keyring(osd_id, osd_fsid, lockbox_secret)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/util/encryption.py", line 157, in write_lockbox_keyring
>    name=name
>  File "/usr/lib/python2.7/site-packages/ceph_volume/util/prepare.py", line 45, in write_keyring
>    '--add-key', secret
>  File "/usr/lib/python2.7/site-packages/ceph_volume/process.py", line 149, in run
>    raise RuntimeError(msg)
>RuntimeError: command returned non-zero exit status: 1
>[2018-09-06 13:10:28,998][ceph_volume.main][INFO  ] Running command: ceph-volume  simple activate --file /etc/ceph/osd/2-4eb40aad-c132-4846-882c-74794cc8e66f.json
>[2018-09-06 13:10:29,000][ceph_volume.process][INFO  ] Running command: ceph-authtool /var/lib/ceph/osd/ceph-2/lockbox.keyring --create-keyring --name client.osd-lockbox.4eb40aad-c132-4846-882c-74794cc8e66f --add-key AQBh+YxbPYCdIhAAsIAfa0m26Ey458ESaJisgA==
>[2018-09-06 13:10:29,052][ceph_volume.process][INFO  ] stdout creating /var/lib/ceph/osd/ceph-2/lockbox.keyring
>[2018-09-06 13:10:29,053][ceph_volume.process][INFO  ] stdout added entity client.osd-lockbox.4eb40aad-c132-4846-882c-74794cc8e66f auth auth(auid = 18446744073709551615 key=AQBh+YxbPYCdIhAAsIAfa0m26Ey458ESaJisgA== with 0 caps)
>[2018-09-06 13:10:29,053][ceph_volume.process][INFO  ] stderr bufferlist::write_file(/var/lib/ceph/osd/ceph-2/lockbox.keyring): failed to open file: (2) No such file or directory
>could not write /var/lib/ceph/osd/ceph-2/lockbox.keyring
>[2018-09-06 13:10:29,054][ceph_volume][ERROR ] exception caught by decorator
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 59, in newfunc
>    return f(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/main.py", line 153, in main
>    terminal.dispatch(self.mapper, subcommand_args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/main.py", line 33, in main
>    terminal.dispatch(self.mapper, self.argv)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/terminal.py", line 182, in dispatch
>    instance.main()
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/activate.py", line 235, in main
>    self.activate(args)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/decorators.py", line 16, in is_root
>    return func(*a, **kw)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/devices/simple/activate.py", line 109, in activate
>    encryption_utils.write_lockbox_keyring(osd_id, osd_fsid, lockbox_secret)
>  File "/usr/lib/python2.7/site-packages/ceph_volume/util/encryption.py", line 157, in write_lockbox_keyring
>    name=name
>  File "/usr/lib/python2.7/site-packages/ceph_volume/util/prepare.py", line 45, in write_keyring
>    '--add-key', secret
>  File "/usr/lib/python2.7/site-packages/ceph_volume/process.py", line 149, in run
>    raise RuntimeError(msg)
>RuntimeError: command returned non-zero exit status: 1

Actions: View

Attachments on bug 1626073: 1481330