OSD prepare pod is stuck while running ceph-volume prepare command. The backing disk for this pv is /dev/sdd on compute-1 node. from ceph-volume logs on compute-1 node where this OSD prepare pod is stuck: ``` [2023-08-11 10:11:21,471][ceph_volume.process][INFO ] Running command: /usr/bin/ceph-bluestore-tool show-label --dev /dev/sdd [2023-08-11 10:11:21,492][ceph_volume.process][INFO ] stderr unable to read label for /dev/sdd: (2) No such file or directory [2023-08-11 10:11:21,492][ceph_volume.devices.raw.list][DEBUG ] assuming device /dev/sdd is not BlueStore; ceph-bluestore-tool failed to get info from device: [] ['unable to read label for /dev/sdd: (2) No such file or directory'] [2023-08-11 10:11:21,492][ceph_volume.devices.raw.list][INFO ] device /dev/sdd does not have BlueStore information ``` Could be something to do with the disk
ceph-volume inventory on this disk: ``` sh-5.1# ceph-volume inventory /dev/sdd stderr: lsblk: /dev/sdd: not a block device Traceback (most recent call last): File "/usr/sbin/ceph-volume", line 33, in <module> sys.exit(load_entry_point('ceph-volume==1.0.0', 'console_scripts', 'ceph-volume')()) File "/usr/lib/python3.9/site-packages/ceph_volume/main.py", line 41, in __init__ self.main(self.argv) File "/usr/lib/python3.9/site-packages/ceph_volume/decorators.py", line 59, in newfunc return f(*a, **kw) File "/usr/lib/python3.9/site-packages/ceph_volume/main.py", line 153, in main terminal.dispatch(self.mapper, subcommand_args) File "/usr/lib/python3.9/site-packages/ceph_volume/terminal.py", line 194, in dispatch instance.main() File "/usr/lib/python3.9/site-packages/ceph_volume/inventory/main.py", line 50, in main self.format_report(Device(self.args.path, with_lsm=self.args.with_lsm)) File "/usr/lib/python3.9/site-packages/ceph_volume/util/device.py", line 131, in __init__ self._parse() File "/usr/lib/python3.9/site-packages/ceph_volume/util/device.py", line 225, in _parse dev = disk.lsblk(self.path) File "/usr/lib/python3.9/site-packages/ceph_volume/util/disk.py", line 243, in lsblk result = lsblk_all(device=device, File "/usr/lib/python3.9/site-packages/ceph_volume/util/disk.py", line 337, in lsblk_all raise RuntimeError(f"Error: {err}") RuntimeError: Error: ['lsblk: /dev/sdd: not a block device'] ```
sh-5.1# lsblk /dev/sdd lsblk: /dev/sdd: not a block device sh-5.1#
Moving out of 4.14 while the bad disk is being investigate