Bug 1946417

Summary: "ceph orch device ls --wide" command shows N/A vendor name for NVMI devices
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: skanta
Component: CephadmAssignee: Juan Miguel Olmo <jolmomar>
Status: CLOSED NOTABUG QA Contact: Vasishta <vashastr>
Severity: low Docs Contact: Karen Norteman <knortema>
Priority: unspecified    
Version: 5.0   
Target Milestone: ---   
Target Release: 5.1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-04-08 09:25:12 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description skanta 2021-04-06 04:18:06 UTC
Description of problem: "ceph orch device ls  --wide"  command  shows N/A vendor name for  NVMI devices 

[ceph: root@magna048 /]# ceph orch device ls  --wide
Hostname     Path          Type  Transport  RPM      Vendor  Model                Serial              Size   Health   Ident  Fault  Available  Reject Reasons  
depressa009  /dev/nvme0n1  ssd   Unknown    Unknown  N/A     INTEL SSDPE21K375GA  PHKE91360315375AGN   375G  Unknown  N/A    N/A    Yes                        
depressa009  /dev/nvme1n1  ssd   Unknown    Unknown  N/A     INTEL SSDPE21K375GA  PHKE913602XT375AGN   375G  Unknown  N/A    N/A    Yes                        
depressa009  /dev/sdb      ssd   Unknown    Unknown  ATA     SAMSUNG MZ7LH7T6     S487NY0M801907      7681G  Unknown  N/A    N/A    Yes                        
depressa009  /dev/sdc      ssd   Unknown    Unknown  ATA     SAMSUNG MZ7LH7T6     S487NY0M801785      7681G  Unknown  N/A    N/A    Yes                        
depressa009  /dev/sdd      ssd   Unknown    Unknown  ATA     SAMSUNG MZ7LH7T6     S487NY0M801134      7681G  Unknown  N/A    N/A    Yes                        
depressa010  /dev/nvme0n1  ssd   Unknown    Unknown  N/A     INTEL SSDPE21K375GA  PHKE913602LR375AGN   375G  Unknown  N/A    N/A    Yes                        
depressa010  /dev/nvme1n1  ssd   Unknown    Unknown  N/A     INTEL SSDPE21K375GA  PHKE913600WM375AGN   375G  Unknown  N/A    N/A    Yes                        
depressa010  /dev/sdb      ssd   Unknown    Unknown  ATA     SAMSUNG MZ7LH7T6     S487NY0M801864      7681G  Unknown  N/A    N/A    Yes                        
depressa010  /dev/sdc      ssd   Unknown    Unknown  ATA     SAMSUNG MZ7LH7T6     S487NY0M801915      7681G  Unknown  N/A    N/A    Yes                        
magna048     /dev/sdb      hdd   Unknown    Unknown  ATA     Hitachi HUA72201     JPW9K0N21EGGHE      1000G  Unknown  N/A    N/A    Yes                        
magna048     /dev/sdc      hdd   Unknown    Unknown  ATA     Hitachi HUA72201     JPW9K0N20BX7DE      1000G  Unknown  N/A    N/A    Yes                        
magna048     /dev/sdd      hdd   Unknown    Unknown  ATA     Hitachi HUA72201     JPW9M0N20D0Z6E      1000G  Unknown  N/A    N/A    Yes                        
magna049     /dev/sdb      hdd   Unknown    Unknown  ATA     Hitachi HUA72201     JPW9J0N20A9P0C      1000G  Unknown  N/A    N/A    Yes                        
magna049     /dev/sdc      hdd   Unknown    Unknown  ATA     Hitachi HUA72201     JPW9M0N20BSWDE      1000G  Unknown  N/A    N/A    Yes                        
magna049     /dev/sdd      hdd   Unknown    Unknown  ATA     Hitachi HUA72201     JPW9M0N20BNNYE      1000G  Unknown  N/A    N/A    Yes                        
[ceph: root@magna048 /]#


Version-Release number of selected component (if applicable):
ceph version 16.1.0-1323.el8cp (46ac37397f0332c20aceceb8022a1ac1ddf8fa73) pacific (rc)



How reproducible:


Steps to Reproduce:
1.Configure cluster with cephadm
2.execute "ceph orch device ls  --wide" command
3.

Actual results:
                N/A exist as a vendor name for NVMI devices 

Expected results:
                  Proper vendor name should exist in the output


Additional info:

Comment 1 skanta 2021-04-07 08:14:30 UTC
After setting the  "device_enhanced_scan true " Getting the following vendor name  for NVMI's

[ceph: root@magna045 /]# ceph config set mgr mgr/cephadm/device_enhanced_scan true
[ceph: root@magna045 /]# ceph orch device ls --wide
Hostname     Path          Type  Transport  RPM      Vendor  Model                Serial          Size   Health   Ident  Fault  Available  Reject Reasons  
depressa008  /dev/nvme0n1  ssd   Unknown    Unknown  N/A     INTEL SSDPE21K375GA  Unknown          375G  Unknown  N/A    N/A    Yes                        
depressa008  /dev/nvme1n1  ssd   Unknown    Unknown  N/A     INTEL SSDPE21K375GA  Unknown          375G  Unknown  N/A    N/A    Yes                        
depressa008  /dev/sdb      ssd   ATA/SATA   Unknown  ATA     SAMSUNG MZ7LH7T6     S487NY0M801863  7681G  Good     N/A    N/A    Yes                        
depressa008  /dev/sdc      ssd   ATA/SATA   Unknown  ATA     SAMSUNG MZ7LH7T6     S487NY0M801906  7681G  Good     N/A    N/A    Yes                        
depressa008  /dev/sdd      ssd   ATA/SATA   Unknown  ATA     SAMSUNG MZ7LH7T6     S487NY0M801866  7681G  Good     N/A    N/A    Yes                        
magna045     /dev/sdb      hdd   ATA/SATA   7200     ATA     Hitachi HUA72201     JPW9K0N21ETAME  1000G  Good     N/A    N/A    Yes                        
magna045     /dev/sdc      hdd   ATA/SATA   7200     ATA     Hitachi HUA72201     JPW9M0N20BWRNE  1000G  Good     N/A    N/A    Yes                        
magna045     /dev/sdd      hdd   ATA/SATA   7200     ATA     Hitachi HUA72201     JPW9M0N20BT1PE  1000G  Good     N/A    N/A    Yes                        
magna046     /dev/sdb      hdd   ATA/SATA   7200     ATA     Hitachi HUA72201     JPW9K0N20D1NYE  1000G  Good     N/A    N/A    Yes                        
magna046     /dev/sdc      hdd   ATA/SATA   7200     ATA     Hitachi HUA72201     JPW9K0N20D2H6E  1000G  Good     N/A    N/A    Yes                        
magna046     /dev/sdd      hdd   ATA/SATA   7200     ATA     Hitachi HUA72201     JPW9K0N20D1U0E  1000G  Good     N/A    N/A    Yes                        
[ceph: root@magna045 /]#

Comment 2 Juan Miguel Olmo 2021-04-07 16:48:49 UTC
It seems that your devices are not supported by libstoragemgmt, and there is no way to get this information:

Just to confirm that:
execute in depressa008:
# cephadm ceph-volume inventory
# cephadm shell lsmcli ldl

Can you see the vendor information?, if not .. you have devices that are not supported, and then ,, the way to use this devices in OSDs is selecting them using other attributes.

Comment 3 skanta 2021-04-08 03:38:56 UTC
Command: # cephadm ceph-volume inventory in depressa008


[root@depressa008 ubuntu]# cephadm ceph-volume inventory
Inferring fsid 1be45d94-976b-11eb-b36b-002590fbc342
Using recent ceph image registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:7f38a6cac0bc00f1e2bc729d3df7c6c36de2ec8a4666d4dc6dbcf4dc53226522
/bin/podman: 
/bin/podman: Device Path               Size         rotates available Model name
/bin/podman: /dev/nvme0n1              349.32 GB    False   True      INTEL SSDPE21K375GA
/bin/podman: /dev/nvme1n1              349.32 GB    False   True      INTEL SSDPE21K375GA
/bin/podman: /dev/sdb                  6.99 TB      False   True      SAMSUNG MZ7LH7T6
/bin/podman: /dev/sdc                  6.99 TB      False   True      SAMSUNG MZ7LH7T6
/bin/podman: /dev/sdd                  6.99 TB      False   True      SAMSUNG MZ7LH7T6
/bin/podman: /dev/sda                  447.13 GB    False   False     Micron_5200_MTFD
/bin/podman: time="2021-04-08T03:31:51Z" level=warning msg="container 3e3fd1ea6f7e60ca9e19abbb4765b8cf63dbf0616cc41993a34a38dade906fd9: poststop hook 0: executing []: exit status 1"
/bin/podman: time="2021-04-08T03:31:51Z" level=warning msg="container 3e3fd1ea6f7e60ca9e19abbb4765b8cf63dbf0616cc41993a34a38dade906fd9: poststop hook 0: executing []: exit status 1"

Device Path               Size         rotates available Model name
/dev/nvme0n1              349.32 GB    False   True      INTEL SSDPE21K375GA
/dev/nvme1n1              349.32 GB    False   True      INTEL SSDPE21K375GA
/dev/sdb                  6.99 TB      False   True      SAMSUNG MZ7LH7T6
/dev/sdc                  6.99 TB      False   True      SAMSUNG MZ7LH7T6
/dev/sdd                  6.99 TB      False   True      SAMSUNG MZ7LH7T6
/dev/sda                  447.13 GB    False   False     Micron_5200_MTFD

[root@depressa008 ubuntu]# 

Command:cephadm shell lsmcli ldl in depressa008

[root@depressa008 ubuntu]# cephadm shell lsmcli ldl
Inferring fsid 1be45d94-976b-11eb-b36b-002590fbc342
Using recent ceph image registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:7f38a6cac0bc00f1e2bc729d3df7c6c36de2ec8a4666d4dc6dbcf4dc53226522
Path         | SCSI VPD 0x83    | Link Type  | Serial Number  | Health Status
-----------------------------------------------------------------------------
/dev/sdd     | 5002538e09873fb4 | PATA/SATA  | S487NY0M801866 | Good         
/dev/sda     | 500a07512387b90d | PATA/SATA  | 19302387B90D   | Good         
/dev/sdb     | 5002538e09873fa7 | PATA/SATA  | S487NY0M801863 | Good         
/dev/sdc     | 5002538e0987403c | PATA/SATA  | S487NY0M801906 | Good         
/dev/nvme0n1 |                  | No Support |                | Unknown      
/dev/nvme1n1 |                  | No Support |                | Unknown      
WARN[0000] container 18afe2f0a07929dd0166c7e826d16ca7345d3c9b29d511ab7d0e69974ea1545a: poststop hook 0: executing []: exit status 1 
WARN[0000] container 18afe2f0a07929dd0166c7e826d16ca7345d3c9b29d511ab7d0e69974ea1545a: poststop hook 0: executing []: exit status 1 
[root@depressa008 ubuntu]#

The vendor information not exist in depressa008 for SSD's and NVME's, but for SSD's the vendor name is updated with "ATA".

Comment 4 Juan Miguel Olmo 2021-04-08 09:25:12 UTC
As you can see, there is no information returned for NVME devices, so these devices are not supported by libstoragemgmt and we cannot obtain the vendor information using other means.

So the selection of these devices in order to be part of an OSD must be done using any of the attributes that we can obtain from the devices:
-Path
-Model Name
-Size
-Rotational