Bug 2306577

Description of problem (please be detailed as possible and provide log
snippests):
Not getting the expected output from python script ceph-external-cluster-details-exporter.py

Version of all relevant components (if applicable):
ODF 4.17 with External RHCS 7.17z cluster

Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?


Is there any workaround available to the best of your knowledge?


Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?


Can this issue reproducible?


Can this issue reproduce from the UI?
No

If this is a regression, please provide more details to justify this:


Steps to Reproduce:
1. Get ODF 4.17 External cluster with RHCS 7.1z
2. login to cephadm shell
3. run python script ceph-external-cluster-details-exporter.py with --config-file

Actual results:
[ceph: root@osd-0 ~]# python3 script.py --config-file config4.ini
Command Input: {"format": "json", "prefix": "fs ls"}
Return Val: 0
Command Output: b'[{"name":"fsvol001","metadata_pool":"cephfs.fsvol001.meta","metadata_pool_id":7,"data_pool_ids":[8],"data_pools":["cephfs.fsvol001.data"]}]\n'
Error Message:
----------

Command Input: {"format": "json", "prefix": "quorum_status"}
Return Val: 0
Command Output: b'{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["osd-1","osd-3","osd-2"],"quorum_leader_name":"osd-1","quorum_age":30607,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":5,"fsid":"0fdc6e8e-5f85-11ef-812f-0050568f559e","modified":"2024-08-21T06:21:41.002308Z","created":"2024-08-21T06:17:53.766748Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"0","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"osd-1","public_addrs":{"addrvec":[{"type":"v2","addr":"10.1.112.188:3300","nonce":0},{"type":"v1","addr":"10.1.112.188:6789","nonce":0}]},"addr":"10.1.112.188:6789/0","public_addr":"10.1.112.188:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"osd-3","public_addrs":{"addrvec":[{"type":"v2","addr":"10.1.112.192:3300","nonce":0},{"type":"v1","addr":"10.1.112.192:6789","nonce":0}]},"addr":"10.1.112.192:6789/0","public_addr":"10.1.112.192:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"osd-2","public_addrs":{"addrvec":[{"type":"v2","addr":"10.1.112.190:3300","nonce":0},{"type":"v1","addr":"10.1.112.190:6789","nonce":0}]},"addr":"10.1.112.190:6789/0","public_addr":"10.1.112.190:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}}\n'
Error Message:
----------

Command Input: {"entity": "client.healthchecker", "format": "json", "prefix": "auth get"}
Return Val: 0
Command Output: b'[{"entity":"client.healthchecker","key":"AQAimMVmOqYlCBAAY3qUt4MGAVsSqoXVmtIVow==","caps":{"mgr":"allow command config","mon":"allow r, allow command quorum_status, allow command version","osd":"profile rbd-read-only, allow rwx pool=default.rgw.meta, allow r pool=.rgw.root, allow rw pool=default.rgw.control, allow rx pool=default.rgw.log, allow x pool=default.rgw.buckets.index"}}]'
Error Message:
----------

Command Input: {"format": "json", "prefix": "mgr services"}
Return Val: 0
Command Output: b'{"dashboard":"https://10.1.112.189:8443/","prometheus":"http://10.1.112.189:9283/"}'
Error Message:
----------

Command Input: {"entity": "client.csi-rbd-node", "format": "json", "prefix": "auth get"}
Return Val: 0
Command Output: b'[{"entity":"client.csi-rbd-node","key":"AQAimMVmpn6+CBAAp4rYMZcJM4I/zsrNMdN68A==","caps":{"mon":"profile rbd, allow command \'osd blocklist\'","osd":"profile rbd"}}]'
Error Message:
----------

Command Input: {"entity": "client.csi-rbd-provisioner", "format": "json", "prefix": "auth get"}
Return Val: 0
Command Output: b'[{"entity":"client.csi-rbd-provisioner","key":"AQAimMVm79tkCRAAVY32repcNJ8v3OIBCdXtzw==","caps":{"mgr":"allow rw","mon":"profile rbd, allow command \'osd blocklist\'","osd":"profile rbd"}}]'
Error Message:
----------

Command Input: {"entity": "client.csi-cephfs-node", "format": "json", "prefix": "auth get"}
Return Val: 0
Command Output: b'[{"entity":"client.csi-cephfs-node","key":"AQAimMVmynDxCRAA+3nqLAlWz0qZYEzQ4OL2BQ==","caps":{"mds":"allow rw","mgr":"allow rw","mon":"allow r, allow command \'osd blocklist\'","osd":"allow rw tag cephfs *=*"}}]'
Error Message:
----------

Command Input: {"entity": "client.csi-cephfs-provisioner", "format": "json", "prefix": "auth get"}
Return Val: 0
Command Output: b'[{"entity":"client.csi-cephfs-provisioner","key":"AQAimMVmyECoChAApgcWNCuYtCV2XFgXoKGAZQ==","caps":{"mgr":"allow rw","mon":"allow r, allow command \'osd blocklist\'","osd":"allow rw tag cephfs metadata=*"}}]'
Error Message:
----------

Command Input: {"format": "json", "prefix": "status"}
Return Val: 0
Command Output: b'{"fsid":"0fdc6e8e-5f85-11ef-812f-0050568f559e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":20,"quorum":[0,1,2],"quorum_names":["osd-1","osd-3","osd-2"],"quorum_age":30608,"monmap":{"epoch":5,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":212,"num_osds":8,"num_up_osds":8,"osd_up_since":1724221564,"num_in_osds":8,"osd_in_since":1724221545,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":433}],"num_pgs":433,"num_pools":8,"num_objects":2447,"data_bytes":7963886504,"bytes_used":33492197376,"bytes_avail":2165497503744,"bytes_total":2198989701120,"read_bytes_sec":511,"write_bytes_sec":182531,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":12,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"fsvol001.osd-2.xnxovb","status":"up:active","gid":34517}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://10.1.112.189:8443/","prometheus":"http://10.1.112.189:9283/"}},"servicemap":{"epoch":279,"modified":"2024-08-21T14:51:46.732533+0000","services":{"mon":{"daemons":{"summary":"","osd-3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"rgw":{"daemons":{"summary":"","24519":{"start_epoch":6,"start_stamp":"2024-08-21T06:26:37.493615+0000","gid":24519,"addr":"10.1.112.188:0/30800825","metadata":{"arch":"x86_64","ceph_release":"reef","ceph_version":"ceph version 18.2.1-229.el9cp (ef652b206f2487adfc86613646a4cac946f6b4e0) reef (stable)","ceph_version_short":"18.2.1-229.el9cp","container_hostname":"osd-1","container_image":"registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:4f598dcdef399669e615b5624fd2ff3c4d152e44da2614e5aa5e286d628158ad","cpu":"Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz","distro":"rhel","distro_description":"Red Hat Enterprise Linux 9.4 (Plow)","distro_version":"9.4","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"osd-1","id":"rgw.ssl.osd-1.vfvqay","kernel_description":"#1 SMP PREEMPT_DYNAMIC Fri Aug 25 09:13:12 EDT 2023","kernel_version":"5.14.0-284.30.1.el9_2.x86_64","mem_swap_kb":"5242876","mem_total_kb":"8879876","num_handles":"1","os":"Linux","pid":"2","realm_id":"","realm_name":"","zone_id":"107bd170-237a-4816-9e51-6375d577a737","zone_name":"default","zonegroup_id":"6f25f0c5-50ce-4057-9dae-b0836f95a6a4","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{}}\n'
Error Message:
----------

[{"name": "external-cluster-user-command", "kind": "ConfigMap", "data": {"args": "\"[Configurations]\nverbose = True\nrgw-pool-prefix = default\nrestricted-auth-permission = False\nv2-port-enable = False\nformat = json\ncephfs-filesystem-name = fsvol001\ncephfs-metadata-pool-name = cephfs.fsvol001.meta\ncephfs-data-pool-name = cephfs.fsvol001.data\nrbd-data-pool-name = rbd\nrgw-endpoint = 10.1.112.188:80\nrgw-skip-tls = False\nskip-monitoring-endpoint = False\ndry-run = False\nupgrade = False\n\""}}, {"name": "rook-ceph-mon-endpoints", "kind": "ConfigMap", "data": {"data": "osd-1=10.1.112.188:3300", "maxMonId": "0", "mapping": "{}"}}, {"name": "rook-ceph-mon", "kind": "Secret", "data": {"admin-secret": "admin-secret", "fsid": "0fdc6e8e-5f85-11ef-812f-0050568f559e", "mon-secret": "mon-secret"}}, {"name": "rook-ceph-operator-creds", "kind": "Secret", "data": {"userID": "client.healthchecker", "userKey": "AQAimMVmOqYlCBAAY3qUt4MGAVsSqoXVmtIVow=="}}, {"name": "monitoring-endpoint", "kind": "CephCluster", "data": {"MonitoringEndpoint": "10.1.112.189", "MonitoringPort": "9283"}}, {"name": "rook-csi-rbd-node", "kind": "Secret", "data": {"userID": "csi-rbd-node", "userKey": "AQAimMVmpn6+CBAAp4rYMZcJM4I/zsrNMdN68A=="}}, {"name": "rook-csi-rbd-provisioner", "kind": "Secret", "data": {"userID": "csi-rbd-provisioner", "userKey": "AQAimMVm79tkCRAAVY32repcNJ8v3OIBCdXtzw=="}}, {"name": "rook-csi-cephfs-provisioner", "kind": "Secret", "data": {"adminID": "csi-cephfs-provisioner", "adminKey": "AQAimMVmyECoChAApgcWNCuYtCV2XFgXoKGAZQ=="}}, {"name": "rook-csi-cephfs-node", "kind": "Secret", "data": {"adminID": "csi-cephfs-node", "adminKey": "AQAimMVmynDxCRAA+3nqLAlWz0qZYEzQ4OL2BQ=="}}, {"name": "rook-ceph-dashboard-link", "kind": "Secret", "data": {"userID": "ceph-dashboard-link", "userKey": "https://10.1.112.189:8443/"}}, {"name": "ceph-rbd", "kind": "StorageClass", "data": {"pool": "rbd", "csi.storage.k8s.io/provisioner-secret-name": "rook-csi-rbd-provisioner", "csi.storage.k8s.io/controller-expand-secret-name": "rook-csi-rbd-provisioner", "csi.storage.k8s.io/node-stage-secret-name": "rook-csi-rbd-node"}}, {"name": "cephfs", "kind": "StorageClass", "data": {"fsName": "fsvol001", "pool": "cephfs.fsvol001.data", "csi.storage.k8s.io/provisioner-secret-name": "rook-csi-cephfs-provisioner", "csi.storage.k8s.io/controller-expand-secret-name": "rook-csi-cephfs-provisioner", "csi.storage.k8s.io/node-stage-secret-name": "rook-csi-cephfs-node"}}, {"name": "ceph-rgw", "kind": "StorageClass", "data": {"endpoint": "10.1.112.188:80", "poolPrefix": "default"}}, {"name": "rgw-admin-ops-user", "kind": "Secret", "data": {"accessKey": "FM3D2KOC5VW86F8C8CRJ", "secretKey": "PHTE5gNsVr7kfDMjTM6nrdl4h42R7cDZfZoAUHEj"}}]

[ceph: root@osd-0 ~]# 

Expected results:
JSON output

Additional info: