Bug 1979476 - Iscsi gateways are not showing "UP" in dashboard if not collocated with bootstrap nodes
Summary: Iscsi gateways are not showing "UP" in dashboard if not collocated with boots...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: Cephadm
Version: 5.0
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: 5.1
Assignee: Adam King
QA Contact: Gopi
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-07-06 07:27 UTC by Gopi
Modified: 2022-04-04 10:21 UTC (History)
10 users (show)

Fixed In Version: ceph-16.2.6-18.el8cp
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-04-04 10:21:14 UTC
Embargoed:
gpatta: needinfo+
gpatta: needinfo+
gpatta: needinfo+


Attachments (Terms of Use)
Screeshot collocated with osd nodes (108.15 KB, image/png)
2021-07-06 07:27 UTC, Gopi
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHCEPH-863 0 None None None 2021-08-23 12:30:09 UTC
Red Hat Product Errata RHSA-2022:1174 0 None None None 2022-04-04 10:21:28 UTC

Description Gopi 2021-07-06 07:27:30 UTC
Created attachment 1798455 [details]
Screeshot collocated with osd nodes

Description of problem:

Iscsi gateways are not showing up in dashboard if we collocated with osd nodes. I can see them in CLI and if we deploy with bootstrap node then it is working fine.

Version-Release number of selected component (if applicable):
ceph version 16.2.0-88.el8cp (39884f5728635903be37a5fa873e4ef9d8a0b04a) pacific (stable)

How reproducible:
100%

Steps to Reproduce:
1. Deploy cluster using cephadm
2. Deploy iscsi gateways using iscsi.yml file
3. adding gateways to dashboard using below proceedure.
http://pastebin.test.redhat.com/969703


Actual results:
Gateways are showing "down" in dashboard.

Expected results:
Gateways should be up in dashboard.

Additional info:
I used bootstrap nodes to deploy gateways and tried adding in dashboard then it's showing as up without following the below procedure. 
http://pastebin.test.redhat.com/969703

Please find the screenshots.

Comment 3 Gopi 2021-07-06 12:31:04 UTC
Hi Ernesto,

I checked firewall and those are in disable state.

[root@magna108 ubuntu]# sudo firewall-cmd --state
not running

[root@magna113 ubuntu]# sudo firewall-cmd --state
not running

[root@magna108 ubuntu]# ss -tnlp | grep rbd
LISTEN 0      128                *:5000            *:*    users:(("rbd-target-api",pid=226207,fd=15))              
[root@magna108 ubuntu]#

Comment 6 Gopi 2021-07-07 10:12:57 UTC
Moving to 5.0z1 as this is not a regression.

Comment 7 Sebastian Wagner 2021-08-17 12:22:12 UTC
Can you answer Ernesto's questions?

Comment 8 Gopi 2021-08-23 12:29:25 UTC
Sure. I will provide you the details with newly configured setup as the previous setup is not there now.

Comment 12 Gopi 2021-09-06 13:27:51 UTC
Hi Ernesto,

As per our discussion, i have shared the setup details with you. But this time, i have observed one more new thing that, my second gateway node link is disappeared from iscsi-gateway-list after few seconds and unable to see that host in dashboard as well.

Steps:
[ceph: root@magna031 ~]# cat iscsi.yml 
service_type: iscsi
service_id: iscsi
placement:
  hosts:
  - depressa001
  - depressa002
spec:
  pool: iscsi_pool
  trusted_ip_list: "10.1.172.201,10.1.172.202"
  api_user: admin
  api_password: admin
[ceph: root@magna031 ~]# ceph orch apply -i iscsi.yml 
Scheduled iscsi.iscsi update...
[ceph: root@magna031 ~]# ceph dashboard set-iscsi-api-ssl-verification false
Option ISCSI_API_SSL_VERIFICATION updated
[ceph: root@magna031 ~]# ceph dashboard iscsi-gateway-list
{"gateways": {"depressa001": {"service_url": "http://admin:admin@10.1.172.201:5000"}, "depressa002": {"service_url": "http://admin:admin@10.1.172.202:5000"}}}
[ceph: root@magna031 ~]# vi gatewayfile1
[ceph: root@magna031 ~]# vi gatewayfile2
[ceph: root@magna031 ~]# cat gatewayfile1
http://admin:admin@10.1.172.201:5000
[ceph: root@magna031 ~]# cat gatewayfile2
http://admin:admin@10.1.172.202:5000
[ceph: root@magna031 ~]# ceph dashboard iscsi-gateway-add -i gatewayfile1 depressa001
Success
[ceph: root@magna031 ~]# ceph dashboard iscsi-gateway-add -i gatewayfile1 depressa002
Success


Wait for sometime and checked it and one gateway link is not there.

[ceph: root@magna031 ~]# ceph dashboard iscsi-gateway-list
{"gateways": {"depressa001": {"service_url": "http://admin:admin@10.1.172.201:5000"}}}


If you think this is a different issue, then I can file a new BZ as this is a regression as it worked previously.

Comment 15 Daniel Pivonka 2021-09-21 20:23:38 UTC
upstream tracker: https://tracker.ceph.com/issues/52692
upstream master pr: https://github.com/ceph/ceph/pull/43246

Comment 16 Sebastian Wagner 2021-11-04 12:28:07 UTC
moving to 5.1 as z2 was reduced in scope to ODF and installation related bugs. This is only shows up in the dashboard.

Comment 25 Preethi 2022-02-08 09:31:16 UTC
Working as expected. Moving to verified state.

Comment 27 errata-xmlrpc 2022-04-04 10:21:14 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat Ceph Storage 5.1 Security, Enhancement, and Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:1174


Note You need to log in before you can comment on or make changes to this bug.