Bug 2005838

Summary:	[Tracker for Ceph BZ #1981186] [DR] Rbdmirror pod keeps showing unable to find a keyring
Product:	[Red Hat Storage] Red Hat OpenShift Data Foundation	Reporter:	Pratik Surve <prsurve>
Component:	ceph	Assignee:	Scott Ostapovicz <sostapov>
Status:	CLOSED ERRATA	QA Contact:	Pratik Surve <prsurve>
Severity:	medium	Docs Contact:
Priority:	unspecified
Version:	4.9	CC:	bniver, idryomov, kramdoss, madam, mrajanna, muagarwa, ocs-bugs, odf-bz-bot, sapillai, tdesala
Target Milestone:	---
Target Release:	ODF 4.9.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	v4.9.0-182.ci	Doc Type:	No Doc Update
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2021-12-13 17:46:30 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1981186
Bug Blocks:

Description Pratik Surve 2021-09-20 10:09:44 UTC

Description of problem (please be detailed as possible and provide log
snippests):

[DR] Rbdmirror pod keeps showing unable to find a keyring 

Version of all relevant components (if applicable):

odf-operator.v4.9.0-138.ci

Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?


Is there any workaround available to the best of your knowledge?


Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?
1

Can this issue reproducible?
yes

Can this issue reproduce from the UI?


If this is a regression, please provide more details to justify this:


Steps to Reproduce:
1. Deploy DR on 2 cluster
2. Enable mirroring on them
3. Deploy app that uses rbd PVC which is mirrored 
4. Check rbdmirror pod logs


Actual results:

debug 2021-09-14T16:19:00.051+0000 7f3ede7205c0 -1 Errors while parsing config file!
debug 2021-09-14T16:19:00.051+0000 7f3ede7205c0 -1 can't open 3401ff21-accc-4fbe-9cd7-34c9e729aa0d.conf: (2) No such file or directory
debug 2021-09-14T16:19:00.052+0000 7f3ede7205c0 -1 auth: unable to find a keyring on /etc/ceph/3401ff21-accc-4fbe-9cd7-34c9e729aa0d.client.rbd-mirror-peer.keyring,/etc/ceph/3401ff21-accc-4fbe-9cd7-34c9e729aa0d.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory
debug 2021-09-14T16:19:00.053+0000 7f3ede7205c0 -1 auth: unable to find a keyring on /etc/ceph/3401ff21-accc-4fbe-9cd7-34c9e729aa0d.client.rbd-mirror-peer.keyring,/etc/ceph/3401ff21-accc-4fbe-9cd7-34c9e729aa0d.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory



Expected results:
There should not be any Errors 

Additional info:

Pod logs:- http://pastebin.test.redhat.com/995140

Comment 3 Travis Nielsen 2021-09-20 15:22:31 UTC

Can you take a look?

Comment 4 Santosh Pillai 2021-09-21 07:05:20 UTC

Confirmed with QE that these error logs does not affect the mirrored image. So these could be invalid error logs. There is a tracker about similar bogus log messages - https://tracker.ceph.com/issues/51628

Following up with the ceph team for more info.

Comment 5 Santosh Pillai 2021-09-21 09:26:31 UTC

upstream ceph PR for the fix - https://github.com/ceph/ceph/pull/43220 
Changing the component to ceph

Comment 12 Mudit Agarwal 2021-09-28 13:34:05 UTC

Ceph BZ is ON_QA

Comment 16 errata-xmlrpc 2021-12-13 17:46:30 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat OpenShift Data Foundation 4.9.0 enhancement, security, and bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:5086