Bug 2097058 - DCN: cinder-volume is not able to establish connection with etcd cluster
Summary: DCN: cinder-volume is not able to establish connection with etcd cluster
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-tripleo-heat-templates
Version: 17.0 (Wallaby)
Hardware: Unspecified
OS: Unspecified
medium
high
Target Milestone: rc
: 17.0
Assignee: Alan Bishop
QA Contact: Marian Krcmarik
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-06-14 19:45 UTC by Marian Krcmarik
Modified: 2022-09-21 12:22 UTC (History)
5 users (show)

Fixed In Version: openstack-tripleo-heat-templates-14.3.1-0.20220706080800.feca772.el9ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-09-21 12:22:30 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 845982 0 None master: MERGED tripleo-heat-templates: etcd: fix service config to work with latest versions (I3ed29a14298f4df94b8a5520615bfa85cd291346... 2022-06-29 18:05:50 UTC
OpenStack gerrit 847184 0 None stable/wallaby: MERGED tripleo-heat-templates: etcd: fix service config to work with latest versions (I3ed29a14298f4df94b8a5520615bfa85cd291346... 2022-06-29 18:05:56 UTC
Red Hat Issue Tracker OSP-15744 0 None None None 2022-06-14 20:01:22 UTC
Red Hat Product Errata RHEA-2022:6543 0 None None None 2022-09-21 12:22:52 UTC

Description Marian Krcmarik 2022-06-14 19:45:34 UTC 
Description of problem:
The cinder-volume deployed on a DCN site with ceph backend and managed by etcd is not able to make a successful connection to the etcd cluster and throws following error:
2022-06-13 10:00:40.691 80151 INFO cinder.service [-] Starting cinder-volume node (version 18.2.1)
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service [-] Error starting thread.: etcd3gw.exceptions.Etcd3Exception: Not Found
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service Traceback (most recent call last):
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service   File "/usr/lib/python3.9/site-packages/oslo_service/service.py", line 807, in run_service
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service     service.start()
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service   File "/usr/lib/python3.9/site-packages/cinder/service.py", line 220, in start
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service coordination.COORDINATOR.start()
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service   File "/usr/lib/python3.9/site-packages/cinder/coordination.py", line 67, in start
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service self.coordinator.start(start_heart=True)
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service   File "/usr/lib/python3.9/site-packages/tooz/coordination.py", line 689, in start
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service super(CoordinationDriverWithExecutor, self).start(start_heart)
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service   File "/usr/lib/python3.9/site-packages/tooz/coordination.py", line 426, in start
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service     self._start()
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service   File "/usr/lib/python3.9/site-packages/tooz/drivers/etcd3gw.py", line 224, in _start
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service self._membership_lease = self.client.lease(self.membership_timeout)
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service   File "/usr/lib/python3.9/site-packages/etcd3gw/client.py", line 121, in lease
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service     result = self.post(self.get_url("/lease/grant"),
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service   File "/usr/lib/python3.9/site-packages/etcd3gw/client.py", line 91, in post
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service     raise exceptions.Etcd3Exception(resp.text, resp.reason)
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service etcd3gw.exceptions.Etcd3Exception: Not Found
2022-06-13 10:00:40.711 80151 ERROR oslo_service.service 


Version-Release number of selected component (if applicable):
openstack-tripleo-heat-templates-14.3.1-0.20220513220827.4edb55d.el9ost.noarch

How reproducible:
Always

Steps to Reproduce:
1. Deploy DCN env with storage (ceph backend) managed byt etcd on a DCN site.

Actual results:
The cinder volume service is not able to create a successful connection to the etcd cluster.

Expected results:
Operational cinder-volume service on the DCN site.

Additional info:
Comment 8 errata-xmlrpc 2022-09-21 12:22:30 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 17.0 (Wallaby)), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2022:6543
Note You need to log in before you can comment on or make changes to this bug.