Bug 1726217

Summary:	On fresh osp15 deployment ovn-controller on compute is in unhealthy state
Product:	Red Hat OpenStack	Reporter:	pkomarov
Component:	openstack-tripleo	Assignee:	Michele Baldessari <mbaldessari>
Status:	CLOSED DUPLICATE	QA Contact:	Arik Chernetsky <achernet>
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	15.0 (Stein)	CC:	apevec, dalvarez, jlibosva, lhh, lmartins, majopela, mburns, michele, scohen, twilson
Target Milestone:	---	Keywords:	Triaged, ZStream
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:
Clones:	1740114 (view as bug list)		Environment:
Last Closed:	2020-02-06 14:28:22 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1720947, 1757254
Bug Blocks:	1740114, 1740115

Description pkomarov 2019-07-02 11:01:01 UTC

Description of problem:
On fresh osp15 deployment ovn-controller on compute is in unhealthy state

Version-Release number of selected component (if applicable):
ospo15 
RHOS_TRUNK-15.0-RHEL-8-20190619.n.1

Steps to Reproduce:
rerun : 
https://rhos-ci-staging-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/DFG/view/pidone/view/sanity/job/DFG-pidone-sanity-15_director-rhel-virthost-3cont_2comp_3ceph-ipv4-geneve-sanity/11/testReport/junit/.home.stack.openstack-sts.tests.sanity/01_POST_DEPLOY_CHECK/STS_HA_Tests___01_POST_DEPLOY_CHECK_sh/

Additional info:
overcloud nodes's logs and files are at : 
https://rhos-ci-staging-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/DFG/view/pidone/view/sanity/job/DFG-pidone-sanity-15_director-rhel-virthost-3cont_2comp_3ceph-ipv4-geneve-sanity/11/artifact/

test output is at : 
https://rhos-ci-staging-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/DFG/view/pidone/view/sanity/job/DFG-pidone-sanity-15_director-rhel-virthost-3cont_2comp_3ceph-ipv4-geneve-sanity/11/testReport/junit/.home.stack.openstack-sts.tests.sanity/01_POST_DEPLOY_CHECK/STS_HA_Tests___01_POST_DEPLOY_CHECK_sh/

Comment 2 pkomarov 2019-07-03 12:16:38 UTC

openstack network agent list
+--------------------------------------+----------------------+--------------------------+-------------------+-------+-------+-------------------------------+
| ID                                   | Agent Type           | Host                     | Availability Zone | Alive | State | Binary                        |
+--------------------------------------+----------------------+--------------------------+-------------------+-------+-------+-------------------------------+
| f901907b-ef6e-4d13-a9a4-0acc914da566 | OVN Controller agent | compute-0.localdomain    | n/a               | :-)   | UP    | ovn-controller                |
| f2fe5474-a1bc-49b7-abff-79206d1a58af | OVN Metadata agent   | compute-0.localdomain    | n/a               | :-)   | UP    | networking-ovn-metadata-agent |
| 8701def4-92d7-4893-8927-80fd08eff56b | OVN Controller agent | compute-1.localdomain    | n/a               | :-)   | UP    | ovn-controller                |
| 7471ef8b-ae03-4fc4-8130-703e97f3d34b | OVN Metadata agent   | compute-1.localdomain    | n/a               | :-)   | UP    | networking-ovn-metadata-agent |
| 8fbf455c-cdff-46d1-80e8-2ca80415e400 | OVN Controller agent | controller-0.localdomain | n/a               | :-)   | UP    | ovn-controller                |
| 579c127f-6470-4d5b-826f-81a0f1c7ecba | OVN Controller agent | controller-2.localdomain | n/a               | :-)   | UP    | ovn-controller                |
| c8d78525-37c5-40ed-96a0-e4645094d7ea | OVN Controller agent | controller-1.localdomain | n/a               | :-)   | UP    | ovn-controller                |
+--------------------------------------+----------------------+--------------------------+-------------------+-------+-------+-------------------


run sts test which just check openstack services and boots up a vm with rally : 
http://pastebin.test.redhat.com/777011
^^^
In this sts test there are no reboots or disruptions

then ovn agents are in unhealthy state : 

(overcloud) [stack@undercloud-0 openstack-sts]$ openstack network agent list
+--------------------------------------+----------------------+--------------------------+-------------------+-------+-------+-------------------------------+
| ID                                   | Agent Type           | Host                     | Availability Zone | Alive | State | Binary                        |
+--------------------------------------+----------------------+--------------------------+-------------------+-------+-------+-------------------------------+
| f901907b-ef6e-4d13-a9a4-0acc914da566 | OVN Controller agent | compute-0.localdomain    | n/a               | XXX   | UP    | ovn-controller                |
| f2fe5474-a1bc-49b7-abff-79206d1a58af | OVN Metadata agent   | compute-0.localdomain    | n/a               | XXX   | UP    | networking-ovn-metadata-agent |
| 8701def4-92d7-4893-8927-80fd08eff56b | OVN Controller agent | compute-1.localdomain    | n/a               | :-)   | UP    | ovn-controller                |
| 7471ef8b-ae03-4fc4-8130-703e97f3d34b | OVN Metadata agent   | compute-1.localdomain    | n/a               | :-)   | UP    | networking-ovn-metadata-agent |
| 8fbf455c-cdff-46d1-80e8-2ca80415e400 | OVN Controller agent | controller-0.localdomain | n/a               | :-)   | UP    | ovn-controller                |
| 579c127f-6470-4d5b-826f-81a0f1c7ecba | OVN Controller agent | controller-2.localdomain | n/a               | :-)   | UP    | ovn-controller                |
| c8d78525-37c5-40ed-96a0-e4645094d7ea | OVN Controller agent | controller-1.localdomain | n/a               | :-)   | UP    | ovn-controller                |
+--------------------------------------+----------------------+--------------------------+-------------------+-------+-------+-------------------------------+

Comment 14 Jakub Libosvar 2020-02-06 14:28:22 UTC


*** This bug has been marked as a duplicate of bug 1720947 ***