Bug 2172611 - [OSP 17.0] After Overcloud Update Neutron agents become unhealthy
Summary: [OSP 17.0] After Overcloud Update Neutron agents become unhealthy
Keywords:
Status: ON_QA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-neutron
Version: 16.2 (Train)
Hardware: Unspecified
OS: Linux
medium
medium
Target Milestone: ---
: ---
Assignee: Miro Tomaska
QA Contact: Eran Kuris
URL:
Whiteboard:
Depends On: 2166969
Blocks:
TreeView+ depends on / blocked
 
Reported: 2023-02-22 17:41 UTC by Julia Marciano
Modified: 2023-08-03 15:58 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:
Embargoed:
jmarcian: needinfo-


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-22608 0 None None None 2023-02-22 17:41:43 UTC

Description Julia Marciano 2023-02-22 17:41:10 UTC
Description of paaAroblem:
After OC update, all ovn agents were detected as not alive:

Uploaded image for project: 'OpenStack Platform'

AssertionError: Unhealthy agent(s) found:
[
{
"admin_state_up": true,
"agent_type": "OVN Controller Gateway agent",
"alive": false,
"availability_zone": "",
"binary": "ovn-controller",
"configurations":

{ "bridge-mappings": "datacentre:br-ex,tenant:br-tenant", "chassis_name": "0451ff27-4e61-4f74-ab70-50cca70b7210" }
,
"description": "",
"heartbeat_timestamp": "2023-02-16 19:17:22.354160",
"host": "controller-1.redhat.local",
"id": "0451ff27-4e61-4f74-ab70-50cca70b7210",
"topic": "n/a"
},
{
"admin_state_up": true,
"agent_type": "OVN Controller Gateway agent",
"alive": false,
"availability_zone": "",
"binary": "ovn-controller",
"configurations":

{ "bridge-mappings": "datacentre:br-ex,tenant:br-tenant", "chassis_name": "9917161c-f5a9-4d66-a0c4-74bd7f8cc7f9" }
,
"description": "",
"heartbeat_timestamp": "2023-02-16 19:17:22.354661",
"host": "controller-2.redhat.local",
"id": "9917161c-f5a9-4d66-a0c4-74bd7f8cc7f9",
"topic": "n/a"
},
{
"admin_state_up": true,
"agent_type": "OVN Metadata agent",
"alive": false,
"availability_zone": "",
"binary": "neutron-ovn-metadata-agent",
"configurations":

{ "bridge-mappings": "datacentre:br-ex,tenant:br-tenant", "chassis_name": "6eb52c3b-65f3-4f1a-b125-e02522c6e7f2" }
,
"description": "",
"heartbeat_timestamp": "2023-02-16 19:17:22.354958",
"host": "compute-1.redhat.local",
"id": "91bbcf25-267a-59a9-812c-f7e92df8e3f5",
"topic": "n/a"
},
{
"admin_state_up": true,
"agent_type": "OVN Controller agent",
"alive": false,
"availability_zone": "",
"binary": "ovn-controller",
"configurations":

{ "bridge-mappings": "datacentre:br-ex,tenant:br-tenant", "chassis_name": "6eb52c3b-65f3-4f1a-b125-e02522c6e7f2" }
,
"description": "",
"heartbeat_timestamp": "2023-02-16 19:17:22.355192",
"host": "compute-1.redhat.local",
"id": "6eb52c3b-65f3-4f1a-b125-e02522c6e7f2",
"topic": "n/a"
},
{
"admin_state_up": true,
"agent_type": "OVN Controller Gateway agent",
"alive": false,
"availability_zone": "",
"binary": "ovn-controller",
"configurations":

{ "bridge-mappings": "datacentre:br-ex,tenant:br-tenant", "chassis_name": "4b6b55a5-e58c-4184-a121-b57122a54a99" }
,
"description": "",
"heartbeat_timestamp": "2023-02-16 19:17:22.355510",
"host": "controller-0.redhat.local",
"id": "4b6b55a5-e58c-4184-a121-b57122a54a99",
"topic": "n/a"
},
{
"admin_state_up": true,
"agent_type": "OVN Metadata agent",
"alive": false,
"availability_zone": "",
"binary": "neutron-ovn-metadata-agent",
"configurations":

{ "bridge-mappings": "datacentre:br-ex,tenant:br-tenant", "chassis_name": "50feb097-d00d-4be3-a330-b2148bc5e412" }
,
"description": "",
"heartbeat_timestamp": "2023-02-16 19:17:22.355872",
"host": "compute-0.redhat.local",
"id": "ed2384b1-5cea-541e-860d-137c4581e854",
"topic": "n/a"
},
{
"admin_state_up": true,
"agent_type": "OVN Controller agent",
"alive": false,
"availability_zone": "",
"binary": "ovn-controller",
"configurations":

{ "bridge-mappings": "datacentre:br-ex,tenant:br-tenant", "chassis_name": "50feb097-d00d-4be3-a330-b2148bc5e412" }
,
"description": "",
"heartbeat_timestamp": "2023-02-16 19:17:22.356414",
"host": "compute-0.redhat.local",
"id": "50feb097-d00d-4be3-a330-b2148bc5e412",
"topic": "n/a"
}
]

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.Run DFG-pidone-updates-17.0_director-rhel-virthost-3cont_2comp-ipv4-geneve-tobiko-faults job
2.
3.

Actual results:
Neutron agents are detected as not healthy

Expected results:
Neutron agents are alive

Additional info:


Note You need to log in before you can comment on or make changes to this bug.