Bug 2017827

Summary: After a scale down, ovn agents are not getting deleted
Product: Red Hat OpenStack Reporter: David Vallee Delisle <dvd>
Component: openstack-tripleo-heat-templatesAssignee: David Vallee Delisle <dvd>
Status: CLOSED CURRENTRELEASE QA Contact: Joe H. Rahme <jhakimra>
Severity: high Docs Contact:
Priority: high    
Version: 17.0 (Wallaby)CC: mburns
Target Milestone: ---Keywords: Patch, Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-tripleo-heat-templates-14.3.1-0.20211127001845.d48e51e.el8ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-01-18 14:30:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version: Xena
Embargoed:
Bug Depends On: 2018013    
Bug Blocks:    
Attachments:
Description Flags
ovn-metadata-agent.log none

Description David Vallee Delisle 2021-10-27 13:48:55 UTC 
Description of problem:
When we scale down, we have the agents still presents [1].

If we scale up again keeping the same node names, the metadata agent is not working properly [2]

After we delete the agents, they get recreated [3] using the id from the error message in [2]



[1]
~~~
[stack@undercloud-0 ~]$ neutron agent-list                                                                                                                                                                                                                                                
neutron CLI is deprecated and will be removed in the Z cycle. Use openstack CLI instead.                                                                                                                                                                                                    
+--------------------------------------+------------------------------+-------------------------+-------------------+-------+----------------+----------------------------+                                                                                                                
| id                                   | agent_type                   | host                    | availability_zone | alive | admin_state_up | binary                     |                                                                                                                
+--------------------------------------+------------------------------+-------------------------+-------------------+-------+----------------+----------------------------+                                                                                                                
| a5f6f246-fce6-44f5-89ee-d342a57168b9 | OVN Controller Gateway agent | controller-2.home.arpa  |                   | :-)   | True           | ovn-controller             |                                                                                                                
| 702b5e5d-a751-52ad-aec0-cc471e11f917 | OVN Metadata agent           | compute-0.home.arpa     |                   | :-)   | True           | neutron-ovn-metadata-agent |                                                                                                                
| 601420bd-3474-4787-b8f8-8b090891766f | OVN Controller agent         | compute-0.home.arpa     |                   | :-)   | True           | ovn-controller             |                                                                                                                
| 35d1712c-14b1-5232-9ed9-eefaeef9eba9 | OVN Metadata agent           | computevdpa-0.home.arpa |                   | xxx   | True           | neutron-ovn-metadata-agent |                                                                                                                
| f102f501-da6e-49ce-bab9-3894adcca03e | OVN Controller agent         | computevdpa-0.home.arpa |                   | xxx   | True           | ovn-controller             |                                                                                                                
| 9b15a906-c50d-48bc-8382-c61a817d4cd2 | OVN Controller Gateway agent | controller-1.home.arpa  |                   | :-)   | True           | ovn-controller             |                                                                                                                
| d8603757-391d-5efd-83f0-ff0adf735f7b | OVN Metadata agent           | compute-1.home.arpa     |                   | :-)   | True           | neutron-ovn-metadata-agent |                                                                                                                
| 1dc65f6b-d1ba-4d06-9ad6-4500bea8b9cf | OVN Controller agent         | compute-1.home.arpa     |                   | :-)   | True           | ovn-controller             |                                                                                                                
| fcf21215-9c31-459f-865f-16ee9489118a | OVN Controller Gateway agent | controller-0.home.arpa  |                   | :-)   | True           | ovn-controller             |                                                                                                                
| 90b542f8-e9a9-593c-a68a-cb5c1a3ae5a1 | OVN Metadata agent           | computevdpa-1.home.arpa |                   | xxx   | True           | neutron-ovn-metadata-agent |                                                                                                                
| 03485cc9-c676-4593-abc5-6b8a7e098724 | OVN Controller agent         | computevdpa-1.home.arpa |                   | xxx   | True           | ovn-controller             |                                                                                                                
+--------------------------------------+------------------------------+-------------------------+-------------------+-------+----------------+----------------------------+                                                                                                                 
~~~

[2]
~~~
2021-10-27 12:11:33.375 30321 ERROR ovsdbapp.backend.ovs_idl.command ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Chassis_Private with name=2c95cd13-8698-462d-aee3-c13729ffd6ef
~~~

[3]
~~~
 [stack@undercloud-0 ovn]$ openstack network agent list --long
+--------------------------------------+------------------------------+-------------------------+-------------------+-------+-------+----------------------------+
| ID                                   | Agent Type                   | Host                    | Availability Zone | Alive | State | Binary                     |
+--------------------------------------+------------------------------+-------------------------+-------------------+-------+-------+----------------------------+
| a5f6f246-fce6-44f5-89ee-d342a57168b9 | OVN Controller Gateway agent | controller-2.home.arpa  |                   | :-)   | UP    | ovn-controller             |
| 702b5e5d-a751-52ad-aec0-cc471e11f917 | OVN Metadata agent           | compute-0.home.arpa     |                   | :-)   | UP    | neutron-ovn-metadata-agent |
| 601420bd-3474-4787-b8f8-8b090891766f | OVN Controller agent         | compute-0.home.arpa     |                   | :-)   | UP    | ovn-controller             |
| 9b15a906-c50d-48bc-8382-c61a817d4cd2 | OVN Controller Gateway agent | controller-1.home.arpa  |                   | :-)   | UP    | ovn-controller             |
| d8603757-391d-5efd-83f0-ff0adf735f7b | OVN Metadata agent           | compute-1.home.arpa     |                   | :-)   | UP    | neutron-ovn-metadata-agent |
| 1dc65f6b-d1ba-4d06-9ad6-4500bea8b9cf | OVN Controller agent         | compute-1.home.arpa     |                   | :-)   | UP    | ovn-controller             |
| fcf21215-9c31-459f-865f-16ee9489118a | OVN Controller Gateway agent | controller-0.home.arpa  |                   | :-)   | UP    | ovn-controller             |
| 2c95cd13-8698-462d-aee3-c13729ffd6ef | OVN Controller agent         | computevdpa-1.home.arpa |                   | :-)   | UP    | ovn-controller             |
| 25ea56ca-641a-49a7-b696-c555a51aa6e3 | OVN Controller agent         | computevdpa-0.home.arpa |                   | :-)   | UP    | ovn-controller             |
| 1183459a-f8fc-5e24-8e8f-cb8a84987b37 | OVN Metadata agent           | computevdpa-1.home.arpa |                   | :-)   | UP    | neutron-ovn-metadata-agent |
| 0b9c8d59-0579-5588-b8ad-31f775e56c1d | OVN Metadata agent           | computevdpa-0.home.arpa |                   | :-)   | UP    | neutron-ovn-metadata-agent |
+--------------------------------------+------------------------------+-------------------------+-------------------+-------+-------+----------------------------+
~~~
Comment 1 David Vallee Delisle 2021-10-27 14:01:01 UTC 
Created attachment 1837624 [details]
ovn-metadata-agent.log