Bug 2143428 - test_hard_reboot_controllers_recovery fails occasionally
Summary: test_hard_reboot_controllers_recovery fails occasionally
Keywords:
Status: CLOSED DUPLICATE of bug 2133743
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-neutron
Version: 16.2 (Train)
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: ---
Assignee: Miro Tomaska
QA Contact: Eran Kuris
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-11-16 22:22 UTC by Miro Tomaska
Modified: 2022-11-29 04:17 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-11-29 04:17:44 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-20246 0 None None None 2022-11-16 22:24:33 UTC

Description Miro Tomaska 2022-11-16 22:22:29 UTC
Description of problem:
tobiko.tests.faults.ha.test_cloud_recovery.DisruptTripleoNodesTest.test_hard_reboot_controllers_recovery has been failing occasionally [1]

It appears that neutron_l3_agent is not in the list of running containers when a controller gets rebooted. I inspected tobiko log file for the test_hard_reboot_controllers_recovery test section [2].
However, the controller-2 l3-agent log does not show any abnormality [3] in fact it shows it as running and spinning off haproxy side containers which can be seen in the tobiko log list.
This is as far as I took this debug, we need to see if this is perhaps a test problem, i.e. not getting an accurate list of running containers. 
OR this could be related to an existing BZ2133743. In that BZ, the haproxy container is not started but not the l3-agent container is.

[1] https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/neutron/job/DFG-network-neutron-16.2_director-rhel-virthost-3cont_2comp-ml2ovs-ipv4-vxlan-tobiko-tempest-dvr/35/testReport/junit/tobiko.tests.faults.ha.test_cloud_recovery/DisruptTripleoNodesTest/Tobiko___test_hard_reboot_controllers_recovery/

[2] timestamp 23:34:15(first output) http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-network-neutron-16.2_director-rhel-virthost-3cont_2comp-ml2ovs-ipv4-vxlan-tobiko-tempest-dvr/35/test_results/tobiko_faults-neutron_1/tobiko.log

[3] http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-network-neutron-16.2_director-rhel-virthost-3cont_2comp-ml2ovs-ipv4-vxlan-tobiko-tempest-dvr/35/controller-2/var/log/containers/neutron/l3-agent.log.1.gz

Comment 2 Miro Tomaska 2022-11-29 04:17:44 UTC

*** This bug has been marked as a duplicate of bug 2133743 ***


Note You need to log in before you can comment on or make changes to this bug.