Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1351101

Summary: Removing network fails with "internal server error" in HA environment
Product: Red Hat OpenStack Reporter: Arie Bregman <abregman>
Component: openstack-neutronAssignee: Assaf Muller <amuller>
Status: CLOSED ERRATA QA Contact: Ofer Blaut <oblaut>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 8.0 (Liberty)CC: abregman, amuller, chrisw, hmlnarik, nlevinki, nyechiel, srevivo, tfreger
Target Milestone: asyncKeywords: AutomationBlocker, ZStream
Target Release: 8.0 (Liberty)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-neutron-7.0.4-11.el7ost.noarch Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1348998 Environment:
Last Closed: 2016-08-24 13:30:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1348998    
Bug Blocks:    

Comment 2 Arie Bregman 2016-07-19 12:51:20 UTC
Latest rebase fixed the issue for OSP 8.

Comment 4 Ofer Blaut 2016-08-18 03:41:36 UTC
heat-admin@controller-0 ~]$ rpm -qa | grep neutron
python-neutron-7.1.1-4.el7ost.noarch
openstack-neutron-bigswitch-lldp-2015.3.8-1.el7ost.noarch
openstack-neutron-openvswitch-7.1.1-4.el7ost.noarch
openstack-neutron-bigswitch-agent-2015.3.8-1.el7ost.noarch
openstack-neutron-common-7.1.1-4.el7ost.noarch
python-neutron-lbaas-7.1.1-1.el7ost.noarch
openstack-neutron-lbaas-7.1.1-1.el7ost.noarch
openstack-neutron-ml2-7.1.1-4.el7ost.noarch
openstack-neutron-7.1.1-4.el7ost.noarch
openstack-neutron-metering-agent-7.1.1-4.el7ost.noarch
python-neutronclient-3.1.0-1.el7ost.noarch


heat-admin@compute-0 ~]$ rpm -qa | grep neutron
python-neutron-7.1.1-4.el7ost.noarch
openstack-neutron-bigswitch-lldp-2015.3.8-1.el7ost.noarch
openstack-neutron-openvswitch-7.1.1-4.el7ost.noarch
openstack-neutron-bigswitch-agent-2015.3.8-1.el7ost.noarch
openstack-neutron-common-7.1.1-4.el7ost.noarch
python-neutron-lbaas-7.1.1-1.el7ost.noarch
openstack-neutron-lbaas-7.1.1-1.el7ost.noarch
openstack-neutron-ml2-7.1.1-4.el7ost.noarch
openstack-neutron-7.1.1-4.el7ost.noarch
openstack-neutron-metering-agent-7.1.1-4.el7ost.noarch
python-neutronclient-3.1.0-1.el7ost.noarch




{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_connectivity_between_vms_on_different_networks [65.353182s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic [45.537446s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [62.455491s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_port_security_macspoofing_port [48.204373s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_preserve_preexisting_port [21.502399s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling [46.986013s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_subnet_details [37.685493s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_instance_port_admin_state [38.178976s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_router_admin_state [53.126665s] ... ok

======
Totals
======
Ran: 9 tests in 425.0000 sec.
 - Passed: 9
 - Skipped: 0
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 419.0300 sec.

{3} tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network [1.518742s] ... ok
{3} tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port [3.136298s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes [4.483215s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_delete_subnet_all_attributes [2.175286s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools [2.059799s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_slaac_subnet_with_ports [4.858750s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled [2.424199s] ... ok
{3} tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet [6.773718s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_delete_subnet_with_allocation_pools [4.945874s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw [1.990513s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_delete_subnet_with_default_gw [1.352126s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools [2.051177s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_stateless_subnet_with_ports [5.721636s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_delete_subnet_with_dhcp_enabled [2.505297s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_delete_subnet_with_gw [1.311192s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers [2.843692s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_all_attributes [1.611213s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway [1.176609s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_delete_subnet_with_gw_and_allocation_pools [1.695673s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_allocation_pools [1.808513s] ... ok
{3} tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network [2.582531s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_default_gw [1.305722s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_delete_subnet_with_host_routes_and_dns_nameservers [1.684325s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_dhcp_enabled [1.559178s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_delete_subnet_without_gateway [1.664817s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [3.882506s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_gw [0.896876s] ... ok
{3} tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port [4.261715s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_list_subnet_with_no_gw64_one_network [1.900373s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet [1.963046s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_gw_and_allocation_pools [1.462954s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility [0.307700s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.574143s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields [0.120521s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.108717s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields [0.105467s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_show_network [0.051567s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_show_network_fields [0.080086s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.055447s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields [0.056414s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_host_routes_and_dns_nameservers [2.119015s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet [2.528820s] ... ok
{3} tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet [3.561049s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp [2.375131s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_delete_network_with_subnet [1.845857s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_slaac [2.173887s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility [0.229958s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks [0.095540s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks_fields [0.059147s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets [0.063166s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets_fields [0.056410s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network [0.045631s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network_fields [0.046486s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet [0.050121s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet_fields [0.037504s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_stateful [1.236776s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_create_port_on_non_existent_network [0.302697s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_network [0.214510s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_stateless [1.614858s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_port [0.322341s] ... ok
{1} tempest.api.network.test_networks.NetworksIpV6TestJSON.test_update_subnet_gw_dns_host_routes_dhcp [2.539468s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_subnet [0.282048s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_network [0.029039s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_port [0.043658s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_subnet [0.259555s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_network [0.298878s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_port [0.085962s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_subnet [0.333476s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_without_gateway [2.058155s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_list_subnet_with_no_gw64_one_network [1.342775s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet [2.211736s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_delete_network_with_subnet [2.008678s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility [0.087190s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks [0.053119s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks_fields [0.053220s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets [0.054339s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets_fields [0.058864s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network [0.032898s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network_fields [0.031755s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet [0.029388s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet_fields [0.031388s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_update_subnet_gw_dns_host_routes_dhcp [2.032040s] ... ok

======
Totals
======
Ran: 82 tests in 53.0000 sec.
 - Passed: 82
 - Skipped: 0
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 114.0042 sec.

==============
Worker Balance
==============
 - Worker 0 (26 tests) => 0:00:36.467793
 - Worker 1 (21 tests) => 0:00:26.844053
 - Worker 2 (19 tests) => 0:00:26.720587
 - Worker 3 (16 tests) => 0:00:32.923103

{0} tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario [64.068929s] ... ok

======
Totals
======
Ran: 1 tests in 75.0000 sec.
 - Passed: 1
 - Skipped: 0
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 64.0689 sec.

==============
Worker Balance
==============
 - Worker 0 (1 tests) => 0:01:04.068929

Comment 6 errata-xmlrpc 2016-08-24 13:30:23 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2016-1770.html