Bug 1440908

Summary: Frequent failure at Subnet deletion with 3 controller
Product: Red Hat OpenStack Reporter: Ihar Hrachyshka <ihrachys>
Component: openstack-neutronAssignee: Assaf Muller <amuller>
Status: CLOSED ERRATA QA Contact: Alexander Stafeyev <astafeye>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 11.0 (Ocata)CC: afazekas, amuller, chrisw, ihrachys, nyechiel, oblaut, srevivo, tfreger
Target Milestone: ---Keywords: Triaged, ZStream
Target Release: 8.0 (Liberty)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-neutron-7.2.0-8.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1440897 Environment:
Last Closed: 2017-06-20 12:57:43 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1440897    
Bug Blocks: 1440901    

Description Ihar Hrachyshka 2017-04-10 17:54:15 UTC 
+++ This bug was initially created as a clone of Bug #1440897 +++

Description of problem:
4 thread tempest runs, frequently fail with subnet deletion.
 

The log contains:

2017-04-07 02:01:40,246 24529 WARNING  [urllib3.connectionpool] Retrying (Retry(total=9, connect=None, read=None, redirect=5)) after connection broken by 'ReadTimeoutError("HTTPConnectionPool(host='10.0.0.110', port=9696): Read timed out. (read timeout=60)",)': /v2.0/subnets/9197a378-4a60-4e60-a0e0-1df71e26a35e



Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/tempest/lib/services/network/subnets_client.py", line 52, in delete_subnet
    return self.delete_resource(uri)
  File "/usr/lib/python2.7/site-packages/tempest/lib/services/network/base.py", line 41, in delete_resource
    resp, body = self.delete(req_uri)
  File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 307, in delete
    return self.request('DELETE', url, extra_headers, headers, body)
  File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 665, in request
    self._error_checker(resp, resp_body)
  File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 762, in _error_checker
    raise exceptions.NotFound(resp_body, resp=resp)
tempest.lib.exceptions.NotFound: Object not found
Details: {u'message': u'Subnet 9197a378-4a60-4e60-a0e0-1df71e26a35e could not be found.', u'type': u'SubnetNotFound', u'detail': u''}
And at the cleanup phase you also see:


Version-Release number of selected component (if applicable):
python-neutron-lbaas-10.0.0-5.el7ost.noarch
python-neutronclient-6.1.0-1.el7ost.noarch
puppet-neutron-10.3.0-2.el7ost.noarch
openstack-neutron-common-10.0.0-13.el7ost.noarch
openstack-neutron-lbaas-10.0.0-5.el7ost.noarch
openstack-neutron-openvswitch-10.0.0-13.el7ost.noarch
python-neutron-10.0.0-13.el7ost.noarch
openstack-neutron-10.0.0-13.el7ost.noarch
openstack-neutron-metering-agent-10.0.0-13.el7ost.noarch
python-neutron-lib-1.1.0-1.el7ost.noarch
openstack-neutron-sriov-nic-agent-10.0.0-13.el7ost.noarch
openstack-neutron-ml2-10.0.0-13.el7ost.noarch


How reproducible:
25% chance with  ostestr -r PortsIpV6TestJSON

--- Additional comment from Ihar Hrachyshka on 2017-04-10 13:34:50 EDT ---

This is a known regression in Ocata and earlier tracked in upstream as: https://bugs.launchpad.net/neutron/+bug/1680912
Comment 1 Red Hat Bugzilla Rules Engine 2017-04-10 17:54:28 UTC 
This bugzilla has been removed from the release and needs to be reviewed and Triaged for another Target Release.
Comment 6 errata-xmlrpc 2017-06-20 12:57:43 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:1540