1341732 – Packstack fails under OSP 8 when network is nova flat dhcp

Bug 1341732 - Packstack fails under OSP 8 when network is nova flat dhcp

Summary: Packstack fails under OSP 8 when network is nova flat dhcp

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openstack-puppet-modules
Sub Component:
Version:	8.0 (Liberty)
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	---
Target Release:	8.0 (Liberty)
Assignee:	Emilien Macchi
QA Contact:	Arik Chernetsky
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2016-06-01 15:45 UTC by Arx Cruz
Modified:	2016-08-01 01:04 UTC (History)
CC List:	6 users (show)
Fixed In Version:	openstack-puppet-modules-7.1.1-1.el7ost
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2016-06-29 13:58:37 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)
Packstack nova debug (39.19 KB, text/plain) 2016-06-01 15:45 UTC, Arx Cruz	no flags	Details
Packstack answer file (38.90 KB, text/plain) 2016-06-01 15:46 UTC, Arx Cruz	no flags	Details
View All

Links
System	ID	Private	Priority	Status	Summary	Last Updated
OpenStack gerrit	325106	0	None	None	None	2016-06-03 08:00:06 UTC
Red Hat Product Errata	RHBA-2016:1354	0	normal	SHIPPED_LIVE	openstack-packstack bug fix advisory	2016-06-29 17:57:39 UTC

Description Arx Cruz 2016-06-01 15:45:23 UTC

Created attachment 1163737 [details]
Packstack nova debug

Description of problem:
Packstack fails to install with nova flat dhcp network

Version-Release number of selected component (if applicable):
openstack-packstack-7.0.0-0.14.dev1702.g490e674.el7ost.noarch
openstack-packstack-puppet-7.0.0-0.14.dev1702.g490e674.el7ost.noarche 

How reproducible:
Always

Steps to Reproduce:
1. Setup packstack to use nova network
2. Run packstack

Actual results:
Packstack fails in nova puppet run

Expected results:
Packstack install everything properly without errors

Additional info:
Attached the packstack answer file and the logs from puppet nova steps

Comment 1 Arx Cruz 2016-06-01 15:46:01 UTC

Created attachment 1163738 [details]
Packstack answer file

Comment 2 Arx Cruz 2016-06-01 16:08:58 UTC

Nova api log:

2016-06-01 11:19:41.135 2959 INFO nova.api.openstack.wsgi [req-6975d8e2-7903-49e5-900b-6c35dfa61bc9 c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessagingTimeout'>
2016-06-01 11:19:41.136 2959 INFO nova.osapi_compute.wsgi.server [req-6975d8e2-7903-49e5-900b-6c35dfa61bc9 c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] 172.16.32.4 "POST /v2/53b51a04f9624f80842bbf2dd0e768a8/os-networks HTTP/1.1" status: 500 len: 447 time: 60.1982138
2016-06-01 12:05:08.745 2962 INFO nova.osapi_compute.wsgi.server [req-1d31c935-54a4-4129-9f01-393047ccc1e8 c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] 172.16.32.4 "GET /v2/53b51a04f9624f80842bbf2dd0e768a8 HTTP/1.1" status: 404 len: 264 time: 0.6178360
2016-06-01 12:05:08.754 2962 INFO nova.osapi_compute.wsgi.server [req-2ee7cc94-d910-4bd9-8531-52a62b59cc2f c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] 172.16.32.4 "GET /v2/ HTTP/1.1" status: 200 len: 573 time: 0.0051780
2016-06-01 12:05:09.063 2962 INFO oslo_messaging._drivers.impl_qpid [req-e926ac42-3157-4dd3-a686-9df6a5fbda66 c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] Connected to AMQP server on 172.16.32.4:5672
2016-06-01 12:05:09.076 2962 INFO oslo_messaging._drivers.impl_qpid [req-e926ac42-3157-4dd3-a686-9df6a5fbda66 c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] Connected to AMQP server on 172.16.32.4:5672
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions [req-e926ac42-3157-4dd3-a686-9df6a5fbda66 c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] Unexpected exception in API method
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/networks.py", line 148, in create
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     network = self.network_api.create(context, **params)[0]
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/api.py", line 49, in wrapped
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     return func(self, context, *args, **kwargs)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/api.py", line 103, in create
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     return self.network_rpcapi.create_networks(context, **kwargs)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/rpcapi.py", line 132, in create_networks
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     return self.client.call(ctxt, 'create_networks', **kwargs)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 403, in call
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     return self.prepare().call(ctxt, method, **kwargs)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     retry=self.retry)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 90, in _send
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     timeout=timeout, retry=retry)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     retry=retry)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     result = self._waiter.wait(msg_id, timeout)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     message = self.waiters.get(msg_id, timeout=timeout)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions     'to message ID %s' % msg_id)
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions MessagingTimeout: Timed out waiting for a reply to message ID 2a1364967a154cbdbfaf367587f65014
2016-06-01 12:06:09.083 2962 ERROR nova.api.openstack.extensions 
2016-06-01 12:06:09.092 2962 INFO nova.api.openstack.wsgi [req-e926ac42-3157-4dd3-a686-9df6a5fbda66 c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessagingTimeout'>
2016-06-01 12:06:09.102 2962 INFO nova.osapi_compute.wsgi.server [req-e926ac42-3157-4dd3-a686-9df6a5fbda66 c091d5fd76cf4549bebe132c30e6e0f9 53b51a04f9624f80842bbf2dd0e768a8 - - -] 172.16.32.4 "POST /v2/53b51a04f9624f80842bbf2dd0e768a8/os-networks HTTP/1.1" status: 500 len: 447 time: 60.2062860
2016-06-01 12:06:28.545 2961 WARNING oslo_config.cfg [req-cf241c4c-0567-464e-9b2a-726b42328efd 32c6676af26b4945b83c98d63bebfef8 53b51a04f9624f80842bbf2dd0e768a8 - - -] Option "sql_connection" from group "DEFAULT" is deprecated. Use option "connection" from group "database".
2016-06-01 12:06:28.944 2961 INFO nova.osapi_compute.wsgi.server [req-cf241c4c-0567-464e-9b2a-726b42328efd 32c6676af26b4945b83c98d63bebfef8 53b51a04f9624f80842bbf2dd0e768a8 - - -] 172.16.32.4 "GET /v2/53b51a04f9624f80842bbf2dd0e768a8/servers/detail?all_tenants=True&host=permanent-acruz-rh-pud-pksk-controller HTTP/1.1" status: 200 len: 211 time: 1.0185940

Comment 3 Javier Peña 2016-06-03 08:00:06 UTC

After some local tests, the issue seems to be caused by the nova-network service not being up when Packstack tries to create the network (nova-api is up, though).

This is fixed by patch https://review.openstack.org/318195 to puppet-nova, and https://review.openstack.org/325106 is the backport to Liberty.

Comment 6 nlevinki 2016-06-28 07:21:31 UTC

automation passed
https://rhos-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/rhos-jenkins-rhos-8.0-puddle-rhel-7.2-multi-node-packstack-neutron-ml2-gre-rabbitmq-tempest-rpm-all/16/

Comment 8 errata-xmlrpc 2016-06-29 13:58:37 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1354

Note You need to log in before you can comment on or make changes to this bug.