Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

RDO tickets are now tracked in Jira https://issues.redhat.com/projects/RDO/issues/

Bug 1047156

Summary:

packstack fail to install openstack ice-house version

Product:

[Community] RDO

Reporter:

Nir Magnezi <nmagnezi>

Component:

openstack-nova

Assignee:

Pádraig Brady <pbrady>

Status:

CLOSED CURRENTRELEASE

QA Contact:

Ami Jeain <ajeain>

Severity:

urgent

Docs Contact:

Priority:

unspecified

Version:

unspecified

CC:

ajeain, aortega, derekh, fpercoco, hateya, mmagr, ndipanov, pbrady, p, rbryant, whayutin, yeylon

Target Milestone:

---

Target Release:

---

Hardware:

Unspecified

OS:

Linux

Whiteboard:

Fixed In Version:

openstack-nova-2014.1-0.5.b1

Doc Type:

Bug Fix

Doc Text:

Story Points:

---

Clone Of:

Environment:

Last Closed:

2014-01-07 02:57:39 UTC

Type:

Bug

Regression:

---

Mount Type:

---

Documentation:

---

CRM:

Verified Versions:

Category:

---

oVirt Team:

---

RHEL 7.3 requirements from Atomic Host:

Cloudforms Team:

---

Target Upstream Version:

Embargoed:

Attachments:

Description	Flags
The faulty nova.conf file	none
glance api.log file	none

Description Nir Magnezi 2013-12-29 15:13:57 UTC

Description of problem:
=======================
I tried to follow the quick-start instructions[1] in order to install openstack ice-house all-in-one.
In addition to those instructions I added an internal repository[2] for ice-house with higher priority.
That resulted a situation where I actually try to use RDO havana packstack in order to install RDO ice-house (since packstack is N/A in the ice-house repository at the moment).

This resulted the following error:

ERROR : Error appeared during Puppet run: <all-in-one-host>_api_nova.pp
Notice: /Stage[main]/Nova::Api/Exec[nova-db-sync]/returns: oslo.config.cfg.ConfigFileParseError: Failed to parse /etc/nova/nova.conf: at /etc/nova/nova.conf:3423, No ':' or '=' found in assignment: 'nil'
You will find full trace in log /var/tmp/packstack/20131225-141104-GGT2Vy/manifests/<all-in-one-host>_api_nova.pp.log
Please check log file /var/tmp/packstack/20131225-141104-GGT2Vy/openstack-setup.log for more information
 
Additional information:
<snipped>


I consulted with pbrady and we found some unneeded strings 'nil' in nova.conf[3]
I tried to overcome the errors by:

a. sed -i '/^nil$/d' /etc/nova/nova.conf
b. yum downgrade puppet[4]

Then, I ran packstack again and got a different error related to glance:

ERROR : Error appeared during Puppet run: <all-in-one-host>_provision.pp
Error: Could not prefetch glance_image provider 'glance': Execution of '/usr/bin/glance -T services -I glance -K 336f937626d84958 -N http://<all-in-one-host>:35357/v2.0/ index' returned 1: Error communicating with http://<all-in-one-host>:9292 [Errno 111] Connection refused

Additional information:
<snipped>

the meaning of this is: openstack-glance-api service is down[5], and cannot be started.


[1] http://openstack.redhat.com/Quickstart
[2] a non-public repository at the moment
[3] will attach nova.conf in Comment #1
[4] puppet version post downgrade: puppet-3.3.2-1.el6.noarch
[5] will attach glance api.log in Comment #2

Version-Release number of selected component (if applicable):
=============================================================
openstack-packstack-2013.2.1-0.25.dev936.el6.noarch

How reproducible:
=================
Always

Steps to Reproduce:
===================
Just follow the Description of problem. you'll need to follow RDO quick-start guide and add your own repositories.

Actual results:
===============
See 'Description of problem'

Expected results:
=================
packstack should be able to install openstack ice-house

Comment 1 Nir Magnezi 2013-12-29 15:15:23 UTC

Created attachment 843083 [details]
The faulty nova.conf file

Comment 2 Nir Magnezi 2013-12-29 15:15:55 UTC

Created attachment 843084 [details]
glance api.log file

Comment 4 Pádraig Brady 2014-01-02 10:17:23 UTC

Glance has some large changes with icehouse, including use of python-oslo-messaging which might be related. I see this error in glance.log:

2013-12-25 14:17:55.042 25202 ERROR glance.common.config [-] Unable to load glance-api-keystone from configuration file /usr/share/glance/glance-api-dist-paste.ini.
Got: ImportError('No module named notify',)

Comment 5 Pádraig Brady 2014-01-02 13:17:01 UTC

The issue was with the new python-oslo-messaging package:

# python -c 'from oslo import messaging'
Traceback (most recent call last):
  File "/usr/lib/...oslo/messaging/__init__.py", line 18, in <module>
    from .notify import *
ImportError: No module named notify

I've fixed this with an updated python-oslo-messaging-1.3.0 package in the test repo. Please update to that and try again.

thanks!

BTW we need a python-oslo-messaging RDO component.

Comment 6 Pádraig Brady 2014-01-02 18:26:28 UTC

BTW I've not looked into the nova.conf issue yet,
but this workaround should work:

  sed -i '/^nil$/d' /etc/nova/nova.conf
  packstack --answer-file ...to resume

Comment 7 wes hayutin 2014-01-03 13:42:34 UTC

Looks like the same issue occurs in the heat conf

14:21:37 ERROR : Error appeared during Puppet run: 192.168.129.8_heat.pp
14:21:37 Notice: /Stage[main]/Heat::Db/Exec[heat-dbsync]/returns: oslo.config.cfg.ConfigFileParseError: Failed to parse /etc/heat/heat.conf: at /etc/heat/heat.conf:866, No ':' or '=' found in assignment: 'nil'
14:21:37 You will find full trace in log /var/tmp/packstack/20140103-080205-RbevL6/manifests/192.168.129.8_heat.pp.log
14:21:37 Please check log file /var/tmp/packstack/20140103-080205-RbevL6/openstack-setup.log for more information

Comment 8 Martin Magr 2014-01-06 11:36:30 UTC

The flash thought of mine: it seems that 'nil' values are added by the latest Puppet (3.4 probably?). After downgrade it did not appear. If you will try to install Icehouse RDO on clean machine with downgraded Puppet as first step, will it pass? I'm asking because from following part of error message "[Errno 111] Connection refused" it seems that you ran "packstack --allinone" twice and hence the second time packstack used invalid password.

Comment 9 Martin Magr 2014-01-06 13:14:33 UTC

I just successfully installed on clean VM with Nir's repos and Puppet downgraded to 3.3.2, but looking at the openstack* installed packages, they are from Havana repo. Icehouse RDO repo [1] is currently empty (except repo packages). If this is intentional, then I'm doing something wrong.

[1] http://repos.fedorapeople.org/repos/openstack/openstack-icehouse/epel-6/

Comment 10 Martin Magr 2014-01-06 15:05:38 UTC

So after reproducing the issue I noticed that Icehouse nova-common package has [keystone_authtoken] section twice in it's default nova.conf. This probably makes Puppet remove those two section headers and paste "nil" instead.

Will check also Heat default config file if this is the similar case.

Comment 11 Martin Magr 2014-01-06 15:09:48 UTC

For heat-common package it's the same case. There is [keystone_authtoken] section duplication in heat.conf (line 813 and 1004).

Comment 12 Pádraig Brady 2014-01-07 01:55:32 UTC

I've rebuilt nova and heat with the default config adjusted as Martin suggests in comment 11. These are currently in place in the RDO icehouse repos

Comment 13 Pádraig Brady 2014-01-07 02:57:39 UTC

Passes CI without "nil" issue presenting itself.