Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1349452

Summary: rhel-osp-director: 9.0 neutron-server failed to load after reboot of undercloud.
Product: Red Hat OpenStack Reporter: Mike Burns <mburns>
Component: openstack-neutronAssignee: Assaf Muller <amuller>
Status: CLOSED WORKSFORME QA Contact: Toni Freger <tfreger>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 9.0 (Mitaka)CC: amuller, athomas, chrisw, dbecker, jason.dobies, mburns, morazi, nyechiel, ohochman, rhel-osp-director-maint, sasha, srevivo, tvignaud
Target Milestone: ga   
Target Release: 9.0 (Mitaka)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1348700 Environment:
Last Closed: 2016-07-22 18:12:51 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Mike Burns 2016-06-23 13:19:35 UTC
+++ This bug was initially created as a clone of Bug #1348700 +++

rhel-osp-director: 9.0 rabbitmq and neutron-server failed to load after reboot of undercloud.

Environment:
instack-undercloud-4.0.0-4.el7ost.noarch
python-neutron-8.1.0-6.el7ost.noarch
python-neutron-lib-0.0.2-1.el7ost.noarch
openstack-neutron-8.1.0-6.el7ost.noarch
openstack-neutron-openvswitch-8.1.0-6.el7ost.noarch
python-neutronclient-4.1.1-2.el7ost.noarch
openstack-neutron-common-8.1.0-6.el7ost.noarch
openstack-neutron-ml2-8.1.0-6.el7ost.noarch
rabbitmq-server-3.6.2-3.el7ost.noarch


Steps to reproduce:
1. Deploy overcloud with:
openstack overcloud deploy --templates --control-scale 3 --compute-scale 1 --swift-storage-scale 0 --block-storage-scale 0 --neutron-tunnel-types vxlan,gre --neutron-network-type vxlan,gre --neutron-network-vlan-ranges datacentre:118:143 --neutron-bridge-mappings datacentre:br-ex --ntp-server clock.redhat.com --timeout 90 -e /usr/share/openstack-tripleo-heat-templates/environments/storage-environment.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml -e network-environment.yaml -e /home/stack/ssl-heat-templates/environments/enable-tls.yaml -e /home/stack/ssl-heat-templates/environments/inject-trust-anchor.yaml --ceph-storage-scale 1

2. Populate the overcloud
3. Reboot the undercloud
4. After reboot attempt to run "nova list" on the undercloud.


Result:

No handlers could be found for logger "keystoneauth.identity.generic.base"

[stack@instack ~]$ sudo systemctl|grep -i fail
● neutron-server.service  loaded failed     failed   OpenStack Neutron Server
● ovirt-guest-agent.service loaded failed     failed          oVirt Guest Agent
● postfix.service   loaded failed     failed          Postfix Mail Transport Agent
● rabbitmq-server.service   loaded failed     failed          RabbitMQ broker


Manually starting rabbitmq and neutron-server works.

Workaround:
systemctl start rabbitmq-server.service
systemctl start neutron-server.service
nova list

--- Additional comment from Alexander Chuzhoy on 2016-06-21 15:55 EDT ---



--- Additional comment from Alexander Chuzhoy on 2016-06-21 16:49:20 EDT ---

On another deployment/attempt, only the neutron-server was failed after rebooting the undercloud.
Manually started it.

--- Additional comment from Mike Burns on 2016-06-23 09:18:45 EDT ---

Splitting this into separate bugs for neutron and rabbit

Comment 1 Mike Burns 2016-06-23 13:21:47 UTC
Can you please provide the neutron server logs?

Comment 2 Assaf Muller 2016-06-30 14:33:20 UTC
Hey Sasha, can we get either full logs or a reproduction and access to your environment?

Comment 3 Alexander Chuzhoy 2016-07-22 17:51:18 UTC
Tried to reproduce, rebooted the same setup twice - worked fine.