Bug 1365225

Summary:	Keystone eventlet processes still running after OSP 8 -> OSP 9 upgrade
Product:	Red Hat OpenStack	Reporter:	Rodrigo Duarte <rduartes>
Component:	rhosp-director	Assignee:	Angus Thomas <athomas>
Status:	CLOSED NOTABUG	QA Contact:	Omri Hochman <ohochman>
Severity:	unspecified	Docs Contact:
Priority:	unspecified
Version:	9.0 (Mitaka)	CC:	dbecker, mburns, mcornea, morazi, rhel-osp-director-maint
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2016-08-08 17:39:52 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Rodrigo Duarte 2016-08-08 16:36:05 UTC

In OSP 9 keystone is no longer running in as a standalone Eventlet server as in OSP 8, it runs in httpd instead. 

After finalizing the OSP 8 -> OSP 9 upgrade following the steps at [1], keystone is up and running in httpd, but the old standalone (Eventlet) processes are still running.

[1] http://etherpad.corp.redhat.com/ospd9-upgrade

httpd is listening in ports 5000 and 35357 (keystone's public and admin ports):

[root@controller-0 ~]# lsof -i :5000 | grep LISTEN
haproxy  1036 haproxy   27u  IPv4 6766285      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
haproxy  1036 haproxy   28u  IPv4 6766286      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12168    root    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12183  apache    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12184  apache    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12185  apache    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12186  apache    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12187  apache    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12188  apache    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12189  apache    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
httpd   12190  apache    3u  IPv4 6802866      0t0  TCP controller-0.localdomain:commplex-main (LISTEN)
[root@controller-0 ~]# lsof -i :35357 | grep LISTEN
haproxy  1036 haproxy   25u  IPv4 6766283      0t0  TCP controller-0.localdomain:openstack-id (LISTEN)
haproxy  1036 haproxy   26u  IPv4 6766284      0t0  TCP controller-0.localdomain:openstack-id (LISTEN)
httpd   12168    root    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)
httpd   12183  apache    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)
httpd   12184  apache    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)
httpd   12185  apache    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)
httpd   12186  apache    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)
httpd   12187  apache    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)
httpd   12188  apache    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)
httpd   12189  apache    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)
httpd   12190  apache    7u  IPv4 6802874      0t0  TCP controller-0-management:openstack-id (LISTEN)

Keystone eventlet is still running:

[root@controller-0 ~]# ps aux | grep keystone
root      5341  0.0  0.0 112648   976 pts/0    S+   12:03   0:00 grep --color=auto keystone
keystone 12175  0.1  1.1 603520 95532 ?        Sl   01:51   1:04 keystone-admin  -DFOREGROUND
keystone 12176  0.1  1.1 603520 95456 ?        Sl   01:51   1:04 keystone-admin  -DFOREGROUND
keystone 12177  0.1  1.1 603520 95620 ?        Sl   01:51   1:03 keystone-admin  -DFOREGROUND
keystone 12178  0.1  1.1 603520 95476 ?        Sl   01:51   1:02 keystone-admin  -DFOREGROUND
keystone 12179  0.1  1.1 603520 93596 ?        Sl   01:51   0:40 keystone-main   -DFOREGROUND
keystone 12180  0.1  1.1 603520 93980 ?        Sl   01:51   0:42 keystone-main   -DFOREGROUND
keystone 12181  0.1  1.1 603520 93860 ?        Sl   01:51   0:38 keystone-main   -DFOREGROUND
keystone 12182  0.1  1.1 603520 93988 ?        Sl   01:51   0:41 keystone-main   -DFOREGROUND

tripleo-heat-templates version: openstack-tripleo-heat-templates-2.0.0-30.el7

Addition info can be found at bug 1354046.