Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1733527

Summary:	Openstack doesn't work due to a haproxy problem(huge number of http procesees)
Product:	Red Hat OpenStack	Reporter:	Candido Campos <ccamposr>
Component:	openstack-tripleo-heat-templates	Assignee:	RHOS Maint <rhos-maint>
Status:	CLOSED NOTABUG	QA Contact:	Sasha Smolyak <ssmolyak>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	10.0 (Newton)	CC:	apevec, aschultz, bperkins, ekuris, lhh, mburns, mmagr
Target Milestone:	---	Keywords:	ZStream
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-10-03 10:15:00 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1723116

Description Candido Campos 2019-07-26 11:47:08 UTC

Description of problem:



Description of problem:
Deployed brand new overcloud in running job over night to discover a gateway timeout on the overcloud in the morning requiring a restart of httpd on all controllers to get a working overcloud again.  If I deploy a new overcloud and I am available to begin testing it I typically do not see this issue.

If a cloud is unused for several hours it will reappear.  Clouds under load (some sort of browbeat config running against them do not exhibit this issue)

[stack@undercloud ~]$ . overcloudrc
[stack@undercloud ~]$ openstack endpoint list
Discovering versions from the identity service failed when creating the password plugin. Attempting to determine version from URL.
Gateway Timeout (HTTP 504)

...
[root@overcloud-controller-0 log]# systemctl restart httpd
...
[root@overcloud-controller-1 log]# systemctl restart httpd
...
[root@overcloud-controller-2 log]# systemctl restart httpd
...


Version-Release number of selected component (if applicable):

[stack@undercloud-0 ~]$ cat core_puddle_version 
2019-07-22.7[stack@undercloud-0 ~]$ cat /etc/rhosp-release 
Red Hat OpenStack Platform release 10.0.12 (Newton)
[stack@undercloud-0 ~]$ 



How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:

http processes number is increased with every keystone petition

Expected results:

No increase the number of httpd processes

Additional info:

issue very similar to:

https://bugzilla.redhat.com/show_bug.cgi?id=1372751
https://bugzilla.redhat.com/show_bug.cgi?id=1371657
https://bugzilla.redhat.com/show_bug.cgi?id=1372821


[root@controller-0 heat-admin]# ps -ef | grep httpd  | wc -l
265

Comment 1 Alex Schultz 2019-07-26 17:01:19 UTC

Please provide logs and additional details around which processes are excessive in number and what you're actually configuring. The title indicates haproxy, but you mention restarting apache.  Additionally previous bugs indicate issues with telemetry services, are you configuring those?

Comment 2 Candido Campos 2019-07-26 20:43:27 UTC

the httpd processes as in the old bugzillas:

[root@controller-0 heat-admin]# ps -ef | grep httpd 
apache      2254  125101  0 02:22 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache      3514  125101  0 06:36 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     11231  125101  0 02:24 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     12572  125101  0 06:38 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     20118  125101  0 02:27 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     21571  125101  0 06:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     29006  125101  0 02:29 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     30648  125101  0 06:42 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     38322  125101  0 02:31 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     39808  125101  0 06:45 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     47328  125101  0 02:33 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     48719  125101  0 06:47 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     56398  125101  0 02:35 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     57654  125101  0 06:49 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     65491  125101  0 02:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     66719  125101  0 06:51 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     71811  125101  0 06:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     74468  125101  0 02:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     83410  125101  0 02:42 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     84702  125101  0 06:55 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     92551  125101  0 02:44 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     93756  125101  0 06:58 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    101571  125101  0 02:46 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    102755  125101  0 07:00 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    110451  125101  0 02:48 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    111687  125101  0 07:02 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    119350  125101  0 02:50 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    120636  125101  0 07:04 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
root      125101       1  0 Jul25 ?        00:00:14 /usr/sbin/httpd -DFOREGROUND
aodh      125103  125101  0 Jul25 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
ceilome+  125104  125101  0 Jul25 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
gnocchi   125105  125101  0 Jul25 ?        00:00:05 /usr/sbin/httpd -DFOREGROUND
gnocchi   125106  125101  0 Jul25 ?        00:00:05 /usr/sbin/httpd -DFOREGROUND
apache    125107  125101  0 Jul25 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
apache    125108  125101  0 Jul25 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
apache    125109  125101  0 Jul25 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
apache    125126  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    125127  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    125128  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    125129  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    125130  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    125131  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    125132  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    125133  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    127321  125101  0 02:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    129754  125101  0 07:06 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    137445  125101  0 02:55 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    138773  125101  0 07:08 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    146463  125101  0 02:57 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    147744  125101  0 07:11 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    155391  125101  0 02:59 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    156744  125101  0 07:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    164391  125101  0 03:01 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    165709  125101  0 07:15 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    173352  125101  0 03:03 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    174595  125101  0 07:17 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    182241  125101  0 03:06 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    183512  125101  0 07:19 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    191157  125101  0 03:08 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    192460  125101  0 07:21 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    200110  125101  0 03:10 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    201422  125101  0 07:24 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    209082  125101  0 03:12 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    210041  125101  0 03:12 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    210402  125101  0 07:26 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    219261  125101  0 07:28 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    227107  125101  0 03:16 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    228204  125101  0 07:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    236096  125101  0 03:19 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    237282  125101  0 07:32 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    245175  125101  0 03:21 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    246229  125101  0 07:34 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    251105  125101  0 03:22 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    255338  125101  0 07:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    263265  125101  0 03:25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    264307  125101  0 07:39 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    272129  125101  0 03:27 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    273214  125101  0 07:41 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    281037  125101  0 03:29 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    282211  125101  0 07:43 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    289987  125101  0 03:32 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    291265  125101  0 07:45 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    298987  125101  0 03:34 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    300223  125101  0 07:47 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    307923  125101  0 03:36 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    309167  125101  0 07:50 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    315568  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    316885  125101  0 03:38 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    318140  125101  0 07:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    324515  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    325827  125101  0 03:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    327081  125101  0 07:54 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    333392  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    334725  125101  0 03:42 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    335874  125101  0 07:56 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    342321  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    343647  125101  0 03:45 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    344814  125101  0 07:58 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    351272  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    352592  125101  0 03:47 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    353774  125101  0 08:00 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    360254  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    361525  125101  0 03:49 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    362785  125101  0 08:03 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    369200  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    370487  125101  0 03:51 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    371756  125101  0 08:05 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    375270  125101  0 03:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    378153  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    380701  125101  0 08:07 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    387111  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    388692  125101  0 03:55 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    389642  125101  0 08:09 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    391123  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    397684  125101  0 03:58 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    398523  125101  0 08:11 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    404933  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    406635  125101  0 04:00 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    407501  125101  0 08:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    413838  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    415609  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    415621  125101  0 04:02 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    416542  125101  0 08:16 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    422814  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    424570  125101  0 04:04 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    425658  125101  0 08:18 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    431777  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    433509  125101  0 04:06 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    436734  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    442447  125101  0 04:08 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    449748  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    451396  125101  0 04:11 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    458811  125101  0 Jul25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    460379  125101  0 04:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    467890  125101  0 00:01 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    469350  125101  0 04:15 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    471440  125101  0 00:02 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    478266  125101  0 04:17 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    485749  125101  0 00:06 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    487217  125101  0 04:19 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    494772  125101  0 00:08 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    496109  125101  0 04:21 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    503739  125101  0 00:10 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    505073  125101  0 04:24 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    512696  125101  0 00:12 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    513934  125101  0 04:26 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    515059  125101  0 00:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    522866  125101  0 04:28 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    530625  125101  0 00:17 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    531827  125101  0 04:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    539581  125101  0 00:19 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    541059  125101  0 04:32 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    548437  125101  0 00:21 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    550104  125101  0 04:34 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    557409  125101  0 00:23 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    559004  125101  0 04:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    566232  125101  0 00:25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    568053  125101  0 04:39 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    575168  125101  0 00:27 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    577019  125101  0 04:41 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    584150  125101  0 00:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    584560  125101  0 00:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    585964  125101  0 04:43 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    594931  125101  0 04:45 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    602118  125101  0 00:34 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    603883  125101  0 04:47 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    611067  125101  0 00:36 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    612831  125101  0 04:50 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    620008  125101  0 00:38 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    621758  125101  0 04:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    628941  125101  0 00:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    630691  125101  0 04:54 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    637996  125101  0 00:43 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    639599  125101  0 04:56 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    646934  125101  0 00:45 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    648472  125101  0 04:58 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    655992  125101  0 00:47 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    657388  125101  0 05:00 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    665105  125101  0 00:49 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    666409  125101  0 05:03 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    674085  125101  0 00:51 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    675473  125101  0 05:05 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    678071  125101  0 00:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    684499  125101  0 05:07 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    692092  125101  0 00:56 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    693555  125101  0 05:09 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    700961  125101  0 00:58 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    702601  125101  0 05:11 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    709830  125101  0 01:00 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    711601  125101  0 05:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    718802  125101  0 01:02 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    720502  125101  0 05:16 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    727733  125101  0 01:04 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    729444  125101  0 05:18 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    736657  125101  0 01:06 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    738404  125101  0 05:20 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    745596  125101  0 01:09 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    747360  125101  0 05:22 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    747475  125101  0 05:22 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    754590  125101  0 01:11 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    763665  125101  0 01:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    765221  125101  0 05:26 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    772674  125101  0 01:15 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    774052  125101  0 05:29 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    781687  125101  0 01:17 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    782989  125101  0 05:31 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    790567  125101  0 01:19 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    791957  125101  0 05:33 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    799555  125101  0 01:22 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    800887  125101  0 05:35 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    808674  125101  0 01:24 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    809830  125101  0 05:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    817531  125101  0 01:26 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    818779  125101  0 05:39 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    826463  125101  0 01:28 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    827722  125101  0 05:42 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    835404  125101  0 01:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    836685  125101  0 05:44 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    837402  125101  0 05:44 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    844368  125101  0 01:32 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    853330  125101  0 01:35 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    854535  125101  0 05:48 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    862238  125101  0 01:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    863596  125101  0 05:50 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    871170  125101  0 01:39 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    872541  125101  0 05:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    880094  125101  0 01:41 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    881521  125101  0 05:55 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    885177  125101  0 01:42 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    890458  125101  0 05:57 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    898008  125101  0 01:45 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    899498  125101  0 05:59 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    906944  125101  0 01:48 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    908590  125101  0 06:01 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    915920  125101  0 01:50 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    917579  125101  0 06:03 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    924872  125101  0 01:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
root      926364  443934  0 10:19 pts/0    00:00:00 grep --color=auto httpd
apache    926511  125101  0 06:06 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    933891  125101  0 01:54 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    935482  125101  0 06:08 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    942838  125101  0 01:56 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    944379  125101  0 06:10 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    951640  125101  0 01:58 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    953326  125101  0 06:12 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    960776  125101  0 02:01 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    962321  125101  0 06:14 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    969793  125101  0 02:03 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    971251  125101  0 06:16 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    978761  125101  0 02:05 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    980214  125101  0 06:19 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    987820  125101  0 02:07 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    989187  125101  0 06:21 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    995839  125101  0 06:22 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    996818  125101  0 02:09 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1005704  125101  0 02:11 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1007031  125101  0 06:25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1009389  125101  0 02:12 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1015946  125101  0 06:27 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1023608  125101  0 02:16 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1024784  125101  0 06:29 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1032572  125101  0 02:18 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1033759  125101  0 06:32 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1041514  125101  0 02:20 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1042758  125101  0 06:34 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
[root@controller-0 heat-admin]# ps -ef | grep httpd  | wc -l
265

and with the time some limit is reached and the petitions are not processed. After today restart the number is inrcreasing again:

[root@controller-1 heat-admin]# ps -ef | grep httpd 
apache      4724  212970  0 19:17 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     13727  212970  0 19:19 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     22683  212970  0 19:21 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     31620  212970  0 19:23 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     34083  212970  0 19:24 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     49464  212970  0 19:28 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     58307  212970  0 19:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     58869  212970  0 19:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     71099  212970  0 19:33 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     83817  212970  0 19:36 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache     87977  212970  0 19:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    100416  212970  0 19:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    108892  212970  0 19:42 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    112424  212970  0 15:29 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    117126  212970  0 19:44 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    121312  212970  0 15:31 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    127781  212970  0 15:33 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    130051  212970  0 19:47 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    135029  212970  0 19:48 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    139348  212970  0 15:36 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    147986  212970  0 19:51 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    148207  212970  0 15:38 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    151924  212970  0 19:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    157170  212970  0 15:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    160539  212970  0 19:54 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    166102  212970  0 15:42 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    174823  212970  0 19:58 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    175088  212970  0 15:44 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    183701  212970  0 20:00 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    184031  212970  0 15:47 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    192741  212970  0 20:02 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    193014  212970  0 15:49 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    201709  212970  0 20:04 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    201949  212970  0 15:51 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    207834  212970  0 15:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    210669  212970  0 20:07 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
root      212970       1  0 11:40 ?        00:00:08 /usr/sbin/httpd -DFOREGROUND
aodh      212972  212970  0 11:40 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
ceilome+  212973  212970  0 11:40 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
gnocchi   212974  212970  0 11:40 ?        00:00:03 /usr/sbin/httpd -DFOREGROUND
gnocchi   212975  212970  0 11:40 ?        00:00:03 /usr/sbin/httpd -DFOREGROUND
apache    212976  212970  0 11:40 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
apache    212977  212970  0 11:40 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
apache    212978  212970  0 11:40 ?        00:00:01 /usr/sbin/httpd -DFOREGROUND
apache    212995  212970  0 11:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    212996  212970  0 11:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    212997  212970  0 11:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    212998  212970  0 11:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    212999  212970  0 11:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    213000  212970  0 11:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    213001  212970  0 11:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    213002  212970  0 11:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    219762  212970  0 20:09 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    219953  212970  0 15:55 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    228726  212970  0 20:11 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    228932  212970  0 15:57 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    237698  212970  0 20:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    237822  212970  0 16:00 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    246651  212970  0 20:15 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    246806  212970  0 16:02 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    255555  212970  0 20:17 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    255805  212970  0 16:04 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    262924  212970  0 11:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    264528  212970  0 20:20 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    264887  212970  0 16:06 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    265824  212970  0 20:20 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    273850  212970  0 16:08 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    282358  212970  0 20:24 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    282659  212970  0 20:24 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    282805  212970  0 16:10 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    291725  212970  0 16:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    300157  212970  0 20:28 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    300691  212970  0 16:15 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    308917  212970  0 20:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    309687  212970  0 16:17 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    316553  212970  0 20:32 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    318773  212970  0 16:19 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    326797  212970  0 20:35 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    327733  212970  0 16:21 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    335772  212970  0 20:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    336745  212970  0 16:23 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    344712  212970  0 20:39 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    345468  212970  0 20:39 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    345826  212970  0 16:26 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
root      345875  750612  0 20:39 pts/1    00:00:00 grep --color=auto httpd
apache    354804  212970  0 16:28 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    363750  212970  0 16:30 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    372569  212970  0 16:32 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    375763  212970  0 16:33 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    384656  212970  0 16:35 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    391997  212970  0 16:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    402621  212970  0 16:39 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    408783  212970  0 16:41 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    426617  212970  0 16:45 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    435575  212970  0 16:47 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    444453  212970  0 16:49 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    453232  212970  0 16:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    455957  212970  0 16:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    471171  212970  0 16:56 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    473385  212970  0 16:56 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    489040  212970  0 17:00 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    498049  212970  0 17:02 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    507029  212970  0 17:05 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    515904  212970  0 17:07 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    524668  212970  0 17:09 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    533635  212970  0 17:11 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    542321  212970  0 17:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    551571  212970  0 17:15 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    560546  212970  0 17:18 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    569535  212970  0 17:20 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    578381  212970  0 17:22 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    587435  212970  0 17:24 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    596485  212970  0 17:26 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    598884  212970  0 17:27 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    614159  212970  0 17:31 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    623126  212970  0 17:33 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    632089  212970  0 17:35 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    641069  212970  0 17:37 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    649712  212970  0 17:39 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    659062  212970  0 17:41 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    668056  212970  0 17:44 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    677031  212970  0 17:46 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    685927  212970  0 17:48 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    694905  212970  0 17:50 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    703847  212970  0 17:52 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    712884  212970  0 17:54 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    721778  212970  0 17:57 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    729266  212970  0 17:58 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    739682  212970  0 18:01 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    748631  212970  0 18:03 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    757583  212970  0 18:05 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    763226  212970  0 18:07 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    775450  212970  0 18:10 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    784435  212970  0 18:12 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    788054  212970  0 18:13 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    802274  212970  0 18:16 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    811229  212970  0 18:18 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    820169  212970  0 18:20 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    827794  212970  0 18:22 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    838000  212970  0 18:25 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    846972  212970  0 18:27 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    855917  212970  0 18:29 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    864920  212970  0 18:31 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    873937  212970  0 18:33 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    882777  212970  0 18:36 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    884491  212970  0 18:36 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    900691  212970  0 18:40 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    905642  212970  0 18:41 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    918609  212970  0 18:44 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    927570  212970  0 18:46 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    936522  212970  0 18:49 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    945438  212970  0 18:51 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    947461  212970  0 18:51 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    963290  212970  0 18:55 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    964323  212970  0 18:55 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    981189  212970  0 18:59 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    989239  212970  0 19:01 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache    995390  212970  0 19:03 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1008155  212970  0 19:06 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1017045  212970  0 19:08 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1026017  212970  0 19:10 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1034966  212970  0 19:12 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
apache   1039922  212970  0 19:14 ?        00:00:00 /usr/sbin/httpd -DFOREGROUND
[root@controller-1 heat-admin]#

Comment 3 Alex Schultz 2019-07-26 21:08:56 UTC

Please provide the templates/services that you have configured.  Http process may increase based on the configuration, but we need to know what you're deploying.

Comment 5 Alex Schultz 2019-07-26 22:56:31 UTC

Looks like gnocchi is not properly configured or is in a bad state which may be leading to the httpd issues.

[root@controller-1 gnocchi]# tail *.log
==> app.log <==
2019-07-26 22:49:56.149 212974 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:50:06.220 212975 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:50:56.210 212974 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:51:06.282 212975 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:51:56.272 212974 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:52:06.344 212975 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:52:56.333 212974 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:06.406 212975 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:56.393 212974 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:54:06.469 212975 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)

==> metricd.log <==
2019-07-26 22:52:53.232 119934 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:52:53.256 119932 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:52:53.313 119926 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:53.113 119938 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:53.238 119925 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:53.273 119928 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:53.280 119940 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:53.293 119934 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:53.318 119932 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:53.374 119926 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)

==> statsd.log <==
2019-07-26 22:44:52.426 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:45:52.482 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:46:52.542 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:47:52.603 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:48:52.665 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:49:52.727 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:50:52.789 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:51:52.851 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:52:52.913 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)
2019-07-26 22:53:52.973 119755 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)