Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1651355

Summary:	[OSP9] HAproxy fails to start during undercloud installation because rabbitmq is already binding on port 5672
Product:	Red Hat OpenStack	Reporter:	Michele Baldessari <michele>
Component:	openstack-puppet-modules	Assignee:	Michele Baldessari <michele>
Status:	CLOSED EOL	QA Contact:	pkomarov
Severity:	high	Docs Contact:
Priority:	high
Version:	9.0 (Mitaka)	CC:	bperkins, dbecker, dpeacock, jjoyce, jschluet, mburns, mcornea, michele, mkrcmari, morazi, nlevinki, pkomarov, sathlang, slinaber, tvignaud, yprokule
Target Milestone:	---	Keywords:	Triaged, ZStream
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	openstack-puppet-modules-8.1.13-9.el7ost	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:	1651032
Clones:	1651357 (view as bug list)		Environment:
Last Closed:	2019-08-30 15:01:40 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1651032
Bug Blocks:	1651357

Comment 1 pkomarov 2018-11-21 11:18:16 UTC

fix check succesful:

[stack@undercloud-0 ~]$ systemctl status haproxy
● haproxy.service - HAProxy Load Balancer
   Loaded: loaded (/usr/lib/systemd/system/haproxy.service; enabled; vendor preset: disabled)
   Active: failed (Result: exit-code) since Wed 2018-11-21 02:21:07 EST; 1h 26min ago
 Main PID: 25699 (code=exited, status=1/FAILURE)

Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
[stack@undercloud-0 ~]$ rhos-release -L
Installed repositories (rhel-7.6):
  9-director
  9
  ceph-1.3
  ceph-osd-1.3
  rhel-7.6
[stack@undercloud-0 ~]$ rpm -qa|grep openstack-puppet-module
openstack-puppet-modules-8.1.13-8.el7ost.noarch
[stack@undercloud-0 ~]$ systemctl status haproxy
● haproxy.service - HAProxy Load Balancer
   Loaded: loaded (/usr/lib/systemd/system/haproxy.service; enabled; vendor preset: disabled)
   Active: failed (Result: exit-code) since Wed 2018-11-21 02:21:07 EST; 3h 32min ago
 Main PID: 25699 (code=exited, status=1/FAILURE)

Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
[stack@undercloud-0 ~]$ grep -A6 rabbitmq /etc/haproxy/haproxy.cfg
listen rabbitmq
  bind 192.168.24.3:5672 transparent
  option tcpka
  timeout client 0
  timeout server 0
  server 192.168.24.1 192.168.24.1:5672 check fall 5 inter 2000 rise 2

[stack@undercloud-0 ~]$  ss -lpn  | grep :5672
tcp    LISTEN     0      128      :::5672                 :::*
[stack@undercloud-0 ~]$ sudo ss -lpn  | grep 5672
tcp    LISTEN     0      128       *:25672                 *:*                   users:(("beam.smp",pid=24737,fd=43))
tcp    LISTEN     0      128    192.168.24.1:15672                 *:*                   users:(("beam.smp",pid=24737,fd=53))
tcp    LISTEN     0      128      :::5672                 :::*                   users:(("beam.smp",pid=24737,fd=52))
[stack@undercloud-0 ~]$ sudo -i
[root@undercloud-0 ~]#  ss -lpn  | grep :5672
tcp    LISTEN     0      128      :::5672                 :::*                   users:(("beam.smp",pid=24737,fd=52))
[root@undercloud-0 ~]#  ss -lpn  | grep 5672
tcp    LISTEN     0      128       *:25672                 *:*                   users:(("beam.smp",pid=24737,fd=43))
tcp    LISTEN     0      128    192.168.24.1:15672                 *:*                   users:(("beam.smp",pid=24737,fd=53))
tcp    LISTEN     0      128      :::5672                 :::*                   users:(("beam.smp",pid=24737,fd=52))
[root@undercloud-0 ~]# ps axu |grep 24737
root      6747  0.0  0.0 112708   980 pts/0    S+   05:55   0:00 grep --color=auto 24737
rabbitmq 24737  2.3  1.4 4720124 239652 ?      Ssl  02:20   5:03 /usr/lib64/erlang/erts-7.3.1.4/bin/beam.smp -W w -A 128 -P 1048576 -K true -- -root /usr/lib64/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rabbitmq_server-3.6.3/ebin -noshell -noinput -s rabbit boot -sname rabbit@undercloud-0 -boot start_sasl -config /etc/rabbitmq/rabbitmq -kernel inet_default_connect_options [{nodelay,true}] -sasl errlog_type error -sasl sasl_error_logger false -rabbit error_logger {file,"/var/log/rabbitmq/rabbit"} -rabbit sasl_error_logger {file,"/var/log/rabbitmq/rabbit"} -rabbit enabled_plugins_file "/etc/rabbitmq/enabled_plugins" -rabbit plugins_dir "/usr/lib/rabbitmq/lib/rabbitmq_server-3.6.3/plugins" -rabbit plugins_expand_dir "/var/lib/rabbitmq/mnesia/rabbit@undercloud-0-plugins-expand" -os_mon start_cpu_sup false -os_mon start_disksup false -os_mon start_memsup false -mnesia dir "/var/lib/rabbitmq/mnesia/rabbit@undercloud-0" -kernel inet_dist_listen_min 25672 -kernel inet_dist_listen_max 25672

#update to fix :
[root@undercloud-0 ~]# yum install -y http://download.eng.bos.redhat.com/brewroot/packages/openstack-puppet-modules/8.1.13/9.el7ost/noarch/openstack-puppet-modules-8.1.13-9.el7ost.noarch.rpm
Loaded plugins: search-disabled-repos
openstack-puppet-modules-8.1.13-9.el7ost.noarch.rpm                                                                                                                                           | 3.2 MB  00:00:03
Examining /var/tmp/yum-root-Fsirew/openstack-puppet-modules-8.1.13-9.el7ost.noarch.rpm: 1:openstack-puppet-modules-8.1.13-9.el7ost.noarch
Marking /var/tmp/yum-root-Fsirew/openstack-puppet-modules-8.1.13-9.el7ost.noarch.rpm as an update to 1:openstack-puppet-modules-8.1.13-8.el7ost.noarch
Resolving Dependencies
--> Running transaction check
---> Package openstack-puppet-modules.noarch 1:8.1.13-8.el7ost will be updated
---> Package openstack-puppet-modules.noarch 1:8.1.13-9.el7ost will be an update
--> Finished Dependency Resolution

Dependencies Resolved

=====================================================================================================================================================================================================================
 Package                                            Arch                             Version                                        Repository                                                                  Size
=====================================================================================================================================================================================================================
Updating:
 openstack-puppet-modules                           noarch                           1:8.1.13-9.el7ost                              /openstack-puppet-modules-8.1.13-9.el7ost.noarch                            14 M

Transaction Summary
=====================================================================================================================================================================================================================
Upgrade  1 Package

Total size: 14 M
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Updating   : 1:openstack-puppet-modules-8.1.13-9.el7ost.noarch                                                                                                                                                 1/2
  Cleanup    : 1:openstack-puppet-modules-8.1.13-8.el7ost.noarch                                                                                                                                                 2/2
  Verifying  : 1:openstack-puppet-modules-8.1.13-9.el7ost.noarch                                                                                                                                                 1/2
  Verifying  : 1:openstack-puppet-modules-8.1.13-8.el7ost.noarch                                                                                                                                                 2/2

Updated:
  openstack-puppet-modules.noarch 1:8.1.13-9.el7ost
[root@undercloud-0 ~]# rpm -qa |grep  openstack-puppet-modules
openstack-puppet-modules-8.1.13-9.el7ost.noarch

#reinstall undercloud :
openstack undercloud install

....

"Undercloud install complete."



[stack@undercloud-0 ~]$ systemctl status haproxy
● haproxy.service - HAProxy Load Balancer
   Loaded: loaded (/usr/lib/systemd/system/haproxy.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2018-11-21 06:05:14 EST; 3min 57s ago
 Main PID: 12513 (haproxy-systemd)
    Tasks: 3
   CGroup: /system.slice/haproxy.service
           ├─12513 /usr/sbin/haproxy-systemd-wrapper -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid
           ├─12515 /usr/sbin/haproxy -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -Ds
           └─12518 /usr/sbin/haproxy -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -Ds

[stack@undercloud-0 ~]$ sudo ss -lpn  | grep 5672
tcp    LISTEN     0      128    192.168.24.3:5672                  *:*                   users:(("haproxy",pid=12518,fd=26))
tcp    LISTEN     0      128    192.168.24.1:5672                  *:*                   users:(("beam.smp",pid=12102,fd=52))
tcp    LISTEN     0      128       *:25672                 *:*                   users:(("beam.smp",pid=12102,fd=43))
tcp    LISTEN     0      128    192.168.24.1:15672                 *:*                   users:(("beam.smp",pid=12102,fd=53))

Comment 2 Sofer Athlan-Guyot 2019-01-10 10:10:44 UTC

Hi,

tested that patch and the undercloud installed successfully.

Thanks,

Comment 6 Alex Schultz 2019-01-21 17:29:15 UTC

*** Bug 1667439 has been marked as a duplicate of this bug. ***

Comment 9 pkomarov 2019-02-14 09:41:07 UTC

Verified, 
see comment : https://bugzilla.redhat.com/show_bug.cgi?id=1651355#c1