Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1642582

Summary: after hard reboot of UC iscsid container is restarting : "iscsid: Can not bind IPC socket"
Product: Red Hat OpenStack Reporter: Artem Hrechanychenko <ahrechan>
Component: rhosp-directorAssignee: Artem Hrechanychenko <ahrechan>
Status: CLOSED WORKSFORME QA Contact: Gurenko Alex <agurenko>
Severity: medium Docs Contact:
Priority: medium    
Version: 14.0 (Rocky)CC: ahrechan, aschultz, bshephar, dbecker, emacchi, jslagle, mburns, mcornea, morazi
Target Milestone: gaKeywords: Triaged
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-11-05 14:43:32 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Artem Hrechanychenko 2018-10-24 17:41:18 UTC
Description of problem:
after virsh destroy & virsh start undercloud-0 
0da85de5e6e4        192.168.24.1:8787/rhosp14/openstack-iscsid:2018-10-17.2                      "kolla_start"            2 hours ago         Restarting (1) 6 minutes ago                       iscsid

from docker logs

+ sudo -E kolla_set_configs
INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
INFO:__main__:Validating config file
INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
INFO:__main__:Copying service configuration files
INFO:__main__:Deleting /etc/iscsi/initiatorname.iscsi
INFO:__main__:Copying /var/lib/kolla/config_files/src-iscsid/initiatorname.iscsi to /etc/iscsi/initiatorname.iscsi
INFO:__main__:Deleting /etc/iscsi/iscsid.conf
INFO:__main__:Copying /var/lib/kolla/config_files/src-iscsid/iscsid.conf to /etc/iscsi/iscsid.conf
INFO:__main__:Writing out command to execute
++ cat /run_command
Running command: '/usr/sbin/iscsid -f'
+ CMD='/usr/sbin/iscsid -f'
+ ARGS=
+ [[ ! -n '' ]]
+ . kolla_extend_start
++ [[ ! -f /etc/iscsi/initiatorname.iscsi ]]
+ echo 'Running command: '\''/usr/sbin/iscsid -f'\'''
+ exec /usr/sbin/iscsid -f
iscsid: Can not bind IPC socket
+ sudo -E kolla_set_configs
INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
INFO:__main__:Validating config file
INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
INFO:__main__:Copying service configuration files
INFO:__main__:Deleting /etc/iscsi/initiatorname.iscsi
INFO:__main__:Copying /var/lib/kolla/config_files/src-iscsid/initiatorname.iscsi to /etc/iscsi/initiatorname.iscsi
INFO:__main__:Deleting /etc/iscsi/iscsid.conf
INFO:__main__:Copying /var/lib/kolla/config_files/src-iscsid/iscsid.conf to /etc/iscsi/iscsid.conf
INFO:__main__:Writing out command to execute
++ cat /run_command
+ CMD='/usr/sbin/iscsid -f'
+ ARGS=
+ [[ ! -n '' ]]
+ . kolla_extend_start
++ [[ ! -f /etc/iscsi/initiatorname.iscsi ]]
+ echo 'Running command: '\''/usr/sbin/iscsid -f'\'''
+ exec /usr/sbin/iscsid -f
Running command: '/usr/sbin/iscsid -f'
iscsid: Can not bind IPC socket

Version-Release number of selected component (if applicable):
osp14 puddle from 2018-10-17.2
openstack-selinux-0.8.15-0.20181003125347.4a047a0.el7ost.noarch
openstack-heat-api-11.0.1-0.20181010161427.46aacab.el7ost.noarch
openstack-tripleo-common-containers-9.4.1-0.20181012010862.67bab16.el7ost.noarch
puppet-openstacklib-13.3.1-0.20181013120423.cce1281.el7ost.noarch
python2-openstackclient-3.16.1-0.20180925042058.3e5a2d2.el7ost.noarch
python-openstackclient-lang-3.16.1-0.20180925042058.3e5a2d2.el7ost.noarch
openstack-tripleo-puppet-elements-9.0.0-0.20181007201103.daf9069.el7ost.noarch
openstack-tripleo-common-9.4.1-0.20181012010862.67bab16.el7ost.noarch
openstack-heat-agents-1.7.1-0.20180907213355.476aae2.el7ost.noarch
openstack-tripleo-heat-templates-9.0.1-0.20181013060859.ffbe879.el7ost.noarch
openstack-heat-monolith-11.0.1-0.20181010161427.46aacab.el7ost.noarch
puppet-openstack_extras-13.3.1-0.20181013123747.f810752.el7ost.noarch
openstack-tripleo-validations-9.3.1-0.20181008110747.4064fb7.el7ost.noarch
openstack-heat-engine-11.0.1-0.20181010161427.46aacab.el7ost.noarch
openstack-tripleo-image-elements-9.0.1-0.20181007200834.2dc678a.el7ost.noarch
python2-openstacksdk-0.17.2-0.20180809182656.3ad9dab.el7ost.noarch
openstack-heat-common-11.0.1-0.20181010161427.46aacab.el7ost.noarch
How reproducible:


Steps to Reproduce:
1.Deploy undercloud
2.Start overcloud deployment
3. simulate power outage and reboot oc nodes and undercloud in random order
4. wait for resume 
5. check docker containers status

Actual results:
iscsid contaienr is restarting

Expected results:
all container is ok

Additional info:

Comment 2 Marius Cornea 2018-10-24 23:41:28 UTC
I suspect this is caused by Infrared that installs the libguestfs-tools package which pulls iscsi-initiator-utils package as dependency which creates the iscsi systemd services.

You can disable the iscsi services causing the container not being able to start by:

systemctl stop iscsid.socket
systemctl disable iscsid.socket

Comment 3 James Slagle 2018-10-25 21:29:46 UTC
Artem, please confirm if comment 2 fixes the issue for you.

Comment 4 Artem Hrechanychenko 2018-11-05 14:43:32 UTC
After disabling iscsid.socket and reboot - fixed!

Comment 5 Brendan Shephard 2019-01-10 05:04:13 UTC
*** Bug 1664928 has been marked as a duplicate of this bug. ***