Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1724674

Summary: [OSP14] sshd running inside nova_migration_target overrides /var/run/sshd.pid on host with pid 1
Product: Red Hat OpenStack Reporter: Martin Schuppert <mschuppe>
Component: openstack-tripleo-heat-templatesAssignee: Piotr Kopec <pkopec>
Status: CLOSED ERRATA QA Contact: James Parker <jparker>
Severity: high Docs Contact:
Priority: medium    
Version: 13.0 (Queens)CC: jhakimra, jparker, knoha, mbooth, mburns, mschuppe, pbabbar, pkopec, tkajinam, tvignaud
Target Milestone: z4Keywords: TestOnly, Triaged, ZStream
Target Release: 14.0 (Rocky)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-tripleo-heat-templates-9.3.1-0.20190513171753.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1714816 Environment:
Last Closed: 2019-11-06 16:47:53 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1714816    
Bug Blocks:    

Comment 1 Lon Hohberger 2019-09-04 10:43:41 UTC
According to our records, this should be resolved by openstack-tripleo-heat-templates-9.3.1-0.20190513171752.el7ost.  This build is available now.

Comment 2 Paras Babbar 2019-09-17 18:44:03 UTC
****Version Check *******************************
(undercloud) [stack@undercloud-0 ~]$ rpm -qa | grep openstack-tripleo-heat
openstack-tripleo-heat-templates-9.3.1-0.20190513171752.el7ost.noarch

*****Login to the compute host , restarted the sshd service, check the status of sshd and value of sshd pid *****

[root@compute-0 ~]# systemctl restart sshd
[root@compute-0 ~]# systemctl status sshd
● sshd.service - OpenSSH server daemon
   Loaded: loaded (/usr/lib/systemd/system/sshd.service; enabled; vendor preset: enabled)
   Active: active (running) since Tue 2019-09-17 18:28:16 UTC; 7s ago
     Docs: man:sshd(8)
           man:sshd_config(5)
 Main PID: 80211 (sshd)
    Tasks: 1
   Memory: 1.0M
   CGroup: /system.slice/sshd.service
           └─80211 /usr/sbin/sshd -D

Sep 17 18:28:16 compute-0 systemd[1]: Starting OpenSSH server daemon...
Sep 17 18:28:16 compute-0 sshd[80211]: Server listening on 0.0.0.0 port 22.
Sep 17 18:28:16 compute-0 sshd[80211]: Server listening on :: port 22.
Sep 17 18:28:16 compute-0 sshd[80211]: error: Couldn't create pid file "/var/run/sshd.pid": Permission denied ====> permission issue
Sep 17 18:28:16 compute-0 systemd[1]: Started OpenSSH server daemon.
[root@compute-0 ~]# cat /var/run/sshd.pid 
1   ===============> It still shows 1 as PID after restart
[root@compute-0 ~]#


checking the PID for the nova_migration_target 

[root@compute-0 ~]# docker ps
CONTAINER ID        IMAGE                                                                               COMMAND             CREATED             STATUS                         PORTS               NAMES
c4a3e9159705        192.168.24.1:8787/rhosp14/openstack-neutron-openvswitch-agent:2019-09-05.1-grades   "kolla_start"       About an hour ago   Up About an hour (healthy)                         neutron_ovs_agent
41d5b15e6ca3        192.168.24.1:8787/rhosp14/openstack-nova-compute:2019-09-05.1-grades                "kolla_start"       About an hour ago   Up About an hour (healthy)                         nova_compute
6999c866cf8c        192.168.24.1:8787/rhosp14/openstack-cron:2019-09-05.1-grades                        "kolla_start"       About an hour ago   Up About an hour                                   logrotate_crond
624fc6de14ca        192.168.24.1:8787/rhosp14/openstack-nova-compute:2019-09-05.1-grades                "kolla_start"       About an hour ago   Up 19 minutes (healthy)                            nova_migration_target
45b773d922ec        192.168.24.1:8787/rhosp14/openstack-ceilometer-compute:2019-09-05.1-grades          "kolla_start"       About an hour ago   Up About an hour (unhealthy)                       ceilometer_agent_compute
be993d4d12b2        192.168.24.1:8787/rhosp14/openstack-iscsid:2019-09-05.1-grades                      "kolla_start"       About an hour ago   Up About an hour (healthy)                         iscsid
9179422958f9        192.168.24.1:8787/rhosp14/openstack-nova-libvirt:2019-09-05.1-grades                "kolla_start"       About an hour ago   Up About an hour (healthy)                         nova_libvirt
c07bdec1b697        192.168.24.1:8787/rhosp14/openstack-nova-libvirt:2019-09-05.1-grades                "kolla_start"       About an hour ago   Up About an hour                                   nova_virtlogd
[root@compute-0 ~]# docker restart  nova_migration_target 
nova_migration_target
[root@compute-0 ~]# docker exec nova_migration_target cat /var/run/sshd.pid
1  =========> It shows 1 as the PID 
[root@compute-0 ~]# 

Note: It was showing me different PID initially after the deployment but once I restarted the container nova_migration_target and sshd service , it again shows 1 as PID and permission issue. Hence sending it back to assigned state from ON QA.

Comment 3 Martin Schuppert 2019-09-18 07:20:19 UTC
(In reply to Paras from comment #2)
> ****Version Check *******************************
> (undercloud) [stack@undercloud-0 ~]$ rpm -qa | grep openstack-tripleo-heat
> openstack-tripleo-heat-templates-9.3.1-0.20190513171752.el7ost.noarch
> 
> *****Login to the compute host , restarted the sshd service, check the
> status of sshd and value of sshd pid *****
> 
> [root@compute-0 ~]# systemctl restart sshd
> [root@compute-0 ~]# systemctl status sshd
> ● sshd.service - OpenSSH server daemon
>    Loaded: loaded (/usr/lib/systemd/system/sshd.service; enabled; vendor
> preset: enabled)
>    Active: active (running) since Tue 2019-09-17 18:28:16 UTC; 7s ago
>      Docs: man:sshd(8)
>            man:sshd_config(5)
>  Main PID: 80211 (sshd)
>     Tasks: 1
>    Memory: 1.0M
>    CGroup: /system.slice/sshd.service
>            └─80211 /usr/sbin/sshd -D
> 
> Sep 17 18:28:16 compute-0 systemd[1]: Starting OpenSSH server daemon...
> Sep 17 18:28:16 compute-0 sshd[80211]: Server listening on 0.0.0.0 port 22.
> Sep 17 18:28:16 compute-0 sshd[80211]: Server listening on :: port 22.
> Sep 17 18:28:16 compute-0 sshd[80211]: error: Couldn't create pid file
> "/var/run/sshd.pid": Permission denied ====> permission issue
> Sep 17 18:28:16 compute-0 systemd[1]: Started OpenSSH server daemon.
> [root@compute-0 ~]# cat /var/run/sshd.pid 
> 1   ===============> It still shows 1 as PID after restart
> [root@compute-0 ~]#
> 
> 
> checking the PID for the nova_migration_target 
> 
> [root@compute-0 ~]# docker ps
> CONTAINER ID        IMAGE                                                   
> COMMAND             CREATED             STATUS                         PORTS
> NAMES
> c4a3e9159705       
> 192.168.24.1:8787/rhosp14/openstack-neutron-openvswitch-agent:2019-09-05.1-
> grades   "kolla_start"       About an hour ago   Up About an hour (healthy) 
> neutron_ovs_agent
> 41d5b15e6ca3       
> 192.168.24.1:8787/rhosp14/openstack-nova-compute:2019-09-05.1-grades        
> "kolla_start"       About an hour ago   Up About an hour (healthy)          
> nova_compute
> 6999c866cf8c       
> 192.168.24.1:8787/rhosp14/openstack-cron:2019-09-05.1-grades                
> "kolla_start"       About an hour ago   Up About an hour                    
> logrotate_crond
> 624fc6de14ca       
> 192.168.24.1:8787/rhosp14/openstack-nova-compute:2019-09-05.1-grades        
> "kolla_start"       About an hour ago   Up 19 minutes (healthy)             
> nova_migration_target
> 45b773d922ec       
> 192.168.24.1:8787/rhosp14/openstack-ceilometer-compute:2019-09-05.1-grades  
> "kolla_start"       About an hour ago   Up About an hour (unhealthy)        
> ceilometer_agent_compute
> be993d4d12b2       
> 192.168.24.1:8787/rhosp14/openstack-iscsid:2019-09-05.1-grades              
> "kolla_start"       About an hour ago   Up About an hour (healthy)          
> iscsid
> 9179422958f9       
> 192.168.24.1:8787/rhosp14/openstack-nova-libvirt:2019-09-05.1-grades        
> "kolla_start"       About an hour ago   Up About an hour (healthy)          
> nova_libvirt
> c07bdec1b697       
> 192.168.24.1:8787/rhosp14/openstack-nova-libvirt:2019-09-05.1-grades        
> "kolla_start"       About an hour ago   Up About an hour                    
> nova_virtlogd
> [root@compute-0 ~]# docker restart  nova_migration_target 
> nova_migration_target
> [root@compute-0 ~]# docker exec nova_migration_target cat /var/run/sshd.pid
> 1  =========> It shows 1 as the PID 
> [root@compute-0 ~]# 
> 
> Note: It was showing me different PID initially after the deployment but
> once I restarted the container nova_migration_target and sshd service , it
> again shows 1 as PID and permission issue. Hence sending it back to assigned
> state from ON QA.

Same as with BZs 1729552 and 1714590 fix was added to openstack-tripleo-heat-templates-9.3.1-0.20190513171739.el7ost,
but got removed for an async release, so it is not in openstack-tripleo-heat-templates-9.3.1-0.20190513171752.el7ost .
The fix got restored with openstack-tripleo-heat-templates-9.3.1-0.20190513171753.el7ost. Updating the FIV information.

Comment 6 errata-xmlrpc 2019-11-06 16:47:53 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:3745