Bug 1805857

Summary: healthcheck errors in compute logs
Product: Red Hat OpenStack Reporter: Joachim von Thadden <j.thadden>
Component: openstack-tripleoAssignee: Rajesh Tailor <ratailor>
Status: CLOSED DUPLICATE QA Contact: Arik Chernetsky <achernet>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 16.0 (Train)CC: aschultz, mburns, michele, mschuppe
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-03-16 05:29:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Joachim von Thadden 2020-02-21 16:16:45 UTC
Description of problem:
I am seeing frequent helth check errors like this one on the computes:

Feb 21 09:35:56 overcloud-novacompute-1 systemd[1]: Starting nova_compute healthcheck...
Feb 21 09:35:56 overcloud-novacompute-1 systemd[1]: Starting iscsid healthcheck...
Feb 21 09:35:56 overcloud-novacompute-1 systemd[1]: Starting ovn_metadata_agent healthcheck...
Feb 21 09:35:56 overcloud-novacompute-1 systemd[1]: Starting logrotate_crond healthcheck...
Feb 21 09:35:56 overcloud-novacompute-1 systemd[1]: Starting nova_virtlogd healthcheck...
Feb 21 09:35:56 overcloud-novacompute-1 systemd[1]: Starting nova_migration_target healthcheck...
Feb 21 09:35:56 overcloud-novacompute-1 podman[33438]: 2020-02-21 09:35:56.857338818 +0000 UTC m=+0.270606752 container exec 6967b99259468abdb6c6a5c86c4f0972cb7d182dfcc7945bd47d4adfb6bb3597 (image=undercloud.ctlplane.localdomain:8787/rhosp-rhel8/openstack-cron:16.0-82, name=logrotate_crond)
Feb 21 09:35:56 overcloud-novacompute-1 podman[33435]: 2020-02-21 09:35:56.908445445 +0000 UTC m=+0.255208021 container exec f3a3a9f7305c1666934930222b13b55a4edfd390a1c842764bf3cff00ac6bcbf (image=undercloud.ctlplane.localdomain:8787/rhosp-rhel8/openstack-nova-compute:16.0-80, name=nova_compute)
Feb 21 09:35:56 overcloud-novacompute-1 podman[33435]:       8 ?        00:00:10 nova-compute
Feb 21 09:35:56 overcloud-novacompute-1 systemd[1]: Started logrotate_crond healthcheck.
Feb 21 09:35:56 overcloud-novacompute-1 podman[33440]: 2020-02-21 09:35:56.960333774 +0000 UTC m=+0.269964585 container exec 7a4b94aeb8d94ea18f78c4a4e7ed03be2958218edbc23d0e06852a4289865ea9 (image=undercloud.ctlplane.localdomain:8787/rhosp-rhel8/openstack-nova-compute:16.0-80, name=nova_migration_target)
Feb 21 09:35:56 overcloud-novacompute-1 sudo[33617]:     nova : command not allowed ; TTY=unknown ; PWD=/ ; USER=nova ; COMMAND=/usr/sbin/ss -ntuap
Feb 21 09:35:56 overcloud-novacompute-1 podman[33435]: Sorry, user nova is not allowed to execute '/usr/sbin/ss -ntuap' as nova on overcloud-novacompute-1.
Feb 21 09:35:56 overcloud-novacompute-1 systemd[1]: Started nova_compute healthcheck.
Feb 21 09:35:56 overcloud-novacompute-1 podman[33437]: 2020-02-21 09:35:56.990545763 +0000 UTC m=+0.316051056 container exec fbf503d03ee3971eec44bef3f94d83c20ca750ce9e86c4fd988a5832cb944fe2 (image=undercloud.ctlplane.localdomain:8787/rhosp-rhel8/openstack-neutron-metadata-agent-ovn:16.0-78, name=ovn_metadata_agent)
Feb 21 09:35:57 overcloud-novacompute-1 podman[33439]: 2020-02-21 09:35:57.015981104 +0000 UTC m=+0.309442861 container exec 63eddef7bcdeafbded0a16395b103c95a89757ae58ab8482eb045bc31ba6a077 (image=undercloud.ctlplane.localdomain:8787/rhosp-rhel8/openstack-nova-libvirt:16.0-86, name=nova_virtlogd)
Feb 21 09:35:57 overcloud-novacompute-1 systemd[1]: Started nova_migration_target healthcheck.
Feb 21 09:35:57 overcloud-novacompute-1 podman[33436]: 2020-02-21 09:35:57.057047941 +0000 UTC m=+0.476796540 container exec 871703cd4628427f8e23a7416366f80f00a76ddd74e24f89565a108ad0f5fed2 (image=undercloud.ctlplane.localdomain:8787/rhosp-rhel8/openstack-iscsid:16.0-84, name=iscsid)
Feb 21 09:35:57 overcloud-novacompute-1 systemd[1]: Started iscsid healthcheck.
Feb 21 09:35:57 overcloud-novacompute-1 sudo[33666]:  neutron : command not allowed ; TTY=unknown ; PWD=/ ; USER=neutron ; COMMAND=/usr/sbin/ss -ntuap
Feb 21 09:35:57 overcloud-novacompute-1 podman[33437]: Sorry, user neutron is not allowed to execute '/usr/sbin/ss -ntuap' as neutron on overcloud-novacompute-1.
Feb 21 09:35:57 overcloud-novacompute-1 systemd[1]: Started ovn_metadata_agent healthcheck.
Feb 21 09:35:57 overcloud-novacompute-1 systemd[1]: Started nova_virtlogd healthcheck.


Version-Release number of selected component (if applicable):


How reproducible:
always

Steps to Reproduce:
1. deploy OSP16
2. journalctl -f
3.

Actual results:
above errors

Expected results:
no errors

Additional info:

Comment 2 Martin Schuppert 2020-03-05 09:49:13 UTC
This looks like a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=1778881, can we get details of the environment to check container/package versions.

Comment 3 Rajesh Tailor 2020-03-16 05:29:23 UTC

*** This bug has been marked as a duplicate of bug 1778881 ***

Comment 4 Joachim von Thadden 2020-03-23 08:46:28 UTC
Yes, the errata in bug #1778881 is sufficient, thanks.