Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1822733

Summary: Openstack undercloud upgrade fails if /var/log/ironic/ironic-dbsync.log is missing
Product: Red Hat OpenStack Reporter: Cody Swanson <cswanson>
Component: instack-undercloudAssignee: James Slagle <jslagle>
Status: CLOSED ERRATA QA Contact: Arik Chernetsky <achernet>
Severity: low Docs Contact:
Priority: low    
Version: 13.0 (Queens)CC: bfournie, dtantsur, emacchi, mburns, mgarciac, rpittau, sbaker
Target Milestone: ---Keywords: Triaged, ZStream
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: instack-undercloud-8.4.9-11.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-10-28 18:23:44 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Cody Swanson 2020-04-09 18:03:47 UTC
Description of problem: 

While performing openstack undercloud upgrade it failed while trying to chown a non-existent log file. The system previously had old logs cleaned up to save space. 

Version-Release number of selected component (if applicable):

(undercloud) [stack@undercloud-0 ~]$ rpm -qa|grep openstack
openstack-tripleo-common-8.7.1-15.el7ost.noarch
openstack-tripleo-ui-8.3.2-3.el7ost.noarch
openstack-tripleo-heat-templates-8.4.1-51.el7ost.noarch
openstack-nova-conductor-17.0.13-2.el7ost.noarch
openstack-swift-object-2.17.1-3.el7ost.noarch
openstack-mistral-executor-6.0.6-3.el7ost.noarch
openstack-heat-common-10.0.3-9.el7ost.noarch
openstack-ironic-conductor-10.1.10-1.el7ost.noarch
openstack-nova-api-17.0.13-2.el7ost.noarch
openstack-glance-16.0.1-10.el7ost.noarch
puppet-openstack_extras-12.4.1-0.20180831193234.7fed86a.el7ost.noarch
openstack-ironic-staging-drivers-0.9.1-2.el7ost.noarch
openstack-ironic-inspector-7.2.4-1.el7ost.noarch
openstack-zaqar-6.0.1-4.el7ost.noarch
openstack-nova-common-17.0.13-2.el7ost.noarch
openstack-neutron-ml2-12.1.1-6.el7ost.noarch
openstack-heat-api-cfn-10.0.3-9.el7ost.noarch
openstack-swift-container-2.17.1-3.el7ost.noarch
openstack-mistral-engine-6.0.6-3.el7ost.noarch
openstack-tripleo-image-elements-8.0.3-1.el7ost.noarch
puppet-openstacklib-12.4.0-5.el7ost.noarch
python-openstackclient-lang-3.14.3-5.el7ost.noarch
openstack-tripleo-common-containers-8.7.1-15.el7ost.noarch
openstack-neutron-openvswitch-12.1.1-6.el7ost.noarch
openstack-nova-scheduler-17.0.13-2.el7ost.noarch
openstack-heat-engine-10.0.3-9.el7ost.noarch
openstack-keystone-13.0.4-1.el7ost.noarch
openstack-swift-proxy-2.17.1-3.el7ost.noarch
openstack-mistral-api-6.0.6-3.el7ost.noarch
python2-openstacksdk-0.11.4-1.el7ost.noarch
openstack-ironic-common-10.1.10-1.el7ost.noarch
openstack-neutron-12.1.1-6.el7ost.noarch
openstack-heat-api-10.0.3-9.el7ost.noarch
openstack-tripleo-validations-8.5.0-4.el7ost.noarch
openstack-selinux-0.8.18-1.el7ost.noarch
openstack-nova-compute-17.0.13-2.el7ost.noarch
openstack-tempest-18.0.0-13.el7ost.noarch
openstack-swift-account-2.17.1-3.el7ost.noarch
openstack-mistral-common-6.0.6-3.el7ost.noarch
python2-openstackclient-3.14.3-5.el7ost.noarch
openstack-neutron-common-12.1.1-6.el7ost.noarch
openstack-ironic-api-10.1.10-1.el7ost.noarch
openstack-nova-placement-api-17.0.13-2.el7ost.noarch
openstack-tripleo-puppet-elements-8.1.1-2.el7ost.noarch


How reproducible:

Every time. 

Steps to Reproduce:
1. Remove /var/log/ironic/ironic-dbsync.log
2. Perform openstack undercloud upgrade following Red Hat documentation.

Actual results:

2020-04-09 13:43:31,359 INFO: Complete!
2020-04-09 13:43:31,517 INFO: Update completed successfully
2020-04-09 13:43:33,217 INFO: Logging to /home/stack/.instack/install-undercloud.log
2020-04-09 13:43:33,309 INFO: Checking for a FQDN hostname...
2020-04-09 13:43:33,395 INFO: Static hostname detected as undercloud-0.redhat.local
2020-04-09 13:43:33,438 INFO: Transient hostname detected as undercloud-0.redhat.local
2020-04-09 13:43:33,664 ERROR: sudo failed: /usr/bin/chown: cannot access ‘/var/log/ironic/ironic-dbsync.log’: No such file or directory

2020-04-09 13:43:33,665 DEBUG: An exception occurred
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2450, in install
    '/var/log/ironic/ironic-dbsync.log'])
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 644, in _run_command
    env=env).decode('utf-8')
  File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['sudo', '/usr/bin/chown', 'ironic:ironic', '/var/log/ironic/ironic-dbsync.log']' returned non-zero exit status 1
2020-04-09 13:43:33,669 ERROR: 
#############################################################################
Undercloud upgrade failed.

Reason: Command '['sudo', '/usr/bin/chown', 'ironic:ironic', '/var/log/ironic/ironic-dbsync.log']' returned non-zero exit status 1

See the previous output for details about what went wrong.  The full install
log can be found at /home/stack/.instack/install-undercloud.log.

#############################################################################

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2450, in install
    '/var/log/ironic/ironic-dbsync.log'])
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 644, in _run_command
    env=env).decode('utf-8')
  File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
subprocess.CalledProcessError: Command '['sudo', '/usr/bin/chown', 'ironic:ironic', '/var/log/ironic/ironic-dbsync.log']' returned non-zero exit status 1
Command '['instack-upgrade-undercloud']' returned non-zero exit status 1

Expected results:

Successful undercloud upgrade.

Additional info:

Comment 2 Cody Swanson 2020-04-15 03:38:16 UTC
Just an update, I forgot to include the workaround which is quite simple.

touch /var/log/ironic/ironic-dbsync.log

then re-running the deploy works as expected.

Comment 14 errata-xmlrpc 2020-10-28 18:23:44 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 13.0 director bug fix advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4388