Bug 1822733 - Openstack undercloud upgrade fails if /var/log/ironic/ironic-dbsync.log is missing
Summary: Openstack undercloud upgrade fails if /var/log/ironic/ironic-dbsync.log is mi...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: instack-undercloud
Version: 13.0 (Queens)
Hardware: All
OS: Linux
low
low
Target Milestone: ---
: ---
Assignee: James Slagle
QA Contact: Arik Chernetsky
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-04-09 18:03 UTC by Cody Swanson
Modified: 2020-10-28 18:24 UTC (History)
7 users (show)

Fixed In Version: instack-undercloud-8.4.9-11.el7ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-10-28 18:23:44 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 737639 0 None MERGED remove ownership change of ironic-dbsync.log 2020-11-02 14:05:41 UTC
Red Hat Product Errata RHBA-2020:4388 0 None None None 2020-10-28 18:24:00 UTC

Description Cody Swanson 2020-04-09 18:03:47 UTC
Description of problem: 

While performing openstack undercloud upgrade it failed while trying to chown a non-existent log file. The system previously had old logs cleaned up to save space. 

Version-Release number of selected component (if applicable):

(undercloud) [stack@undercloud-0 ~]$ rpm -qa|grep openstack
openstack-tripleo-common-8.7.1-15.el7ost.noarch
openstack-tripleo-ui-8.3.2-3.el7ost.noarch
openstack-tripleo-heat-templates-8.4.1-51.el7ost.noarch
openstack-nova-conductor-17.0.13-2.el7ost.noarch
openstack-swift-object-2.17.1-3.el7ost.noarch
openstack-mistral-executor-6.0.6-3.el7ost.noarch
openstack-heat-common-10.0.3-9.el7ost.noarch
openstack-ironic-conductor-10.1.10-1.el7ost.noarch
openstack-nova-api-17.0.13-2.el7ost.noarch
openstack-glance-16.0.1-10.el7ost.noarch
puppet-openstack_extras-12.4.1-0.20180831193234.7fed86a.el7ost.noarch
openstack-ironic-staging-drivers-0.9.1-2.el7ost.noarch
openstack-ironic-inspector-7.2.4-1.el7ost.noarch
openstack-zaqar-6.0.1-4.el7ost.noarch
openstack-nova-common-17.0.13-2.el7ost.noarch
openstack-neutron-ml2-12.1.1-6.el7ost.noarch
openstack-heat-api-cfn-10.0.3-9.el7ost.noarch
openstack-swift-container-2.17.1-3.el7ost.noarch
openstack-mistral-engine-6.0.6-3.el7ost.noarch
openstack-tripleo-image-elements-8.0.3-1.el7ost.noarch
puppet-openstacklib-12.4.0-5.el7ost.noarch
python-openstackclient-lang-3.14.3-5.el7ost.noarch
openstack-tripleo-common-containers-8.7.1-15.el7ost.noarch
openstack-neutron-openvswitch-12.1.1-6.el7ost.noarch
openstack-nova-scheduler-17.0.13-2.el7ost.noarch
openstack-heat-engine-10.0.3-9.el7ost.noarch
openstack-keystone-13.0.4-1.el7ost.noarch
openstack-swift-proxy-2.17.1-3.el7ost.noarch
openstack-mistral-api-6.0.6-3.el7ost.noarch
python2-openstacksdk-0.11.4-1.el7ost.noarch
openstack-ironic-common-10.1.10-1.el7ost.noarch
openstack-neutron-12.1.1-6.el7ost.noarch
openstack-heat-api-10.0.3-9.el7ost.noarch
openstack-tripleo-validations-8.5.0-4.el7ost.noarch
openstack-selinux-0.8.18-1.el7ost.noarch
openstack-nova-compute-17.0.13-2.el7ost.noarch
openstack-tempest-18.0.0-13.el7ost.noarch
openstack-swift-account-2.17.1-3.el7ost.noarch
openstack-mistral-common-6.0.6-3.el7ost.noarch
python2-openstackclient-3.14.3-5.el7ost.noarch
openstack-neutron-common-12.1.1-6.el7ost.noarch
openstack-ironic-api-10.1.10-1.el7ost.noarch
openstack-nova-placement-api-17.0.13-2.el7ost.noarch
openstack-tripleo-puppet-elements-8.1.1-2.el7ost.noarch


How reproducible:

Every time. 

Steps to Reproduce:
1. Remove /var/log/ironic/ironic-dbsync.log
2. Perform openstack undercloud upgrade following Red Hat documentation.

Actual results:

2020-04-09 13:43:31,359 INFO: Complete!
2020-04-09 13:43:31,517 INFO: Update completed successfully
2020-04-09 13:43:33,217 INFO: Logging to /home/stack/.instack/install-undercloud.log
2020-04-09 13:43:33,309 INFO: Checking for a FQDN hostname...
2020-04-09 13:43:33,395 INFO: Static hostname detected as undercloud-0.redhat.local
2020-04-09 13:43:33,438 INFO: Transient hostname detected as undercloud-0.redhat.local
2020-04-09 13:43:33,664 ERROR: sudo failed: /usr/bin/chown: cannot access ‘/var/log/ironic/ironic-dbsync.log’: No such file or directory

2020-04-09 13:43:33,665 DEBUG: An exception occurred
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2450, in install
    '/var/log/ironic/ironic-dbsync.log'])
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 644, in _run_command
    env=env).decode('utf-8')
  File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['sudo', '/usr/bin/chown', 'ironic:ironic', '/var/log/ironic/ironic-dbsync.log']' returned non-zero exit status 1
2020-04-09 13:43:33,669 ERROR: 
#############################################################################
Undercloud upgrade failed.

Reason: Command '['sudo', '/usr/bin/chown', 'ironic:ironic', '/var/log/ironic/ironic-dbsync.log']' returned non-zero exit status 1

See the previous output for details about what went wrong.  The full install
log can be found at /home/stack/.instack/install-undercloud.log.

#############################################################################

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2450, in install
    '/var/log/ironic/ironic-dbsync.log'])
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 644, in _run_command
    env=env).decode('utf-8')
  File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
subprocess.CalledProcessError: Command '['sudo', '/usr/bin/chown', 'ironic:ironic', '/var/log/ironic/ironic-dbsync.log']' returned non-zero exit status 1
Command '['instack-upgrade-undercloud']' returned non-zero exit status 1

Expected results:

Successful undercloud upgrade.

Additional info:

Comment 2 Cody Swanson 2020-04-15 03:38:16 UTC
Just an update, I forgot to include the workaround which is quite simple.

touch /var/log/ironic/ironic-dbsync.log

then re-running the deploy works as expected.

Comment 14 errata-xmlrpc 2020-10-28 18:23:44 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 13.0 director bug fix advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4388


Note You need to log in before you can comment on or make changes to this bug.