Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1916731

Summary: ERROR! Invalid callback for stdout specified: validation_output
Product: Red Hat OpenStack Reporter: Filip Hubík <fhubik>
Component: openstack-tripleo-validationsAssignee: RHOS Maint <rhos-maint>
Status: CLOSED ERRATA QA Contact: Filip Hubík <fhubik>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 16.1 (Train)CC: aschultz, gchamoul, jjoyce, jschluet, mburns, mgarciac, slinaber, tvignaud
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-tripleo-validations-11.3.2-1.20201114040746.el8ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-03-17 15:36:38 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Filip Hubík 2021-01-15 14:36:30 UTC
Description of problem:

Since build RHOS-16.1-RHEL-8-20210115.n.1 OSP 16.1 phase1 deployment fails on undercloud install stage with error:

INFO tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] Checking Hostname...
INFO tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] Checking Memory...
INFO tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] Checking Disk space...
WARNING tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] Using /tmp/undercloud-disk-space.yamli_nfvxrqansible.cfg as config file
WARNING tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] [WARNING]: log file at /usr/share/ansible/validation-playbooks/ansible.log is not writeable and we cannot create it, aborting
WARNING tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] 
WARNING tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] ERROR! Invalid callback for stdout specified: validation_output
WARNING tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] /usr/share/ansible/validation-playbooks/undercloud-disk-space.yaml did not complete successfully.
ERROR tripleoclient.v1.undercloud_preflight.UndercloudSetup [  ] An error occurred during configuration validation, please check your host configuration and try again. Error message: Ansible playbook execution failed: ['ansible-playbook-3', '-u', 'root', '-i', 'undercloud,', '-v', '--extra-vars', 'ansible_python_interpreter=/usr/bin/python3', '-c', 'local', '/usr/share/ansible/validation-playbooks/undercloud-disk-space.yaml']

Using /tmp/undercloud-disk-space.yamli_nfvxrqansible.cfg as config file
[WARNING]: log file at /usr/share/ansible/validation-playbooks/ansible.log is not writeable and we cannot create it, aborting

ERROR! Invalid callback for stdout specified: validation_output
/usr/share/ansible/validation-playbooks/undercloud-disk-space.yaml did not complete successfully.
An error occurred during configuration validation, please check your host configuration and try again. Error message: Ansible playbook execution failed: ['ansible-playbook-3', '-u', 'root', '-i', 'undercloud,', '-v', '--extra-vars', 'ansible_python_interpreter=/usr/bin/python3', '-c', 'local', '/usr/share/ansible/validation-playbooks/undercloud-disk-space.yaml'].

though there seems to be enough free space in UC VM image:

Filesystem      Size  Used Avail Use% Mounted on
devtmpfs         12G     0   12G   0% /dev
tmpfs            12G     0   12G   0% /dev/shm
tmpfs            12G   17M   12G   1% /run
tmpfs            12G     0   12G   0% /sys/fs/cgroup
/dev/vda3        55G  3.7G   52G   7% /
/dev/vda2       100M  6.9M   93M   7% /boot/efi
tmpfs           2.4G     0  2.4G   0% /run/user/1001

Additional info:
openstack-tripleo-validations.noarch          11.3.2-1.20201114040743.el8ost                  @rhelosp-16.1 
openstack-tripleo-common.noarch               11.4.1-1.20210104173606.75bd92a.el8ost          @rhelosp-16.1
ansible.noarch                                2.9.16-1.el8ae                                  @rhosp-ansible-2.9
tripleo-ansible.noarch                        0.5.1-1.20201114030848.el8ost                   @rhelosp-16.1

Comment 2 Alex Schultz 2021-01-15 15:40:38 UTC
Missing validations-common dependency by default. It likely needs to be on openstack-tripleo-validations

[cloud-user@undercloud ~]$ sudo dnf whatprovides '*/validation_output*'
Last metadata expiration check: 0:05:23 ago on Fri 15 Jan 2021 10:33:42 AM EST.
validations-common-1.1.2-1.20200914180306.el8ost.noarch : A collection of Ansible libraries, Plugins and Roles for the Validation Framework
Repo        : rhelosp-16.1
Matched from:
Filename    : /usr/lib/python3.6/site-packages/validations_common/callback_plugins/__pycache__/validation_output.cpython-36.opt-1.pyc
Filename    : /usr/lib/python3.6/site-packages/validations_common/callback_plugins/__pycache__/validation_output.cpython-36.pyc
Filename    : /usr/lib/python3.6/site-packages/validations_common/callback_plugins/validation_output.py
Filename    : /usr/share/ansible/callback_plugins/validation_output.py

[cloud-user@undercloud ~]$ rpm -qa | grep validations-common
[cloud-user@undercloud ~]$ rpm -qa | grep tripleo
puppet-tripleo-11.5.0-1.20201114030109.el8ost.noarch
tripleo-ansible-0.5.1-1.20201114030848.el8ost.noarch
python3-tripleoclient-heat-installer-12.3.2-1.20201114043240.el8ost.noarch
ansible-tripleo-ipsec-9.3.0-1.20201113193132.0c8693c.el8ost.noarch
ansible-tripleo-ipa-0.2.1-1.20201114010033.3bb3c53.el8ost.noarch
openstack-tripleo-common-containers-11.4.1-1.20210104173606.75bd92a.el8ost.noarch
python3-tripleo-common-11.4.1-1.20210104173606.75bd92a.el8ost.noarch
openstack-tripleo-common-11.4.1-1.20210104173606.75bd92a.el8ost.noarch
ansible-role-tripleo-modify-image-1.2.1-1.20201114004656.1dffa21.el8ost.noarch
openstack-tripleo-image-elements-10.6.2-1.20201113215051.7dc0fa1.el8ost.noarch
openstack-tripleo-validations-11.3.2-1.20201114040743.el8ost.noarch
openstack-tripleo-heat-templates-11.3.2-1.20210104205656.el8ost.noarch
openstack-tripleo-puppet-elements-11.2.2-1.20201114042506.f061f90.el8ost.noarch
python3-tripleoclient-12.3.2-1.20201114043240.el8ost.noarch

Comment 3 Alex Schultz 2021-01-15 15:44:06 UTC
Caused by https://bugzilla.redhat.com/show_bug.cgi?id=1877688

Comment 8 Gaël Chamoulaud 2021-01-20 15:14:23 UTC
The validations-common dependency was added to the openstack-tripleo-validations-tests sub-package and not for main one!

Comment 11 Filip Hubík 2021-01-22 13:19:03 UTC
Verified passing UC with openstack-tripleo-validations-11.3.2-1.20200916153443.el8ost on top of RHOS-16.1-RHEL-8-20210115.n.1 manually and also by CI job (where we get openstack-tripleo-validations-11.3.2-1.20201114040746), though was not fixed in RHOS-16.1-RHEL-8-20210118.n.0 by openstack-tripleo-validations-11.3.2-1.20201114040745.el8ost yet.

Changing the "Fixed in" since we are not getting ...43 but openstack-tripleo-validations-11.3.2-1.20201114040746.el8ost in latest builds (RHOS-16.1-RHEL-8-20210120.n.1) - assuming the difference is just in build task (rhos-16.1-rhel-8-candidate/rhos-16.1-rhel-8-trunk-candidate).

Comment 20 errata-xmlrpc 2021-03-17 15:36:38 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 16.1.4 director bug fix advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:0817