Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1774725

Summary: OCP3.11.154 Install w/OCS fails due to GlusterFS health check task in deploy_cluster.yml called before pods scheduled.
Product: OpenShift Container Platform Reporter: Bradley Scalio <bscalio>
Component: InstallerAssignee: Russell Teague <rteague>
Installer sub component: openshift-ansible QA Contact: Prasanth <pprakash>
Status: CLOSED CURRENTRELEASE Docs Contact:
Severity: high    
Priority: high CC: adeshpan, chmurphy, dmoessne, hcisneir, jnordell, jroberts, puebele, rteague, sascha.tanke, sdodson, sople, vjaypurk
Version: 3.11.0Keywords: Regression
Target Milestone: ---   
Target Release: 3.11.z   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-01-15 13:11:32 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1700082    
Attachments:
Description Flags
OCP 3.11.154 and eventual 153 prereq and deploy ansible output none

Description Bradley Scalio 2019-11-20 19:34:58 UTC
Description of problem:  

Single master POC install failing on RHEL7.7 using OCP3.11.153 pulled on Tuesday, 19-NOV-2019 from RHN when running deploy_cluster.yml expects GlusterFS to be available before it is deployed.

Version-Release number of the following components:
See Github Link for information.

How reproducible:
Always

Steps to Reproduce:
See GitHub Linked for information, same steps reproduced on-site with customer and resolution in ticket on GitHub resolved the issue for us.

Actual results:
See GitHub Link for information.

Expected results:
OCP 3.11.153 w/OCS installs

Additional info:
Secure facility cannot upload information

Comment 3 Russell Teague 2019-11-22 13:41:50 UTC
After OCP3.11.154, a change[1] was merged to address an issue with gluster install however this fix has not yet shipped.  Logs will help to further debug this issue.


Please include the following information and logs.

Version-Release number of the following components:
rpm -q openshift-ansible
rpm -q ansible
ansible --version

Additional info:
Please attach logs from ansible-playbook with the -vvv flag


[1] https://github.com/openshift/openshift-ansible/pull/11987

Comment 4 Bradley Scalio 2019-11-25 16:26:10 UTC
Created attachment 1639543 [details]
OCP 3.11.154 and eventual 153 prereq and deploy ansible output

Comment 5 Bradley Scalio 2019-11-25 16:36:41 UTC
The output from the installation that works is below, the output for the one that failed will be in the attached logfile named ansible.rar



$ rpm -q openshift-ansible

openshift-ansible-3.11.153-2.git.0.ee699b5.el7.noarch

 

$ rpm -q ansible         

ansible-2.6.20-1.el7ae.noarch

 

$ ansible --version      

ansible 2.6.20

  config file = /etc/ansible/ansible.cfg

  configured module search path = [u'/home/vhaispjaegea0/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules']

  ansible python module location = /usr/lib/python2.7/site-packages/ansible

  executable location = /bin/ansible

  python version = 2.7.5 (default, Jun 11 2019, 14:33:56) [GCC 4.8.5 20150623 (Red Hat 4.8.5-39)]

Comment 6 Hugo Cisneiros (Eitch) 2019-11-25 21:45:19 UTC
I could also reproduce the issue while trying 3.11.154. Same results from the files attached to this bug.

[root@master-0 ~]# rpm -qa | grep ansible
ansible-2.6.20-1.el7ae.noarch
openshift-ansible-roles-3.11.154-2.git.0.1640c49.el7.noarch
openshift-ansible-playbooks-3.11.154-2.git.0.1640c49.el7.noarch
openshift-ansible-3.11.154-2.git.0.1640c49.el7.noarch
openshift-ansible-docs-3.11.154-2.git.0.1640c49.el7.noarch

I can say that downgrading to 3.11.153 also works:

# yum downgrade openshift-ansible-playbooks-3.11.153-2.git.0.ee699b5.el7 openshift-ansible-3.11.153-2.git.0.ee699b5.el7 openshift-ansible-roles-3.11.153-2.git.0.ee699b5.el7 openshift-ansible-docs-3.11.153-2.git.0.ee699b5.el7

Comment 7 Chris Murphy 2019-12-09 13:55:04 UTC
Hi Russell,

Is there any update on this bug. This is affecting a lot of teams and makes the installation of the product uninstallable.

Regards,
Chris

Comment 9 Sascha Tanke 2020-01-08 08:54:40 UTC
Give installation of OCP a new try today and it is working now.

Package versions:
openshift-ansible-3.11.157-1.git.0.10b76ed.el7.noarch
openshift-ansible-playbooks-3.11.157-1.git.0.10b76ed.el7.noarch
openshift-ansible-roles-3.11.157-1.git.0.10b76ed.el7.noarch

Comment 10 Scott Dodson 2020-01-14 21:04:46 UTC
Please confirm whether this has been resolved in openshift-ansible 3.11.157 or 3.11.161 which contain the changes from https://github.com/openshift/openshift-ansible/pull/11987

Comment 11 Scott Dodson 2020-01-14 21:07:46 UTC
*** Bug 1777499 has been marked as a duplicate of this bug. ***