Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1634244

Summary: [regression] installer fails with AnsibleUndefinedVariable: 'glusterfs_heketi_route' is undefined
Product: OpenShift Container Platform Reporter: daniel <dmoessne>
Component: InstallerAssignee: Jose A. Rivera <jarrpa>
Status: CLOSED ERRATA QA Contact: Rachael <rgeorge>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 3.9.0CC: aos-bugs, aship, bkunal, bleanhar, gpei, jarrpa, jokerman, jrosenta, mcalizo, mmccomas, rgeorge, sdodson, tatanaka, wmeng
Target Milestone: ---   
Target Release: 3.9.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: No Doc Update
Doc Text:
undefined
 Story Points: ---
Clone Of: Environment:
Last Closed: 2019-01-30 15:10:24 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1643366    
Attachments:
Description Flags
ansible log output
none
ansible hosts file used none

Description daniel 2018-09-29 09:09:51 UTC 
Created attachment 1488317 [details]
ansible log output

Description of problem:

when istalling new OCP 3.9 env with latest openshift-ansible-3.9.43-1.git.0.d0bc600.el7.noarch it fails with the following message:


TASK [openshift_storage_glusterfs : Create heketi secret] ************************************************************************************************************************************
changed: [inf152.example.com]

TASK [openshift_storage_glusterfs : Generate GlusterFS StorageClass file] ********************************************************************************************************************
fatal: [inf152.example.com]: FAILED! => {"changed": false, "failed": true, "msg": "AnsibleUndefinedVariable: 'glusterfs_heketi_route' is undefined"}
        to retry, use: --limit @/usr/share/ansible/openshift-ansible/playbooks/deploy_cluster.retry

PLAY RECAP ***********************************************************************************************************************************************************************************
inf152.example.com  : ok=516  changed=208  unreachable=0    failed=1   
inf153.example.com  : ok=343  changed=138  unreachable=0    failed=0
inf154.example.com  : ok=343  changed=138  unreachable=0    failed=0
inf155.example.com  : ok=143  changed=55   unreachable=0    failed=0
inf156.example.com  : ok=159  changed=63   unreachable=0    failed=0
inf157.example.com  : ok=143  changed=55   unreachable=0    failed=0
inf158.example.com  : ok=143  changed=55   unreachable=0    failed=0
inf159.example.com  : ok=143  changed=55   unreachable=0    failed=0
inf160.example.com  : ok=143  changed=55   unreachable=0    failed=0
inf161.example.com  : ok=140  changed=53   unreachable=0    failed=0
inf162.example.com  : ok=140  changed=53   unreachable=0    failed=0
inf163.example.com  : ok=140  changed=53   unreachable=0    failed=0
inf164.example.com  : ok=140  changed=53   unreachable=0    failed=0
inf165.example.com  : ok=140  changed=53   unreachable=0    failed=0
inf166.example.com  : ok=140  changed=53   unreachable=0    failed=0
inf167.example.com  : ok=140  changed=53   unreachable=0    failed=0
inf168.example.com  : ok=140  changed=53   unreachable=0    failed=0
inf169.example.com  : ok=140  changed=53   unreachable=0    failed=0
localhost                  : ok=14   changed=0    unreachable=0    failed=0

INSTALLER STATUS *****************************************************************************************************************************************************************************
Initialization             : Complete (0:01:02)
Health Check               : Complete (0:07:09)
etcd Install               : Complete (0:02:49)
Load balancer Install      : Complete (0:01:20)
Master Install             : Complete (0:05:05)
Master Additional Install  : Complete (0:02:02)
Node Install               : Complete (0:21:53)
GlusterFS Install          : In Progress (0:08:54)
        This phase can be restarted by running: playbooks/openshift-glusterfs/config.yml



Failure summary:  


  1. Hosts:    inf152.example.com
     Play:     Configure GlusterFS
     Task:     Generate GlusterFS StorageClass file
     Message:  AnsibleUndefinedVariable: 'glusterfs_heketi_route' is undefined
[root@inf150 ~]# 

The very same inventory (will attach) is working fine with previous version) 3.9.41, so I consider this a regression!




Version-Release number of the following components:

[root@inf150 ~]# rpm -q openshift-ansible
openshift-ansible-3.9.43-1.git.0.d0bc600.el7.noarch
[root@inf150 ~]# 
[root@inf150 ~]# rpm -q ansible
ansible-2.4.6.0-1.el7ae.noarch
[root@inf150 ~]# 
[root@inf150 ~]# ansible --version
ansible 2.4.6.0
  config file = /etc/ansible/ansible.cfg
  configured module search path = [u'/root/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/lib/python2.7/site-packages/ansible
  executable location = /usr/bin/ansible
  python version = 2.7.5 (default, May 31 2018, 09:41:32) [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)]
[root@inf150 ~]# 


How reproducible:

Steps to Reproduce:
1. Install OCP 3.9 with the inventory attached 
2. fails with above error


Actual results:
Please include the entire output from the last TASK line through the end of output if an error is generated

(see above, ansible log attached)

Expected results:

works as with previous ansible version

Additional info:
- looks like https://github.com/openshift/openshift-ansible/pull/10146
Comment 2 daniel 2018-09-29 09:10:26 UTC 
Created attachment 1488318 [details]
ansible hosts file used
Comment 3 daniel 2018-09-29 09:10:59 UTC 
- hosts file used is attached 
- ansible.log is attached
Comment 5 Takayoshi Tanaka 2018-10-05 05:44:27 UTC 
The customer reported this BZ. Since it's a blocking issue, I'd like to clarify the following things.

- Do you have a workaround?
According to the fix [1], the customer has to edit the playbook directly in their host. Is it correct? If you have any workarounds, please let me know

[1] https://github.com/openshift/openshift-ansible/pull/10146/files

- Do we have a schedule for releasing the next patch including this fix?
Comment 6 Takayoshi Tanaka 2018-10-10 05:50:18 UTC 
Hi,

Since this is the blocking issue for the customer, we need a supported way to workaround the issue. What is the recommended workaround? If the customer needs to modify the playbook directory, please let me know. Or is there a way to lock the old version of openshift-ansible package?
Comment 7 Jose A. Rivera 2018-10-10 15:20:11 UTC 
There is no "supported" workaround other than upgrading to a version of openshift-ansible that has the fix merged. Manually changing the playbooks, while unsupported, would be the most immediate solution.

I do not know what the release schedule for this is. Scott?
Comment 8 Scott Dodson 2018-10-29 20:35:14 UTC 
*** Bug 1643711 has been marked as a duplicate of this bug. ***
Comment 9 Scott Dodson 2018-10-29 20:36:35 UTC 
This is in openshift-ansible-3.9.46-1 and later, moving ON_QA.
Comment 11 Aaron Ship 2018-11-06 07:47:32 UTC 
Hello all
Can we confirm if comment #10 from Scott happened, if not do we have a new release date.
Comment 13 Rachael 2018-12-17 04:25:25 UTC 
Hi Jose,

Can you please update the bug with the fixed in version details?

Thanks!
Comment 16 errata-xmlrpc 2019-01-30 15:10:24 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:0098