Bug 1617949
| Summary: | CNS deployment always failed to wait GlusterFS pods | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Wenkai Shi <weshi> |
| Component: | Installer | Assignee: | Jose A. Rivera <jarrpa> |
| Status: | CLOSED DUPLICATE | QA Contact: | Johnny Liu <jialiu> |
| Severity: | high | Docs Contact: | |
| Priority: | high | ||
| Version: | 3.11.0 | CC: | aos-bugs, jokerman, mmccomas, scuppett, wmeng |
| Target Milestone: | --- | Keywords: | TestBlocker |
| Target Release: | 3.11.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2018-08-23 17:45:16 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | |||
| Bug Blocks: | 1615264 | ||
*** This bug has been marked as a duplicate of bug 1615982 *** |
Description of problem: CNS deployment failed to wait GlusterFS pods since installer is waiting for status become "Ready" but pod status always "Running". It cause installation failure. Version-Release number of the following components: openshift-ansible-3.11.0-0.16.0.git.0.e82689aNone.noarch How reproducible: 100% Steps to Reproduce: 1. Deploy OCP with CNS. 2. 3. Actual results: # ansible-playbook -i hosts -vv /usr/share/ansible/openshift-ansible/playbooks/deploy_cluster.yml ... TASK [openshift_storage_glusterfs : Deploy GlusterFS pods] ********************* Thursday 16 August 2018 16:28:31 +0800 (0:00:00.834) 0:19:42.055 ******* changed: [qe-weshi-cns-master-etcd-1.0816-m1t.qe.rhcloud.com] => {"changed": true, "results": [{"cmd": "/usr/bin/oc create -f /tmp/glusterfs-storage-hZaSnD -n glusterfs", "kind": "DaemonSet", "results": {}, "returncode": 0}], "state": "present"} TASK [openshift_storage_glusterfs : Wait for GlusterFS pods] ******************* Thursday 16 August 2018 16:28:34 +0800 (0:00:02.465) 0:19:44.520 ******* FAILED - RETRYING: Wait for GlusterFS pods (30 retries left). ... FAILED - RETRYING: Wait for GlusterFS pods (1 retries left). Expected results: Should pass this task. Additional info: Related installer code: # cat ./roles/openshift_storage_glusterfs/tasks/wait_for_pods.yml --- - name: Wait for GlusterFS pods oc_obj: namespace: "{{ glusterfs_namespace }}" kind: pod state: list selector: "glusterfs={{ glusterfs_name }}-pod" register: glusterfs_pods_wait until: - "glusterfs_pods_wait.results.results[0]['items'] | count > 0" # There must be as many pods with 'Ready' staus True as there are nodes expecting those pods - "glusterfs_pods_wait.results.results[0]['items'] | lib_utils_oo_collect(attribute='status.conditions') | lib_utils_oo_collect(attribute='status', filters={'type': 'Ready'}) | map('bool') | select | list | count == l_glusterfs_count" delay: 10 retries: "{{ (glusterfs_timeout | int / 10) | int }}" vars: l_glusterfs_count: "{{ glusterfs_count | default(glusterfs_nodes | count) | int }}" Actually pods status: # oc get po -n glusterfs NAME READY STATUS RESTARTS AGE glusterfs-storage-jcs9x 1/1 Running 0 3m glusterfs-storage-jqqjx 1/1 Running 0 3m glusterfs-storage-nfz6d 1/1 Running 0 3m