Bug 1757111

Summary:	upgrade playbook is failing when it is run on 6 nodes OCS cluster
Product:	[Red Hat Storage] Red Hat Gluster Storage	Reporter:	Arun Kumar <arukumar>
Component:	cns-ansible	Assignee:	John Mulligan <jmulligan>
Status:	CLOSED WONTFIX	QA Contact:	Arun Kumar <arukumar>
Severity:	high	Docs Contact:
Priority:	high
Version:	ocs-3.11	CC:	hchiramm, knarra, madam, pprakash, rhs-bugs
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2020-02-27 15:18:24 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1703695

Description Arun Kumar 2019-09-30 15:09:10 UTC

Description of problem:
upgrade playbook is failing when it is run on 6 nodes OCS cluster

During the upgrade, playbook creates DS with 5 nodes when it is run on 6 node cluster.

It is working on the setup which has nodes less than 6.

snippet:

Before upgrade:
=======================
[root@master ~]# 
[root@master ~]# oc get ds
NAME                DESIRED   CURRENT   READY     UP-TO-DATE   AVAILABLE   NODE SELECTOR            AGE
glusterfs-storage   6         6         6         6            6           glusterfs=storage-host   5h

After playbook fails:
============================== 
[root@master ~]# oc get ds
NAME                DESIRED   CURRENT   READY     UP-TO-DATE   AVAILABLE   NODE SELECTOR            AGE
glusterfs-storage   5         5         5         0            5           glusterfs=storage-host   14m





Version-Release number of selected component (if applicable):
[root@master ~]# rpm -qa|grep  ansible
ansible-2.6.19-1.el7ae.noarch
openshift-ansible-3.11.146-1.git.0.fcedb45.el7.noarch
openshift-ansible-docs-3.11.146-1.git.0.fcedb45.el7.noarch
openshift-ansible-playbooks-3.11.146-1.git.0.fcedb45.el7.noarch
openshift-ansible-roles-3.11.146-1.git.0.fcedb45.el7.noarch


I reproduced this issue 4*4

I will attach the ansible logs and inventory file soon:

Comment 5 John Mulligan 2020-02-27 15:18:24 UTC

Upgrade playbook is in tech-preview state and will remain so. Due to resource constraints we will not be futher improving or enhancing the upgrade playbook.