Bug 1563923

Summary: [Gdeploy+Ganesha] If pcs auth command fails while setting up ganesha cluster,gdeploy still proceed further with ganesha cluster creation
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Manisha Saini <msaini>
Component: gdeployAssignee: Devyani Kota <dkota>
Status: CLOSED ERRATA QA Contact: Manisha Saini <msaini>
Severity: high Docs Contact:
Priority: unspecified    
Version: rhgs-3.3CC: dkota, musoni, pmulay, rcyriac, rhinduja, rhs-bugs, smohan, storage-qa-internal
Target Milestone: ---Keywords: ZStream
Target Release: RHGS 3.3.1 Async   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: gdeploy-2.0.2-26 Doc Type: If docs needed, set a value
Doc Text:
Previously, despite failed PCS authentication, NFS Ganesha installation would proceed and execute further steps. A new flag ‘ignore_ganesha_errors’ is introduced with this update. Which can be set either 'yes' or 'no' to control the execution. If set to yes, errors will be ignored. If set to no, execution stops at the first error.
 Story Points: ---
Clone Of: Environment:
Last Closed: 2018-06-21 03:33:15 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1581561    

Description Manisha Saini 2018-04-05 04:18:46 UTC 
Description of problem:

While setting up ganesha cluster via gdeploy,If somehow  pcs auth command fails,Gdeploy still proceed with further steps of ganesha cluster creation.

While verifying the RFE- BZ 1226874,I hit this issue.
As mentioned in comment 11 of BZ 1226874,this should be fixed in Gdeploy to avoid the situation in which if pcs cluster auth fails,Gdeploy should not proceed with "gluster nfs-ganesha enable" command and there by ganesha service should not run on any of the nodes.

If ganesha cluster is setup manually by user,pcs cluster auth command comes as pre-requisite of setting up ganesha cluster.Hence if this command will fail,then user will not proceed further with "gluster nfs-ganesha enable" command.The same should be handled via gdeploy



Version-Release number of selected component (if applicable):
# rpm -qa | grep gdeploy
gdeploy-2.0.2-23.el7rhgs.noarch



How reproducible:
2/2

Steps to Reproduce:
1.Set up ganesha cluster via gdeploy

---------
[hosts]
dhcp47-193.lab.eng.blr.redhat.com
dhcp46-116.lab.eng.blr.redhat.com
dhcp46-184.lab.eng.blr.redhat.com
dhcp47-2.lab.eng.blr.redhat.com


[firewalld]
action=add
ports=111/tcp,2049/tcp,54321/tcp,5900/tcp,5900-6923/tcp,5666/tcp,16514/tcp
services=glusterfs,nlm,nfs,rpc-bind,high-availability,mountd,rquota

[nfs-ganesha]
action=create-cluster
ha-name=ganesha-ha-360
cluster-nodes=dhcp47-193.lab.eng.blr.redhat.com,dhcp46-116.lab.eng.blr.redhat.com,dhcp46-184.lab.eng.blr.redhat.com,dhcp47-2.lab.eng.blr.redhat.com
vip=10.70.46.36,10.70.46.37,10.70.46.42,10.70.46.44
----------


------------


ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=rquota)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=rquota)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=rquota)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=rquota)

TASK [Reloads the firewall] ************************************************************************************************************************************************************
changed: [dhcp47-2.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-2.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   


PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Start firewalld if not already started] ******************************************************************************************************************************************
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Open/Close firewalld ports] ******************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp47-2.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=16514/tcp)

TASK [Reloads the firewall] ************************************************************************************************************************************************************
changed: [dhcp47-2.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-2.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   


PLAY [cluster_nodes] *******************************************************************************************************************************************************************

TASK [Check if nfs-ganesha is installed] ***********************************************************************************************************************************************
 [WARNING]: Consider using yum, dnf or zypper module rather than running rpm

changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-2.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]
skipping: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [Check if corosync is installed] **************************************************************************************************************************************************
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]
skipping: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [Check if pacemaker is installed] *************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-2.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]
skipping: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [Check if libntirpc is installed] *************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]
skipping: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [Check if pcs is installed] *******************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]
skipping: [dhcp47-2.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0   
dhcp47-2.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0   


PLAY [cluster_nodes] *******************************************************************************************************************************************************************

TASK [Stop kernel NFS] *****************************************************************************************************************************************************************
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Stop network manager service] ****************************************************************************************************************************************************
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [Disable network manager service] *************************************************************************************************************************************************
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Start network service] ***********************************************************************************************************************************************************
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Enable network service] **********************************************************************************************************************************************************
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]

TASK [Start pcsd service] **************************************************************************************************************************************************************
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Enable pcsd service] *************************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp47-2.lab.eng.blr.redhat.com]

TASK [Enable pacemaker service] ********************************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-2.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [GlusterFS Share Storage service] *************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Enable nfs-ganesha service] ******************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=10   changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=10   changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=10   changed=1    unreachable=0    failed=0   
dhcp47-2.lab.eng.blr.redhat.com : ok=10   changed=1    unreachable=0    failed=0   


PLAY [master_node] *********************************************************************************************************************************************************************

TASK [Generate ssh key in one of the nodes in HA cluster] ******************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Copy the public key to the local] ************************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Copy the private key to the local] ***********************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   


PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Copy the public key to remote nodes] *********************************************************************************************************************************************
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp47-2.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)

TASK [Copy the private key to remote node] *********************************************************************************************************************************************
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp47-2.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)

TASK [Deploy the pubkey ~/root/.ssh/authorized_keys on all nodes] **********************************************************************************************************************
changed: [dhcp47-2.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-2.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   


PLAY [master_node] *********************************************************************************************************************************************************************

TASK [Make the volume a gluster shared volume] *****************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp47-193.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   


PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Create a user hacluster in all the cluster nodes if not already present] *********************************************************************************************************
ok: [dhcp47-2.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Set the hacluster user the same password on all machines] ************************************************************************************************************************
changed: [dhcp47-2.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0   
dhcp47-2.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0   


PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Pcs cluster authenticate the hacluster users in all the nodes] *******************************************************************************************************************
changed: [dhcp47-2.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp47-2.lab.eng.blr.redhat.com] => (item=dhcp46-116.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp46-116.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp46-116.lab.eng.blr.redhat.com)
changed: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp46-116.lab.eng.blr.redhat.com)
changed: [dhcp47-2.lab.eng.blr.redhat.com] => (item=dhcp46-184.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp46-184.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp46-184.lab.eng.blr.redhat.com)
changed: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp46-184.lab.eng.blr.redhat.com)
changed: [dhcp47-2.lab.eng.blr.redhat.com] => (item=dhcp47-2.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp47-2.lab.eng.blr.redhat.com)
changed: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp47-2.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp47-2.lab.eng.blr.redhat.com)

TASK [Pause for a few seconds] *********************************************************************************************************************************************************
Pausing for 3 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
ok: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0   
dhcp47-2.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   


PLAY [master_node] *********************************************************************************************************************************************************************

TASK [Create configuration directory for nfs-ganesha] **********************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Copy ganesha.conf to config directory on shared volume] **************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Creating ganesha-ha.conf file] ***************************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   


PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Define service port] *************************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-2.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   
dhcp47-2.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   


PLAY [master_node] *********************************************************************************************************************************************************************

TASK [Enable nfs-ganesha] **************************************************************************************************************************************************************
fatal: [dhcp47-193.lab.eng.blr.redhat.com]: FAILED! => {"changed": true, "cmd": "gluster nfs-ganesha enable --mode=script", "delta": "0:00:10.702735", "end": "2018-03-26 12:42:44.520213", "failed_when_result": true, "msg": "non-zero return code", "rc": 1, "start": "2018-03-26 12:42:33.817478", "stderr": "nfs-ganesha: failed: NFS-Ganesha failed to start.Please see log file for details", "stderr_lines": ["nfs-ganesha: failed: NFS-Ganesha failed to start.Please see log file for details"], "stdout": "This will take a few minutes to complete. Please wait ..", "stdout_lines": ["This will take a few minutes to complete. Please wait .."]}
...ignoring

TASK [Pause for 30 seconds (takes a while to enable NFS Ganesha)] **********************************************************************************************************************
Pausing for 30 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Check NFS Ganesha status] ********************************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Report NFS Ganesha status] *******************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Report NFS Ganesha status (If any errors)] ***************************************************************************************************************************************
ok: [dhcp47-193.lab.eng.blr.redhat.com] => {
    "msg": "Error: cluster is not currently running on this node"
}

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp47-193.lab.eng.blr.redhat.com : ok=4    changed=2    unreachable=0    failed=0   

[root@dhcp47-193 gdeploy]# vi ganesha_setup.conf 
[root@dhcp47-193 gdeploy]# gdeploy  -c ganesha_setup.conf 

PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Start firewalld if not already started] ******************************************************************************************************************************************
fatal: [dhcp47-2.labb.eng.blr.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Add/Delete services to firewalld rules] ******************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=glusterfs)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=glusterfs)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=glusterfs)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=rquota)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=rquota)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=rquota)

TASK [Reloads the firewall] ************************************************************************************************************************************************************
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
    to retry, use: --limit @/tmp/tmp0hDpxC/firewalld-service-op.retry

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-2.labb.eng.blr.redhat.com : ok=0    changed=0    unreachable=1    failed=0   

Ignoring errors...

PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Start firewalld if not already started] ******************************************************************************************************************************************
fatal: [dhcp47-2.labb.eng.blr.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]

TASK [Open/Close firewalld ports] ******************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp46-116.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp46-184.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=16514/tcp)

TASK [Reloads the firewall] ************************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
    to retry, use: --limit @/tmp/tmp0hDpxC/firewalld-ports-op.retry

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-2.labb.eng.blr.redhat.com : ok=0    changed=0    unreachable=1    failed=0   

Ignoring errors...

PLAY [cluster_nodes] *******************************************************************************************************************************************************************

TASK [Check if nfs-ganesha is installed] ***********************************************************************************************************************************************
fatal: [dhcp47-2.labb.eng.blr.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
 [WARNING]: Consider using yum, dnf or zypper module rather than running rpm

changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Check if corosync is installed] **************************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Check if pacemaker is installed] *************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Check if libntirpc is installed] *************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Check if pcs is installed] *******************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [fail] ****************************************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]
skipping: [dhcp46-116.lab.eng.blr.redhat.com]
skipping: [dhcp46-184.lab.eng.blr.redhat.com]
    to retry, use: --limit @/tmp/tmp0hDpxC/check_package_installs_ganesha.retry

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0   
dhcp47-2.labb.eng.blr.redhat.com : ok=0    changed=0    unreachable=1    failed=0   

Ignoring errors...

PLAY [cluster_nodes] *******************************************************************************************************************************************************************

TASK [Stop kernel NFS] *****************************************************************************************************************************************************************
fatal: [dhcp47-2.labb.eng.blr.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Stop network manager service] ****************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Disable network manager service] *************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Start network service] ***********************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Enable network service] **********************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Start pcsd service] **************************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Enable pcsd service] *************************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Enable pacemaker service] ********************************************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [GlusterFS Share Storage service] *************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]

TASK [Enable nfs-ganesha service] ******************************************************************************************************************************************************
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]
ok: [dhcp46-184.lab.eng.blr.redhat.com]
    to retry, use: --limit @/tmp/tmp0hDpxC/configure-services.retry

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=10   changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=10   changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=10   changed=1    unreachable=0    failed=0   
dhcp47-2.labb.eng.blr.redhat.com : ok=0    changed=0    unreachable=1    failed=0   

Ignoring errors...

PLAY [master_node] *********************************************************************************************************************************************************************

TASK [Generate ssh key in one of the nodes in HA cluster] ******************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Copy the public key to the local] ************************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Copy the private key to the local] ***********************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   


PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Copy the public key to remote nodes] *********************************************************************************************************************************************
failed: [dhcp47-2.labb.eng.blr.redhat.com] (item=dhcp47-193.lab.eng.blr.redhat.com) => {"item": "dhcp47-193.lab.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
fatal: [dhcp47-2.labb.eng.blr.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "All items completed", "results": [{"_ansible_ignore_errors": null, "_ansible_item_result": true, "item": "dhcp47-193.lab.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}]}
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)

TASK [Copy the private key to remote node] *********************************************************************************************************************************************
ok: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)

TASK [Deploy the pubkey ~/root/.ssh/authorized_keys on all nodes] **********************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
    to retry, use: --limit @/tmp/tmp0hDpxC/copy-ssh-key.retry

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0   
dhcp47-2.labb.eng.blr.redhat.com : ok=0    changed=0    unreachable=1    failed=0   

Ignoring errors...

PLAY [master_node] *********************************************************************************************************************************************************************

TASK [Make the volume a gluster shared volume] *****************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp47-193.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   


PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Create a user hacluster in all the cluster nodes if not already present] *********************************************************************************************************
fatal: [dhcp47-2.labb.eng.blr.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
ok: [dhcp46-184.lab.eng.blr.redhat.com]
ok: [dhcp46-116.lab.eng.blr.redhat.com]
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Set the hacluster user the same password on all machines] ************************************************************************************************************************
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
    to retry, use: --limit @/tmp/tmp0hDpxC/set-pcs-auth-passwd.retry

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0   
dhcp47-2.labb.eng.blr.redhat.com : ok=0    changed=0    unreachable=1    failed=0   

Ignoring errors...

PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Pcs cluster authenticate the hacluster users in all the nodes] *******************************************************************************************************************
failed: [dhcp47-2.labb.eng.blr.redhat.com] (item=dhcp47-193.lab.eng.blr.redhat.com) => {"item": "dhcp47-193.lab.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
failed: [dhcp47-2.labb.eng.blr.redhat.com] (item=dhcp46-116.lab.eng.blr.redhat.com) => {"item": "dhcp46-116.lab.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
failed: [dhcp47-2.labb.eng.blr.redhat.com] (item=dhcp46-184.lab.eng.blr.redhat.com) => {"item": "dhcp46-184.lab.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
failed: [dhcp47-2.labb.eng.blr.redhat.com] (item=dhcp47-2.labb.eng.blr.redhat.com) => {"item": "dhcp47-2.labb.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
fatal: [dhcp47-2.labb.eng.blr.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "All items completed", "results": [{"_ansible_ignore_errors": null, "_ansible_item_result": true, "item": "dhcp47-193.lab.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}, {"_ansible_ignore_errors": null, "_ansible_item_result": true, "item": "dhcp46-116.lab.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}, {"_ansible_ignore_errors": null, "_ansible_item_result": true, "item": "dhcp46-184.lab.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}, {"_ansible_ignore_errors": null, "_ansible_item_result": true, "item": "dhcp47-2.labb.eng.blr.redhat.com", "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}]}
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp47-193.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp46-116.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp46-116.lab.eng.blr.redhat.com)
changed: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp46-116.lab.eng.blr.redhat.com)
changed: [dhcp46-116.lab.eng.blr.redhat.com] => (item=dhcp46-184.lab.eng.blr.redhat.com)
changed: [dhcp46-184.lab.eng.blr.redhat.com] => (item=dhcp46-184.lab.eng.blr.redhat.com)
changed: [dhcp47-193.lab.eng.blr.redhat.com] => (item=dhcp46-184.lab.eng.blr.redhat.com)
failed: [dhcp46-116.lab.eng.blr.redhat.com] (item=dhcp47-2.labb.eng.blr.redhat.com) => {"changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp47-2.labb.eng.blr.redhat.com", "delta": "0:00:00.827062", "end": "2018-03-26 12:55:42.810885", "item": "dhcp47-2.labb.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2018-03-26 12:55:41.983823", "stderr": "Error: Unable to communicate with dhcp47-2.labb.eng.blr.redhat.com", "stderr_lines": ["Error: Unable to communicate with dhcp47-2.labb.eng.blr.redhat.com"], "stdout": "", "stdout_lines": []}
failed: [dhcp46-184.lab.eng.blr.redhat.com] (item=dhcp47-2.labb.eng.blr.redhat.com) => {"changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp47-2.labb.eng.blr.redhat.com", "delta": "0:00:00.934702", "end": "2018-03-26 12:55:43.317563", "item": "dhcp47-2.labb.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2018-03-26 12:55:42.382861", "stderr": "Error: Unable to communicate with dhcp47-2.labb.eng.blr.redhat.com", "stderr_lines": ["Error: Unable to communicate with dhcp47-2.labb.eng.blr.redhat.com"], "stdout": "", "stdout_lines": []}
failed: [dhcp47-193.lab.eng.blr.redhat.com] (item=dhcp47-2.labb.eng.blr.redhat.com) => {"changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp47-2.labb.eng.blr.redhat.com", "delta": "0:00:01.003482", "end": "2018-03-26 12:55:43.387661", "item": "dhcp47-2.labb.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2018-03-26 12:55:42.384179", "stderr": "Error: Unable to communicate with dhcp47-2.labb.eng.blr.redhat.com", "stderr_lines": ["Error: Unable to communicate with dhcp47-2.labb.eng.blr.redhat.com"], "stdout": "", "stdout_lines": []}
    to retry, use: --limit @/tmp/tmp0hDpxC/pcs-authentication.retry

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1   
dhcp46-184.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1   
dhcp47-193.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1   
dhcp47-2.labb.eng.blr.redhat.com : ok=0    changed=0    unreachable=1    failed=0   

Ignoring errors...

PLAY [master_node] *********************************************************************************************************************************************************************

TASK [Create configuration directory for nfs-ganesha] **********************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Copy ganesha.conf to config directory on shared volume] **************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Creating ganesha-ha.conf file] ***************************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp47-193.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0   


PLAY [gluster_servers] *****************************************************************************************************************************************************************

TASK [Define service port] *************************************************************************************************************************************************************
fatal: [dhcp47-2.labb.eng.blr.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: ssh: Could not resolve hostname dhcp47-2.labb.eng.blr.redhat.com: Name or service not known\r\n", "unreachable": true}
changed: [dhcp46-116.lab.eng.blr.redhat.com]
changed: [dhcp47-193.lab.eng.blr.redhat.com]
changed: [dhcp46-184.lab.eng.blr.redhat.com]
    to retry, use: --limit @/tmp/tmp0hDpxC/define_service_ports.retry

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp46-116.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   
dhcp46-184.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   
dhcp47-193.lab.eng.blr.redhat.com : ok=1    changed=1    unreachable=0    failed=0   
dhcp47-2.labb.eng.blr.redhat.com : ok=0    changed=0    unreachable=1    failed=0   

Ignoring errors...

PLAY [master_node] *********************************************************************************************************************************************************************

TASK [Enable nfs-ganesha] **************************************************************************************************************************************************************
fatal: [dhcp47-193.lab.eng.blr.redhat.com]: FAILED! => {"changed": true, "cmd": "gluster nfs-ganesha enable --mode=script", "delta": "0:00:49.946201", "end": "2018-03-26 12:56:44.035225", "failed_when_result": true, "msg": "non-zero return code", "rc": 1, "start": "2018-03-26 12:55:54.089024", "stderr": "nfs-ganesha: failed: Failed to set up HA config for NFS-Ganesha. Please check the log file for details", "stderr_lines": ["nfs-ganesha: failed: Failed to set up HA config for NFS-Ganesha. Please check the log file for details"], "stdout": "This will take a few minutes to complete. Please wait ..", "stdout_lines": ["This will take a few minutes to complete. Please wait .."]}
...ignoring

TASK [Pause for 30 seconds (takes a while to enable NFS Ganesha)] **********************************************************************************************************************
Pausing for 30 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
ok: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Check NFS Ganesha status] ********************************************************************************************************************************************************
changed: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Report NFS Ganesha status] *******************************************************************************************************************************************************
skipping: [dhcp47-193.lab.eng.blr.redhat.com]

TASK [Report NFS Ganesha status (If any errors)] ***************************************************************************************************************************************
ok: [dhcp47-193.lab.eng.blr.redhat.com] => {
    "msg": "Error: cluster is not currently running on this node"
}

PLAY RECAP *****************************************************************************************************************************************************************************
dhcp47-193.lab.eng.blr.redhat.com : ok=4    changed=2    unreachable=0    failed=0   

---------------------

Actual results:
If pcs auth command fails,Gdeploy proceed with further steps of setting up ganesha cluster


Expected results:
If pcs auth command fails,Gdeploy should halt with proper error message and hence avoid running further steps of setting up ganesha cluster

Additional info:
Comment 4 Devyani Kota 2018-04-19 13:38:33 UTC 
Commit #8145 [1] fixes this issue.

[1]https://github.com/gluster/gdeploy/pull/501/commits/8556d566574bc676b2a6faffd067f7dc48d88145

Thanks.
Comment 9 Devyani Kota 2018-06-13 07:59:54 UTC 
@pmulay, yes. looks good.
Comment 12 errata-xmlrpc 2018-06-21 03:33:15 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2018:1958