Bug 1813908

Summary: common-ha: updates for pcs-0.10.x (i.e. in Fedora-29 and RHEL-8)
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Kaleb KEITHLEY <kkeithle>
Component: gdeployAssignee: Prajith <pkesavap>
Status: CLOSED ERRATA QA Contact: Manisha Saini <msaini>
Severity: high Docs Contact:
Priority: unspecified    
Version: rhgs-3.5CC: godas, msaini, pkesavap, pprakash, puebele, rhs-bugs, sheggodu, storage-qa-internal
Target Milestone: ---Keywords: Reopened, TestBlocker, ZStream
Target Release: RHGS 3.5.z Batch Update 2   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: gdeploy-3.0.0-5 Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: 1802727 Environment:
Last Closed: 2020-06-16 05:56:04 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1821907    
Bug Blocks: 1802727, 1813166    

Comment 4 Manisha Saini 2020-03-24 09:42:21 UTC 
This BZ is not a duplicate of BZ 1813166.Both issues are different.

Reopening this BZ since latest pcs command changes needs to be done with gdeploy.

Ganesha setup with gdeploy is failing due to pcs command changes with RHEL 8

Tested with 

# rpm -qa | grep gdeploy
gdeploy-3.0.0-4.el8rhgs.noarch

# rpm -qa | grep ansible
ansible-2.9.6-1.el8ae.noarch


Gdeploy logs--

-----------------
# gdeploy -c ganesha-setup.conf

PLAY [gluster_servers] ***********************************************************************************************************************************************************************************************************************

TASK [Start firewalld if not already started] ************************************************************************************************************************************************************************************************
ok: [dhcp35-21.lab.eng.blr.redhat.com]
ok: [dhcp35-63.lab.eng.blr.redhat.com]
ok: [dhcp35-134.lab.eng.blr.redhat.com]
ok: [dhcp35-76.lab.eng.blr.redhat.com]

TASK [Open/Close firewalld ports] ************************************************************************************************************************************************************************************************************
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=111/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=2049/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=54321/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=5900/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=5900-6923/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=5666/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=16514/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=662/tcp)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=662/tcp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=662/tcp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=662/tcp)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=662/udp)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=662/udp)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=662/udp)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=662/udp)

TASK [Reloads the firewall] ******************************************************************************************************************************************************************************************************************
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-134.lab.eng.blr.redhat.com]
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-134.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-21.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-63.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-76.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   


PLAY [gluster_servers] ***********************************************************************************************************************************************************************************************************************

TASK [Start firewalld if not already started] ************************************************************************************************************************************************************************************************
ok: [dhcp35-76.lab.eng.blr.redhat.com]
ok: [dhcp35-63.lab.eng.blr.redhat.com]
ok: [dhcp35-21.lab.eng.blr.redhat.com]
ok: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [Add/Delete services to firewalld rules] ************************************************************************************************************************************************************************************************
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=glusterfs)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=glusterfs)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=glusterfs)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=glusterfs)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=nlm)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=nfs)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=rpc-bind)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=high-availability)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=mountd)
ok: [dhcp35-21.lab.eng.blr.redhat.com] => (item=rquota)
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=rquota)
ok: [dhcp35-134.lab.eng.blr.redhat.com] => (item=rquota)
ok: [dhcp35-63.lab.eng.blr.redhat.com] => (item=rquota)

TASK [Reloads the firewall] ******************************************************************************************************************************************************************************************************************
changed: [dhcp35-134.lab.eng.blr.redhat.com]
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-134.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-21.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-63.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-76.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   


PLAY [cluster_nodes] *************************************************************************************************************************************************************************************************************************

TASK [Check if nfs-ganesha is installed] *****************************************************************************************************************************************************************************************************
[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'.  If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in
ansible.cfg to get rid of this message.
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]
changed: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [fail] **********************************************************************************************************************************************************************************************************************************
skipping: [dhcp35-76.lab.eng.blr.redhat.com]
skipping: [dhcp35-21.lab.eng.blr.redhat.com]
skipping: [dhcp35-63.lab.eng.blr.redhat.com]
skipping: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [Check if corosync is installed] ********************************************************************************************************************************************************************************************************
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]
changed: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [fail] **********************************************************************************************************************************************************************************************************************************
skipping: [dhcp35-76.lab.eng.blr.redhat.com]
skipping: [dhcp35-21.lab.eng.blr.redhat.com]
skipping: [dhcp35-63.lab.eng.blr.redhat.com]
skipping: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [Check if pacemaker is installed] *******************************************************************************************************************************************************************************************************
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]
changed: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [fail] **********************************************************************************************************************************************************************************************************************************
skipping: [dhcp35-76.lab.eng.blr.redhat.com]
skipping: [dhcp35-21.lab.eng.blr.redhat.com]
skipping: [dhcp35-63.lab.eng.blr.redhat.com]
skipping: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [Check if libntirpc is installed] *******************************************************************************************************************************************************************************************************
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-134.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]

TASK [fail] **********************************************************************************************************************************************************************************************************************************
skipping: [dhcp35-76.lab.eng.blr.redhat.com]
skipping: [dhcp35-21.lab.eng.blr.redhat.com]
skipping: [dhcp35-63.lab.eng.blr.redhat.com]
skipping: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [Check if pcs is installed] *************************************************************************************************************************************************************************************************************
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]
changed: [dhcp35-134.lab.eng.blr.redhat.com]

TASK [fail] **********************************************************************************************************************************************************************************************************************************
skipping: [dhcp35-76.lab.eng.blr.redhat.com]
skipping: [dhcp35-21.lab.eng.blr.redhat.com]
skipping: [dhcp35-63.lab.eng.blr.redhat.com]
skipping: [dhcp35-134.lab.eng.blr.redhat.com]

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-134.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0    skipped=5    rescued=0    ignored=0   
dhcp35-21.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0    skipped=5    rescued=0    ignored=0   
dhcp35-63.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0    skipped=5    rescued=0    ignored=0   
dhcp35-76.lab.eng.blr.redhat.com : ok=5    changed=5    unreachable=0    failed=0    skipped=5    rescued=0    ignored=0   


PLAY [cluster_nodes] *************************************************************************************************************************************************************************************************************************

TASK [Stop kernel NFS] ***********************************************************************************************************************************************************************************************************************
fatal: [dhcp35-21.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "Could not find the requested service nfs: host"}
fatal: [dhcp35-63.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "Could not find the requested service nfs: host"}
fatal: [dhcp35-76.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "Could not find the requested service nfs: host"}
fatal: [dhcp35-134.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "Could not find the requested service nfs: host"}

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-134.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-21.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-63.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-76.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   

Ignoring errors...

PLAY [master_node] ***************************************************************************************************************************************************************************************************************************

TASK [Generate ssh key in one of the nodes in HA cluster] ************************************************************************************************************************************************************************************
changed: [dhcp35-76.lab.eng.blr.redhat.com]

TASK [Copy the public key to the local] ******************************************************************************************************************************************************************************************************
changed: [dhcp35-76.lab.eng.blr.redhat.com]

TASK [Copy the private key to the local] *****************************************************************************************************************************************************************************************************
changed: [dhcp35-76.lab.eng.blr.redhat.com]

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-76.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   


PLAY [gluster_servers] ***********************************************************************************************************************************************************************************************************************

TASK [Copy the public key to remote nodes] ***************************************************************************************************************************************************************************************************
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=dhcp35-76.lab.eng.blr.redhat.com)
changed: [dhcp35-21.lab.eng.blr.redhat.com] => (item=dhcp35-76.lab.eng.blr.redhat.com)
changed: [dhcp35-134.lab.eng.blr.redhat.com] => (item=dhcp35-76.lab.eng.blr.redhat.com)
changed: [dhcp35-63.lab.eng.blr.redhat.com] => (item=dhcp35-76.lab.eng.blr.redhat.com)

TASK [Copy the private key to remote node] ***************************************************************************************************************************************************************************************************
ok: [dhcp35-76.lab.eng.blr.redhat.com] => (item=dhcp35-76.lab.eng.blr.redhat.com)
changed: [dhcp35-21.lab.eng.blr.redhat.com] => (item=dhcp35-76.lab.eng.blr.redhat.com)
changed: [dhcp35-63.lab.eng.blr.redhat.com] => (item=dhcp35-76.lab.eng.blr.redhat.com)
changed: [dhcp35-134.lab.eng.blr.redhat.com] => (item=dhcp35-76.lab.eng.blr.redhat.com)

TASK [Deploy the pubkey ~/root/.ssh/authorized_keys on all nodes] ****************************************************************************************************************************************************************************
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-134.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-134.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-21.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-63.lab.eng.blr.redhat.com : ok=3    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-76.lab.eng.blr.redhat.com : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   


PLAY [master_node] ***************************************************************************************************************************************************************************************************************************

TASK [Make the volume a gluster shared volume] ***********************************************************************************************************************************************************************************************
fatal: [dhcp35-76.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "volume set: failed: Shared storage volume(gluster_shared_storage) already exists.\n"}
...ignoring

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-76.lab.eng.blr.redhat.com : ok=1    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=1   


PLAY [gluster_servers] ***********************************************************************************************************************************************************************************************************************

TASK [Create a user hacluster in all the cluster nodes if not already present] ***************************************************************************************************************************************************************
ok: [dhcp35-76.lab.eng.blr.redhat.com]
ok: [dhcp35-21.lab.eng.blr.redhat.com]
ok: [dhcp35-134.lab.eng.blr.redhat.com]
ok: [dhcp35-63.lab.eng.blr.redhat.com]

TASK [Set the hacluster user the same password on all machines] ******************************************************************************************************************************************************************************
changed: [dhcp35-21.lab.eng.blr.redhat.com]
changed: [dhcp35-76.lab.eng.blr.redhat.com]
changed: [dhcp35-134.lab.eng.blr.redhat.com]
changed: [dhcp35-63.lab.eng.blr.redhat.com]

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-134.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-21.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-63.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
dhcp35-76.lab.eng.blr.redhat.com : ok=2    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   


PLAY [gluster_servers] ***********************************************************************************************************************************************************************************************************************

TASK [Pcs cluster authenticate the hacluster users in all the nodes] *************************************************************************************************************************************************************************
failed: [dhcp35-21.lab.eng.blr.redhat.com] (item=dhcp35-76.lab.eng.blr.redhat.com) => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-76.lab.eng.blr.redhat.com", "delta": "0:00:00.579055", "end": "2020-03-24 05:38:52.467257", "item": "dhcp35-76.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:51.888202", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-76.lab.eng.blr.redhat.com] (item=dhcp35-76.lab.eng.blr.redhat.com) => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-76.lab.eng.blr.redhat.com", "delta": "0:00:00.609376", "end": "2020-03-24 05:38:52.512244", "item": "dhcp35-76.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:51.902868", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-63.lab.eng.blr.redhat.com] (item=dhcp35-76.lab.eng.blr.redhat.com) => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-76.lab.eng.blr.redhat.com", "delta": "0:00:00.604469", "end": "2020-03-24 05:38:52.507350", "item": "dhcp35-76.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:51.902881", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-134.lab.eng.blr.redhat.com] (item=dhcp35-76.lab.eng.blr.redhat.com) => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-76.lab.eng.blr.redhat.com", "delta": "0:00:00.634087", "end": "2020-03-24 05:38:52.552273", "item": "dhcp35-76.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:51.918186", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-21.lab.eng.blr.redhat.com] (item=dhcp35-21.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-21.lab.eng.blr.redhat.com", "delta": "0:00:00.597802", "end": "2020-03-24 05:38:53.717343", "item": "dhcp35-21.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:53.119541", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-76.lab.eng.blr.redhat.com] (item=dhcp35-21.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-21.lab.eng.blr.redhat.com", "delta": "0:00:00.586898", "end": "2020-03-24 05:38:53.754107", "item": "dhcp35-21.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:53.167209", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-63.lab.eng.blr.redhat.com] (item=dhcp35-21.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-21.lab.eng.blr.redhat.com", "delta": "0:00:00.618937", "end": "2020-03-24 05:38:53.792410", "item": "dhcp35-21.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:53.173473", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-134.lab.eng.blr.redhat.com] (item=dhcp35-21.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-21.lab.eng.blr.redhat.com", "delta": "0:00:00.606671", "end": "2020-03-24 05:38:53.820032", "item": "dhcp35-21.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:53.213361", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-21.lab.eng.blr.redhat.com] (item=dhcp35-63.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-63.lab.eng.blr.redhat.com", "delta": "0:00:00.594849", "end": "2020-03-24 05:38:54.940091", "item": "dhcp35-63.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:54.345242", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-76.lab.eng.blr.redhat.com] (item=dhcp35-63.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-63.lab.eng.blr.redhat.com", "delta": "0:00:00.596537", "end": "2020-03-24 05:38:54.997545", "item": "dhcp35-63.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:54.401008", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-63.lab.eng.blr.redhat.com] (item=dhcp35-63.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-63.lab.eng.blr.redhat.com", "delta": "0:00:00.607263", "end": "2020-03-24 05:38:55.038953", "item": "dhcp35-63.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:54.431690", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-134.lab.eng.blr.redhat.com] (item=dhcp35-63.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-63.lab.eng.blr.redhat.com", "delta": "0:00:00.601191", "end": "2020-03-24 05:38:55.048512", "item": "dhcp35-63.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:54.447321", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-21.lab.eng.blr.redhat.com] (item=dhcp35-134.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-134.lab.eng.blr.redhat.com", "delta": "0:00:00.599537", "end": "2020-03-24 05:38:56.172874", "item": "dhcp35-134.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:55.573337", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-76.lab.eng.blr.redhat.com] (item=dhcp35-134.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-134.lab.eng.blr.redhat.com", "delta": "0:00:00.590288", "end": "2020-03-24 05:38:56.243517", "item": "dhcp35-134.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:55.653229", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-134.lab.eng.blr.redhat.com] (item=dhcp35-134.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-134.lab.eng.blr.redhat.com", "delta": "0:00:00.605783", "end": "2020-03-24 05:38:56.304352", "item": "dhcp35-134.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:55.698569", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}
failed: [dhcp35-63.lab.eng.blr.redhat.com] (item=dhcp35-134.lab.eng.blr.redhat.com) => {"ansible_loop_var": "item", "changed": true, "cmd": "pcs cluster auth -u hacluster -p hacluster dhcp35-134.lab.eng.blr.redhat.com", "delta": "0:00:00.620029", "end": "2020-03-24 05:38:56.309080", "item": "dhcp35-134.lab.eng.blr.redhat.com", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:55.689051", "stderr": "", "stderr_lines": [], "stdout": "\nUsage: pcs cluster auth...\n    auth [-u <username>] [-p <password>]\n        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster.", "stdout_lines": ["", "Usage: pcs cluster auth...", "    auth [-u <username>] [-p <password>]", "        Authenticate pcs/pcsd to pcsd on nodes configured in the local cluster."]}

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-134.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-21.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-63.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-76.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   

Ignoring errors...

PLAY [master_node] ***************************************************************************************************************************************************************************************************************************

TASK [Create configuration directory for nfs-ganesha] ****************************************************************************************************************************************************************************************
ok: [dhcp35-76.lab.eng.blr.redhat.com]

TASK [Copy ganesha.conf to config directory on shared volume] ********************************************************************************************************************************************************************************
fatal: [dhcp35-76.lab.eng.blr.redhat.com]: FAILED! => {"changed": true, "cmd": "cp -rf /etc/ganesha/* \"/var/run/gluster/shared_storage/nfs-ganesha\"", "delta": "0:00:00.032095", "end": "2020-03-24 05:38:59.763782", "msg": "non-zero return code", "rc": 1, "start": "2020-03-24 05:38:59.731687", "stderr": "cp: '/etc/ganesha/ganesha.conf' and '/var/run/gluster/shared_storage/nfs-ganesha/ganesha.conf' are the same file", "stderr_lines": ["cp: '/etc/ganesha/ganesha.conf' and '/var/run/gluster/shared_storage/nfs-ganesha/ganesha.conf' are the same file"], "stdout": "", "stdout_lines": []}

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-76.lab.eng.blr.redhat.com : ok=1    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   

Ignoring errors...

PLAY [gluster_servers] ***********************************************************************************************************************************************************************************************************************

TASK [Define service port] *******************************************************************************************************************************************************************************************************************
fatal: [dhcp35-21.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "Destination /etc/sysconfig/nfs does not exist !", "rc": 257}
fatal: [dhcp35-134.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "Destination /etc/sysconfig/nfs does not exist !", "rc": 257}
fatal: [dhcp35-76.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "Destination /etc/sysconfig/nfs does not exist !", "rc": 257}
fatal: [dhcp35-63.lab.eng.blr.redhat.com]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "msg": "Destination /etc/sysconfig/nfs does not exist !", "rc": 257}

PLAY RECAP ***********************************************************************************************************************************************************************************************************************************
dhcp35-134.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-21.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-63.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
dhcp35-76.lab.eng.blr.redhat.com : ok=0    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   

Ignoring errors...

PLAY [master_node] ***************************************************************************************************************************************************************************************************************************

TASK [Enable nfs-ganesha] ********************************************************************************************************************************************************************************************************************
Comment 8 Manisha Saini 2020-04-07 19:42:21 UTC 
Verification of this BZ is blocked until the fix for BZ 1821907 is available
Comment 10 Manisha Saini 2020-04-20 19:49:17 UTC 
Verified this BZ with

# rpm -qa | grep gdeploy
gdeploy-3.0.0-6.el8rhgs.noarch


# rpm -qa | grep ganesha
nfs-ganesha-gluster-2.7.3-13.el8rhgs.x86_64
nfs-ganesha-debuginfo-2.7.3-13.el8rhgs.x86_64
nfs-ganesha-2.7.3-13.el8rhgs.x86_64
nfs-ganesha-selinux-2.7.3-13.el8rhgs.noarch
nfs-ganesha-debugsource-2.7.3-13.el8rhgs.x86_64
glusterfs-ganesha-6.0-32.el8rhgs.x86_64
nfs-ganesha-gluster-debuginfo-2.7.3-13.el8rhgs.x86_64


Latest pcs changes wrt RHEL8 are now Incorporated in Gdeploy setup part .Ganesha Setup is successful via gdeploy. Moving this BZ to verified state
Comment 12 errata-xmlrpc 2020-06-16 05:56:04 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2020:2577