Description of problem: On the latest I was trying the delete node from ganesha cluster and I have seen an error Error: unable to create resource/fence device 'nfs5-cluster_ip-1', 'nfs5-cluster_ip-1' already exists on this system Version-Release number of selected component (if applicable): glusterfs-3.7.0-3.el6rhs.x86_64 nfs-ganesha-2.2.0-0.el6.x86_64 How reproducible: Steps to Reproduce: 1. create a volume of 6x2 type 2. start nfs-ganesha after doing all the pre-requisites 3. start some I/O on mount-point, post mounting the volume with vers=4 4. delete a ganesha node from the existing cluster Actual results: step4 result, delete node finishes with some errors seen on stdout, [root@nfs5 ~]# time /usr/libexec/ganesha/ganesha-ha.sh --delete /etc/ganesha/ nfs8 Removing Constraint - colocation-nfs5-cluster_ip-1-nfs5-trigger_ip-1-INFINITY Removing Constraint - location-nfs5-cluster_ip-1 Removing Constraint - location-nfs5-cluster_ip-1-nfs6-1000 Removing Constraint - location-nfs5-cluster_ip-1-nfs7-2000 Removing Constraint - location-nfs5-cluster_ip-1-nfs8-3000 Removing Constraint - location-nfs5-cluster_ip-1-nfs5-4000 Removing Constraint - order-nfs-grace-clone-nfs5-cluster_ip-1-mandatory Deleting Resource - nfs5-cluster_ip-1 Removing Constraint - order-nfs5-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs5-trigger_ip-1 Removing Constraint - colocation-nfs6-cluster_ip-1-nfs6-trigger_ip-1-INFINITY Removing Constraint - location-nfs6-cluster_ip-1 Removing Constraint - location-nfs6-cluster_ip-1-nfs7-1000 Removing Constraint - location-nfs6-cluster_ip-1-nfs8-2000 Removing Constraint - location-nfs6-cluster_ip-1-nfs5-3000 Removing Constraint - location-nfs6-cluster_ip-1-nfs6-4000 Removing Constraint - order-nfs-grace-clone-nfs6-cluster_ip-1-mandatory Deleting Resource - nfs6-cluster_ip-1 Removing Constraint - order-nfs6-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs6-trigger_ip-1 Removing Constraint - colocation-nfs7-cluster_ip-1-nfs7-trigger_ip-1-INFINITY Removing Constraint - location-nfs7-cluster_ip-1 Removing Constraint - location-nfs7-cluster_ip-1-nfs8-1000 Removing Constraint - location-nfs7-cluster_ip-1-nfs5-2000 Removing Constraint - location-nfs7-cluster_ip-1-nfs6-3000 Removing Constraint - location-nfs7-cluster_ip-1-nfs7-4000 Removing Constraint - order-nfs-grace-clone-nfs7-cluster_ip-1-mandatory Deleting Resource - nfs7-cluster_ip-1 Removing Constraint - order-nfs7-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs7-trigger_ip-1 Removing Constraint - colocation-nfs8-cluster_ip-1-nfs8-trigger_ip-1-INFINITY Removing Constraint - location-nfs8-cluster_ip-1 Removing Constraint - location-nfs8-cluster_ip-1-nfs5-1000 Removing Constraint - location-nfs8-cluster_ip-1-nfs6-2000 Removing Constraint - location-nfs8-cluster_ip-1-nfs7-3000 Removing Constraint - location-nfs8-cluster_ip-1-nfs8-4000 Removing Constraint - order-nfs-grace-clone-nfs8-cluster_ip-1-mandatory Deleting Resource - nfs8-cluster_ip-1 Removing Constraint - order-nfs8-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs8-trigger_ip-1 Adding nfs5-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs5-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs6-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs6-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs7-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs7-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs8-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs8-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Error: unable to create resource/fence device 'nfs5-cluster_ip-1', 'nfs5-cluster_ip-1' already exists on this system Error: unable to create resource/fence device 'nfs5-trigger_ip-1', 'nfs5-trigger_ip-1' already exists on this system Adding nfs5-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs5-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Error: unable to create resource/fence device 'nfs6-cluster_ip-1', 'nfs6-cluster_ip-1' already exists on this system Error: unable to create resource/fence device 'nfs6-trigger_ip-1', 'nfs6-trigger_ip-1' already exists on this system Adding nfs6-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs6-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Error: unable to create resource/fence device 'nfs7-cluster_ip-1', 'nfs7-cluster_ip-1' already exists on this system Error: unable to create resource/fence device 'nfs7-trigger_ip-1', 'nfs7-trigger_ip-1' already exists on this system Adding nfs7-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs7-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) CIB updated CIB updated Removing Constraint - location-nfs_stop-nfs8-nfs8-INFINITY Deleting Resource - nfs_stop-nfs8 nfs8: Successfully destroyed cluster nfs5: Corosync updated nfs6: Corosync updated nfs7: Corosync updated /usr/libexec/ganesha/ganesha-ha.sh: line 828: manage-service: command not found Expected results: Errors mentioned above should not occur, as this may create confusion about the things Additional info:
As can be seen from the logs mentioned below, The Eroor are not seen hence moving this bz to verified. time bash /usr/libexec/ganesha/ganesha-ha.sh --delete /etc/ganesha nfs15.lab.eng.blr.redhat.com Removing Constraint - colocation-nfs11.lab.eng.blr.redhat.com-cluster_ip-1-nfs11.lab.eng.blr.redhat.com-trigger_ip-1-INFINITY Removing Constraint - location-nfs11.lab.eng.blr.redhat.com-cluster_ip-1 Removing Constraint - location-nfs11.lab.eng.blr.redhat.com-cluster_ip-1-nfs12.lab.eng.blr.redhat.com-1000 Removing Constraint - location-nfs11.lab.eng.blr.redhat.com-cluster_ip-1-nfs13.lab.eng.blr.redhat.com-2000 Removing Constraint - location-nfs11.lab.eng.blr.redhat.com-cluster_ip-1-nfs15.lab.eng.blr.redhat.com-3000 Removing Constraint - location-nfs11.lab.eng.blr.redhat.com-cluster_ip-1-nfs11.lab.eng.blr.redhat.com-4000 Removing Constraint - order-nfs-grace-clone-nfs11.lab.eng.blr.redhat.com-cluster_ip-1-mandatory Deleting Resource - nfs11.lab.eng.blr.redhat.com-cluster_ip-1 Removing Constraint - order-nfs11.lab.eng.blr.redhat.com-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs11.lab.eng.blr.redhat.com-trigger_ip-1 Removing Constraint - colocation-nfs12.lab.eng.blr.redhat.com-cluster_ip-1-nfs12.lab.eng.blr.redhat.com-trigger_ip-1-INFINITY Removing Constraint - location-nfs12.lab.eng.blr.redhat.com-cluster_ip-1 Removing Constraint - location-nfs12.lab.eng.blr.redhat.com-cluster_ip-1-nfs13.lab.eng.blr.redhat.com-1000 Removing Constraint - location-nfs12.lab.eng.blr.redhat.com-cluster_ip-1-nfs15.lab.eng.blr.redhat.com-2000 Removing Constraint - location-nfs12.lab.eng.blr.redhat.com-cluster_ip-1-nfs11.lab.eng.blr.redhat.com-3000 Removing Constraint - location-nfs12.lab.eng.blr.redhat.com-cluster_ip-1-nfs12.lab.eng.blr.redhat.com-4000 Removing Constraint - order-nfs-grace-clone-nfs12.lab.eng.blr.redhat.com-cluster_ip-1-mandatory Deleting Resource - nfs12.lab.eng.blr.redhat.com-cluster_ip-1 Removing Constraint - order-nfs12.lab.eng.blr.redhat.com-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs12.lab.eng.blr.redhat.com-trigger_ip-1 Removing Constraint - colocation-nfs13.lab.eng.blr.redhat.com-cluster_ip-1-nfs13.lab.eng.blr.redhat.com-trigger_ip-1-INFINITY Removing Constraint - location-nfs13.lab.eng.blr.redhat.com-cluster_ip-1 Removing Constraint - location-nfs13.lab.eng.blr.redhat.com-cluster_ip-1-nfs15.lab.eng.blr.redhat.com-1000 Removing Constraint - location-nfs13.lab.eng.blr.redhat.com-cluster_ip-1-nfs11.lab.eng.blr.redhat.com-2000 Removing Constraint - location-nfs13.lab.eng.blr.redhat.com-cluster_ip-1-nfs12.lab.eng.blr.redhat.com-3000 Removing Constraint - location-nfs13.lab.eng.blr.redhat.com-cluster_ip-1-nfs13.lab.eng.blr.redhat.com-4000 Removing Constraint - order-nfs-grace-clone-nfs13.lab.eng.blr.redhat.com-cluster_ip-1-mandatory Deleting Resource - nfs13.lab.eng.blr.redhat.com-cluster_ip-1 Removing Constraint - order-nfs13.lab.eng.blr.redhat.com-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs13.lab.eng.blr.redhat.com-trigger_ip-1 Removing Constraint - colocation-nfs15.lab.eng.blr.redhat.com-cluster_ip-1-nfs15.lab.eng.blr.redhat.com-trigger_ip-1-INFINITY Removing Constraint - location-nfs15.lab.eng.blr.redhat.com-cluster_ip-1 Removing Constraint - location-nfs15.lab.eng.blr.redhat.com-cluster_ip-1-nfs11.lab.eng.blr.redhat.com-1000 Removing Constraint - location-nfs15.lab.eng.blr.redhat.com-cluster_ip-1-nfs12.lab.eng.blr.redhat.com-2000 Removing Constraint - location-nfs15.lab.eng.blr.redhat.com-cluster_ip-1-nfs13.lab.eng.blr.redhat.com-3000 Removing Constraint - location-nfs15.lab.eng.blr.redhat.com-cluster_ip-1-nfs15.lab.eng.blr.redhat.com-4000 Removing Constraint - order-nfs-grace-clone-nfs15.lab.eng.blr.redhat.com-cluster_ip-1-mandatory Deleting Resource - nfs15.lab.eng.blr.redhat.com-cluster_ip-1 Removing Constraint - order-nfs15.lab.eng.blr.redhat.com-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs15.lab.eng.blr.redhat.com-trigger_ip-1 Adding nfs11.lab.eng.blr.redhat.com-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs11.lab.eng.blr.redhat.com-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs12.lab.eng.blr.redhat.com-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs12.lab.eng.blr.redhat.com-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs13.lab.eng.blr.redhat.com-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs13.lab.eng.blr.redhat.com-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) CIB updated CIB updated Removing Constraint - location-nfs_stop-nfs15.lab.eng.blr.redhat.com-nfs15.lab.eng.blr.redhat.com-INFINITY Deleting Resource - nfs_stop-nfs15.lab.eng.blr.redhat.com nfs15.lab.eng.blr.redhat.com: Stopping Cluster (pacemaker)... nfs15.lab.eng.blr.redhat.com: Successfully destroyed cluster nfs11.lab.eng.blr.redhat.com: Corosync updated nfs12.lab.eng.blr.redhat.com: Corosync updated nfs13.lab.eng.blr.redhat.com: Corosync updated ganesha-ha.conf 100% 998 1.0KB/s 00:00 ganesha-ha.conf 100% 998 1.0KB/s 00:00 Unknown operation 'nfs-ganesha'.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHSA-2015-1845.html