Bug 1228626
Summary: | nfs-ganesha: add node fails to add a new node to the cluster | ||||||||
---|---|---|---|---|---|---|---|---|---|
Product: | [Red Hat Storage] Red Hat Gluster Storage | Reporter: | Saurabh <saujain> | ||||||
Component: | nfs-ganesha | Assignee: | Meghana <mmadhusu> | ||||||
Status: | CLOSED ERRATA | QA Contact: | Saurabh <saujain> | ||||||
Severity: | urgent | Docs Contact: | |||||||
Priority: | high | ||||||||
Version: | rhgs-3.1 | CC: | annair, kkeithle, mmadhusu, mzywusko, nlevinki, rcyriac, skoduri, vagarwal | ||||||
Target Milestone: | --- | ||||||||
Target Release: | RHGS 3.1.0 | ||||||||
Hardware: | x86_64 | ||||||||
OS: | Linux | ||||||||
Whiteboard: | |||||||||
Fixed In Version: | glusterfs-3.7.1-5 | Doc Type: | Bug Fix | ||||||
Doc Text: | Story Points: | --- | |||||||
Clone Of: | |||||||||
: | 1233246 (view as bug list) | Environment: | |||||||
Last Closed: | 2015-07-29 04:58:14 UTC | Type: | Bug | ||||||
Regression: | --- | Mount Type: | --- | ||||||
Documentation: | --- | CRM: | |||||||
Verified Versions: | Category: | --- | |||||||
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||
Cloudforms Team: | --- | Target Upstream Version: | |||||||
Embargoed: | |||||||||
Bug Depends On: | |||||||||
Bug Blocks: | 1202842, 1233246, 1234216 | ||||||||
Attachments: |
|
Description
Saurabh
2015-06-05 10:49:50 UTC
providing pcs status, Cluster name: new-ganesha Last updated: Fri Jun 5 21:46:24 2015 Last change: Fri Jun 5 21:28:14 2015 Stack: cman Current DC: nfs5 - partition with quorum Version: 1.1.11-97629de 4 Nodes configured 18 Resources configured Online: [ nfs5 nfs6 nfs7 nfs8 ] Full list of resources: Clone Set: nfs-mon-clone [nfs-mon] Started: [ nfs5 nfs6 nfs7 nfs8 ] Clone Set: nfs-grace-clone [nfs-grace] Started: [ nfs5 nfs6 nfs7 nfs8 ] nfs9-cluster_ip-1 (ocf::heartbeat:IPaddr): FAILED (unmanaged) [ nfs5 nfs6 nfs7 nfs8 ] nfs9-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs5 nfs5-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs5 nfs5-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs5 nfs6-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs6 nfs6-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs6 nfs7-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs7 nfs7-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs7 nfs8-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs8 nfs8-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs8 Failed actions: nfs9-cluster_ip-1_stop_0 on nfs5 'not configured' (6): call=85, status=complete, last-rc-change='Fri Jun 5 21:28:16 2015', queued=0ms, exec=49ms nfs9-cluster_ip-1_stop_0 on nfs5 'not configured' (6): call=85, status=complete, last-rc-change='Fri Jun 5 21:28:16 2015', queued=0ms, exec=49ms nfs9-cluster_ip-1_stop_0 on nfs6 'not configured' (6): call=81, status=complete, last-rc-change='Fri Jun 5 21:28:17 2015', queued=0ms, exec=88ms nfs9-cluster_ip-1_stop_0 on nfs6 'not configured' (6): call=81, status=complete, last-rc-change='Fri Jun 5 21:28:17 2015', queued=0ms, exec=88ms nfs9-cluster_ip-1_stop_0 on nfs7 'not configured' (6): call=81, status=complete, last-rc-change='Fri Jun 5 21:28:16 2015', queued=0ms, exec=63ms nfs9-cluster_ip-1_stop_0 on nfs7 'not configured' (6): call=81, status=complete, last-rc-change='Fri Jun 5 21:28:16 2015', queued=0ms, exec=63ms nfs9-cluster_ip-1_stop_0 on nfs8 'not configured' (6): call=81, status=complete, last-rc-change='Fri Jun 5 21:28:16 2015', queued=0ms, exec=91ms nfs9-cluster_ip-1_stop_0 on nfs8 'not configured' (6): call=81, status=complete, last-rc-change='Fri Jun 5 21:28:16 2015', queued=0ms, exec=91ms Created attachment 1035167 [details]
sosreport of nfs5
Created attachment 1035168 [details]
sosreport of nfs9
This patch has been posted upstream and is under review. based on the test that I did moving this BZ to verified, here are the logs, [root@nfs11 ~]# time bash /usr/libexec/ganesha/ganesha-ha.sh --add /etc/ganesha nfs16 10.70.44.96 ganesha.conf 100% 1329 1.3KB/s 00:00 tmp.CBWq1Awsbc 100% 1329 1.3KB/s 00:00 Starting ganesha.nfsd: [ OK ] nfs11: Corosync updated nfs12: Corosync updated nfs13: Corosync updated nfs14: Corosync updated nfs16: Updated cluster.conf... Adding nfs_start-nfs16 nfs-mon-clone (kind: Mandatory) (Options: first-action=start then-action=start) CIB updated nfs16: Starting Cluster... Removing Constraint - location-nfs_start-nfs16-nfs16-INFINITY Removing Constraint - order-nfs_start-nfs16-nfs-mon-clone-mandatory Attempting to stop: nfs_start-nfs16...Stopped Deleting Resource - nfs_start-nfs16 Removing Constraint - colocation-nfs11-cluster_ip-1-nfs11-trigger_ip-1-INFINITY Removing Constraint - location-nfs11-cluster_ip-1 Removing Constraint - location-nfs11-cluster_ip-1-nfs12-1000 Removing Constraint - location-nfs11-cluster_ip-1-nfs13-2000 Removing Constraint - location-nfs11-cluster_ip-1-nfs14-3000 Removing Constraint - location-nfs11-cluster_ip-1-nfs11-4000 Removing Constraint - order-nfs-grace-clone-nfs11-cluster_ip-1-mandatory Deleting Resource - nfs11-cluster_ip-1 Removing Constraint - order-nfs11-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs11-trigger_ip-1 Removing Constraint - colocation-nfs12-cluster_ip-1-nfs12-trigger_ip-1-INFINITY Removing Constraint - location-nfs12-cluster_ip-1 Removing Constraint - location-nfs12-cluster_ip-1-nfs13-1000 Removing Constraint - location-nfs12-cluster_ip-1-nfs14-2000 Removing Constraint - location-nfs12-cluster_ip-1-nfs11-3000 Removing Constraint - location-nfs12-cluster_ip-1-nfs12-4000 Removing Constraint - order-nfs-grace-clone-nfs12-cluster_ip-1-mandatory Deleting Resource - nfs12-cluster_ip-1 Removing Constraint - order-nfs12-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs12-trigger_ip-1 Removing Constraint - colocation-nfs13-cluster_ip-1-nfs13-trigger_ip-1-INFINITY Removing Constraint - location-nfs13-cluster_ip-1 Removing Constraint - location-nfs13-cluster_ip-1-nfs14-1000 Removing Constraint - location-nfs13-cluster_ip-1-nfs11-2000 Removing Constraint - location-nfs13-cluster_ip-1-nfs12-3000 Removing Constraint - location-nfs13-cluster_ip-1-nfs13-4000 Removing Constraint - order-nfs-grace-clone-nfs13-cluster_ip-1-mandatory Deleting Resource - nfs13-cluster_ip-1 Removing Constraint - order-nfs13-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs13-trigger_ip-1 Removing Constraint - colocation-nfs14-cluster_ip-1-nfs14-trigger_ip-1-INFINITY Removing Constraint - location-nfs14-cluster_ip-1 Removing Constraint - location-nfs14-cluster_ip-1-nfs11-1000 Removing Constraint - location-nfs14-cluster_ip-1-nfs12-2000 Removing Constraint - location-nfs14-cluster_ip-1-nfs13-3000 Removing Constraint - location-nfs14-cluster_ip-1-nfs14-4000 Removing Constraint - order-nfs-grace-clone-nfs14-cluster_ip-1-mandatory Deleting Resource - nfs14-cluster_ip-1 Removing Constraint - order-nfs14-trigger_ip-1-nfs-grace-clone-mandatory Deleting Resource - nfs14-trigger_ip-1 Adding nfs11-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs11-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs12-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs12-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs13-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs13-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs14-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs14-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs16-trigger_ip-1 nfs-grace-clone (kind: Mandatory) (Options: first-action=start then-action=start) Adding nfs-grace-clone nfs16-cluster_ip-1 (kind: Mandatory) (Options: first-action=start then-action=start) CIB updated ganesha-ha.conf 100% 922 0.9KB/s 00:00 ganesha-ha.conf 100% 922 0.9KB/s 00:00 ganesha-ha.conf 100% 922 0.9KB/s 00:00 ganesha-ha.conf 100% 922 0.9KB/s 00:00 ganesha-ha.conf 100% 922 0.9KB/s 00:00 real 0m58.806s user 0m18.423s sys 0m5.517s [root@nfs11 ~]# pcs status Cluster name: nozomer Last updated: Sun Jul 5 16:21:03 2015 Last change: Sun Jul 5 16:18:39 2015 Stack: cman Current DC: nfs11 - partition with quorum Version: 1.1.11-97629de 5 Nodes configured 20 Resources configured Online: [ nfs11 nfs12 nfs13 nfs14 nfs16 ] Full list of resources: Clone Set: nfs-mon-clone [nfs-mon] Started: [ nfs11 nfs12 nfs13 nfs14 nfs16 ] Clone Set: nfs-grace-clone [nfs-grace] Started: [ nfs11 nfs12 nfs13 nfs14 nfs16 ] nfs11-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs11 nfs11-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs11 nfs12-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs12 nfs12-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs12 nfs13-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs13 nfs13-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs13 nfs14-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs14 nfs14-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs14 nfs16-cluster_ip-1 (ocf::heartbeat:IPaddr): Started nfs16 nfs16-trigger_ip-1 (ocf::heartbeat:Dummy): Started nfs16 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHSA-2015-1495.html |