Bug 361371 - RHEL5U1beta: reboot service cman on one node can cause inconsistent cluster status.
RHEL5U1beta: reboot service cman on one node can cause inconsistent cluster s...
Status: CLOSED INSUFFICIENT_DATA
Product: Red Hat Enterprise Linux 5
Classification: Red Hat
Component: cman (Show other bugs)
5.0
All Linux
high Severity high
: ---
: ---
Assigned To: Christine Caulfield
Cluster QE
:
Depends On:
Blocks:
  Show dependency treegraph
 
Reported: 2007-11-01 04:41 EDT by Zhenyong(Jerry) Jiang
Modified: 2013-07-28 20:44 EDT (History)
2 users (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed: 2008-07-07 10:54:00 EDT
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)
message from gfs1 (182.20 KB, text/plain)
2007-11-05 04:15 EST, Zhenyong(Jerry) Jiang
no flags Details
message from gfs2 (171.54 KB, text/plain)
2007-11-05 04:16 EST, Zhenyong(Jerry) Jiang
no flags Details

  None (edit)
Description Zhenyong(Jerry) Jiang 2007-11-01 04:41:22 EDT
Description of problem:


Version-Release number of selected component (if applicable):


How reproducible:

Always

Steps to Reproduce:

1. setup a tow-nodes cluster on RHEL5U1beta,(or RHEL5GA) 

2. make sure the cluster status is ok on both nodes.

3. restart service cman on node-a ( /etc/init.d/cman restart )

4. check the cluster status on both nodes, the command of clustat will show
different status.
  
Actual results:

node-a(in my example, it called gfs1)

  Member Name                        ID   Status
  ------ ----                        ---- ------
  gfs1                                  1 Online
  gfs2                                  2 Online


node-b(in my example, it called gfs2)

  Member Name                        ID   Status
  ------ ----                        ---- ------
  gfs1                                  1 Offline
  gfs2                                  2 Online

Expected results:

I think the status should be same.

Additional info:
Comment 1 Christine Caulfield 2007-11-01 04:57:12 EDT
Can you post the output of 'cman_tool status' and 'cman_tool nodes' from bothe
systems please ?
Comment 2 Zhenyong(Jerry) Jiang 2007-11-05 04:12:02 EST
I restart cman on gfs1.

[root@gfs1 ~]# clustat 
msg_open: No such file or directory
Member Status: Quorate

  Member Name                        ID   Status
  ------ ----                        ---- ------
  gfs1                                  1 Online, Local
  gfs2                                  2 Online

[root@gfs1 ~]# 
[root@gfs1 ~]# 
[root@gfs1 ~]# 
[root@gfs1 ~]#  > /var/log/messages
[root@gfs1 ~]# /etc/init.d/cman restart
Stopping cluster: 
   Stopping fencing... done
   Stopping cman... done
   Stopping ccsd... done
   Unmounting configfs... done
                                                           [  OK  ]
Starting cluster: 
   Loading modules... done
   Mounting configfs... done
   Starting ccsd... done
   Starting cman... done
   Starting daemons... done
   Starting fencing... done
                                                           [  OK  ]
[root@gfs1 ~]# clustat
msg_open: No such file or directory
Member Status: Quorate

  Member Name                        ID   Status
  ------ ----                        ---- ------
  gfs1                                  1 Online, Local
  gfs2                                  2 Online

[root@gfs1 ~]# 



And this is shown on gfs2.

[root@gfs2 ~]# clustat 
msg_open: No such file or directory
Member Status: Quorate

  Member Name                        ID   Status
  ------ ----                        ---- ------
  gfs1                                  1 Online
  gfs2                                  2 Online, Local

[root@gfs2 ~]# << At this time, cman was restarted on gfs1 >>
[root@gfs2 ~]# clustat 
msg_open: No such file or directory
Member Status: Quorate

  Member Name                        ID   Status
  ------ ----                        ---- ------
  gfs1                                  1 Online
  gfs2                                  2 Online, Local
Comment 3 Zhenyong(Jerry) Jiang 2007-11-05 04:15:52 EST
Created attachment 247811 [details]
message from gfs1

message from gfs1
Comment 4 Zhenyong(Jerry) Jiang 2007-11-05 04:16:31 EST
Created attachment 247821 [details]
message from gfs2

message from gfs2
Comment 5 Christine Caulfield 2007-11-05 04:27:06 EST
I really need the cman_tool outputs. This was I can determine whether the
problem is in cman itself, or clustat/rgmanager.

The logs you have provided hint that openais is not at fault, but it's hard to
tell without the cman_tool information.

Note You need to log in before you can comment on or make changes to this bug.