Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
For bugs related to Red Hat Enterprise Linux 5 product line. The current stable release is 5.10. For Red Hat Enterprise Linux 6 and above, please visit Red Hat JIRA https://issues.redhat.com/secure/CreateIssue!default.jspa?pid=12332745 to report new issues.

Bug 575952

Summary: fenced post_join_delay doesn't help after quorum is restored
Product: Red Hat Enterprise Linux 5 Reporter: David Teigland <teigland>
Component: cmanAssignee: David Teigland <teigland>
Status: CLOSED ERRATA QA Contact: Cluster QE <mspqa-list>
Severity: medium Docs Contact:
Priority: low    
Version: 5.6CC: cluster-maint, djansa, iannis, nstraz
Target Milestone: rc   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: cman-2.0.115-51.el5 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2011-01-13 22:32:38 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
patch
none
patch none

Description David Teigland 2010-03-22 19:34:29 UTC 
Description of problem:

Found here:
https://bugzilla.redhat.com/show_bug.cgi?id=469212#c7

1,2,3,4,5,6,7,8 are members and in fence domain
5,6,7,8 fail
1,2,3,4 lose quorum
5 rejoins cluster, quorum restored
1,2,3,4 fenced starts fencing node 8
8 rejoins cluster
8 fails from being fenced

Ordinarily we'd expect post_join_delay to allow 8 to rejoin and avoid being fenced, but in this case the last group-level event is the failure of 5,6,7,8,
so post_fail_delay is used instead.  I think past testing has included a positive post_fail_delay which probably masked this unexpected behavior.

post_join_delay was designed primarily to distinguish cluster startup from normal failures, but it would be nice to expand on the logic to detect the case above where we are regaining quorum due to a node joining the cluster.


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.
  
Actual results:


Expected results:


Additional info:
Comment 1 David Teigland 2010-08-05 22:14:22 UTC 
Created attachment 436991 [details]
patch

This makes fenced use post_join_delay after a node joins the cluster giving it
quorum.  I've not done any testing of it.
Comment 2 David Teigland 2010-08-16 22:14:48 UTC 
The patch in comment 1 doesn't work; working on a new one.
Comment 3 David Teigland 2010-08-17 18:51:17 UTC 
Created attachment 439188 [details]
patch

fix
Comment 4 David Teigland 2010-08-17 18:55:42 UTC 
Test:

<fence_daemon post_join_delay="20" post_fail_delay="0"/>

nodes 1,2,3: service cman start
nodes 2,3: killall -9 aisexec
node1: wait to see 2&3 dead
node2: service cman start
wait 5 seconds
node1: ensure group_tool | grep fence shows FAIL_START_WAIT
node3: service cman start
node1: verify node3 was not fenced
Comment 5 David Teigland 2010-08-17 19:55:15 UTC 
pushed to RHEL56 branch
http://git.fedorahosted.org/git?p=cluster.git;a=commitdiff;h=0fc5da5fdc190ed50e94640136fea177a900ea57
Comment 6 David Teigland 2010-08-17 19:59:32 UTC 
*** Bug 469212 has been marked as a duplicate of this bug. ***
Comment 9 errata-xmlrpc 2011-01-13 22:32:38 UTC 
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHBA-2011-0036.html