Bug 1299348 - service pacemaker_remote stop causes node to be fenced
Summary: service pacemaker_remote stop causes node to be fenced
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: pacemaker
Version: 7.2
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: rc
: ---
Assignee: Ken Gaillot
QA Contact: cluster-qe@redhat.com
URL:
Whiteboard:
Depends On: 1288929
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-01-18 07:50 UTC by Jan Kurik
Modified: 2016-02-16 11:18 UTC (History)
11 users (show)

Fixed In Version: pacemaker-1.1.13-10.el7_2.2
Doc Type: Enhancement
Doc Text:
The pacemaker_remote service can now be stopped on an active Pacemaker Remote node, and the cluster gracefully migrates resources off the node before stopping the node. Previously, Pacemaker Remote nodes had to be taken out of the cluster before stopping the pacemaker_remote service, either explicitly or implicitly by commands such as "yum update", otherwise the node was fenced. Now, software upgrades and other routine maintenance are significantly easier to perform on Pacemaker Remote nodes. Note that all nodes in the cluster must be upgraded to a version supporting this feature before the feature can be used on any node.
Clone Of: 1288929
Environment:
Last Closed: 2016-02-16 11:18:20 UTC
Target Upstream Version:

Attachments (Terms of Use)
Add an attachment (proposed patch, testcase, etc.)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2016:0216 0 normal SHIPPED_LIVE Pacemaker bug fix and enhancement update 2016-02-16 16:14:04 UTC

Description Jan Kurik 2016-01-18 07:50:34 UTC 
This bug has been copied from bug #1288929 and has been proposed
to be backported to 7.2 z-stream (EUS).
Comment 4 Ken Gaillot 2016-01-18 18:29:33 UTC 
QA: reproducer is to configure a cluster with a Pacemaker Remote node, then run "systemctl stop pacemaker_remote" on the node while it is in the cluster.

Previously, the node would be fenced; now, all resources will be moved off the node and it will gracefully stop. This should work the same for remote nodes (configured with ocf:pacemaker:remote resource) and guest nodes (configured with remote-node= attribute on a VM resource).
Comment 7 Ken Gaillot 2016-01-25 21:51:53 UTC 
QA: I should have mentioned, that after a graceful stop, the cluster will immediately try to connect to the remote node again. If the remote node is not accepting connections again before the start timeout, the start will fail (and move on to another node if available, and potentially time out there, too). If start times out on all nodes, the cluster will stop trying to reconnect. If a failure-timeout has been configured for the start operation, it will begin retrying again after that time.

This is necessary because all remote connections must be initiated from the cluster side, so there is no way for a newly started remote node to signal the cluster it is available. This may be changed in the future, but for now, start failures are expected if the remote node is down for an extended time -- it is only the stopping that is graceful now.
Comment 12 Ken Gaillot 2016-01-27 00:44:52 UTC 
An issue in the implementation, with the symptom of a second stop hanging, was found, and fixed upstream as of commit 942efa4. An updated build has been added to the errata.
Comment 15 errata-xmlrpc 2016-02-16 11:18:20 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2016-0216.html
Note You need to log in before you can comment on or make changes to this bug.