Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 684020

Summary: Add totem/ttl option to cluster relax-ng schema
Product: Red Hat Enterprise Linux 6 Reporter: Angus Salkeld <asalkeld>
Component: clusterAssignee: Fabio Massimo Di Nitto <fdinitto>
Status: CLOSED ERRATA QA Contact: Cluster QE <mspqa-list>
Severity: medium Docs Contact:
Priority: low    
Version: 6.1CC: agk, ccaulfie, cluster-maint, djansa, djoo, edamato, fdinitto, jkortus, jparsons, lhh, neil, rmccabe, rpeterso, sdake, teigland
Target Milestone: rc   
Target Release: 6.1   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: cluster-3.0.12-37.el6 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: 640311
: 688049 (view as bug list) Environment:
Last Closed: 2011-05-19 12:54:45 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 633415, 640311, 684305, 684928, 684930    
Bug Blocks: 688049    

Comment 1 Angus Salkeld 2011-03-10 22:21:44 UTC
Cloned (as suggested by fabio), so cluster can modify the schema to allow the new ttl option.

Comment 2 Fabio Massimo Di Nitto 2011-03-11 04:29:52 UTC
Lon please hold a sec on this one. I think there is a bug in cman preconfig that would prevent this to work forever. See #640311 comment 9.

I'll try to finish my investigation by end of today.

Comment 3 Fabio Massimo Di Nitto 2011-03-11 09:53:10 UTC
Confirmed the issue in #640311 comment 9 and 10.

Comment 4 Fabio Massimo Di Nitto 2011-03-11 11:32:50 UTC
Need info from 640311. I have patches ready for both cases, need to know the correct one, based on feedback.

Comment 5 Fabio Massimo Di Nitto 2011-03-11 18:29:06 UTC
*** Bug 684305 has been marked as a duplicate of this bug. ***

Comment 6 Fabio Massimo Di Nitto 2011-03-15 08:11:06 UTC
http://git.fedorahosted.org/git/?p=cluster.git;a=commitdiff;h=0f5af364300d3ddb2de2428de2f169be917a3c15

Patch is now upstream, based on agreements from other related BZs.

TTL in cman is configured as:

<cman...>
 <multicast ttl="value"/>
</cman>

and relaxng schema is updated to reflect that.

Tested in a 2 nodes cluster (one node i686 and one x86_64) with corosync + ttl patches and cman with this patch:

  <cman>
   <multicast ttl="0"/>
  </cman>

[root@fedora14-node1 ~]# cman_tool status
Version: 6.2.0
Config Version: 2
Cluster Name: fabbione
Cluster Id: 25573
Cluster Member: Yes
Cluster Generation: 84
Membership state: Cluster-Member
Nodes: 1
Expected votes: 2
Total votes: 1
Node votes: 1
Quorum: 2 Activity blocked
Active subsystems: 1
Flags: 
Ports Bound: 0  
Node name: fedora14-node1
Node ID: 1
Multicast addresses: 239.192.99.73 
Node addresses: 192.168.2.97 

Version: 6.2.0
Config Version: 2
Cluster Name: fabbione
Cluster Id: 25573
Cluster Member: Yes
Cluster Generation: 88
Membership state: Cluster-Member
Nodes: 1
Expected votes: 2
Total votes: 1
Node votes: 1
Quorum: 2 Activity blocked
Active subsystems: 1
Flags: 
Ports Bound: 0  
Node name: fedora14-node2
Node ID: 2
Multicast addresses: 239.192.99.73 
Node addresses: 192.168.2.98 

As expected with ttl=0 nodes do not join the cluster as multicast traffic is only local.

[root@fedora14-node1 ~]# corosync-objctl |grep ttl
cluster.cman.multicast.ttl=0
totem.interface.ttl=0

[root@fedora14-node2 ~]# corosync-objctl |grep ttl
cluster.cman.multicast.ttl=0
totem.interface.ttl=0

and key is propagated down to the totem interface config.

  <cman>
   <multicast ttl="1"/>
  </cman>

[root@fedora14-node1 ~]# cman_tool status 
Version: 6.2.0
Config Version: 2
Cluster Name: fabbione
Cluster Id: 25573
Cluster Member: Yes
Cluster Generation: 92
Membership state: Cluster-Member
Nodes: 2
Expected votes: 2
Total votes: 2
Node votes: 1
Quorum: 2  
Active subsystems: 1
Flags: 
Ports Bound: 0  
Node name: fedora14-node1
Node ID: 1
Multicast addresses: 239.192.99.73 
Node addresses: 192.168.2.97 
[root@fedora14-node1 ~]# 

[root@fedora14-node2 ~]# cman_tool status 
Version: 6.2.0
Config Version: 2
Cluster Name: fabbione
Cluster Id: 25573
Cluster Member: Yes
Cluster Generation: 92
Membership state: Cluster-Member
Nodes: 2
Expected votes: 2
Total votes: 2
Node votes: 1
Quorum: 2  
Active subsystems: 1
Flags: 
Ports Bound: 0  
Node name: fedora14-node2
Node ID: 2
Multicast addresses: 239.192.99.73 
Node addresses: 192.168.2.98 
[root@fedora14-node2 ~]# 

as expected, nodes join the cluster

[root@fedora14-node2 ~]# corosync-objctl |grep ttl
cluster.cman.multicast.ttl=1

default value is not propagated down as it is unnecessary operation.

  <cman>
   <multicast ttl="255"/>
  </cman>

Version: 6.2.0
Config Version: 2
Cluster Name: fabbione
Cluster Id: 25573
Cluster Member: Yes
Cluster Generation: 100
Membership state: Cluster-Member
Nodes: 2
Expected votes: 2
Total votes: 2
Node votes: 1
Quorum: 2  
Active subsystems: 1
Flags: 
Ports Bound: 0  
Node name: fedora14-node1
Node ID: 1
Multicast addresses: 239.192.99.73 
Node addresses: 192.168.2.97 

[root@fedora14-node2 ~]# cman_tool status
Version: 6.2.0
Config Version: 2
Cluster Name: fabbione
Cluster Id: 25573
Cluster Member: Yes
Cluster Generation: 100
Membership state: Cluster-Member
Nodes: 2
Expected votes: 2
Total votes: 2
Node votes: 1
Quorum: 2  
Active subsystems: 1
Flags: 
Ports Bound: 0  
Node name: fedora14-node2
Node ID: 2
Multicast addresses: 239.192.99.73 
Node addresses: 192.168.2.98 

[root@fedora14-node2 ~]# corosync-objctl |grep ttl
cluster.cman.multicast.ttl=255
totem.interface.ttl=255

Testing default (no multicast ttl specified):

[root@fedora14-node1 ~]# cman_tool status
Version: 6.2.0
Config Version: 2
Cluster Name: fabbione
Cluster Id: 25573
Cluster Member: Yes
Cluster Generation: 108
Membership state: Cluster-Member
Nodes: 2
Expected votes: 2
Total votes: 2
Node votes: 1
Quorum: 2  
Active subsystems: 1
Flags: 
Ports Bound: 0  
Node name: fedora14-node1
Node ID: 1
Multicast addresses: 239.192.99.73 
Node addresses: 192.168.2.97 

[root@fedora14-node2 ~]# cman_tool status
Version: 6.2.0
Config Version: 2
Cluster Name: fabbione
Cluster Id: 25573
Cluster Member: Yes
Cluster Generation: 108
Membership state: Cluster-Member
Nodes: 2
Expected votes: 2
Total votes: 2
Node votes: 1
Quorum: 2  
Active subsystems: 1
Flags: 
Ports Bound: 0  
Node name: fedora14-node2
Node ID: 2
Multicast addresses: 239.192.99.73 
Node addresses: 192.168.2.98 

[root@fedora14-node2 ~]# corosync-objctl |grep ttl
[root@fedora14-node2 ~]# 

testing error conditions:

  <cman>
   <multicast ttl="-1"/>
  </cman>

[root@fedora14-node2 cluster]# cman_tool -d join
Validating configuration
calling '/usr/sbin/ccs_config_validate  '
TTL value (4294967295) out of range (0 - 255)
Unable to get the configuration
cman_tool: Not joining, configuration is not valid

(the output of 4294967295 is due to ttl value being unsigned)

  <cman>
   <multicast ttl="256"/>
  </cman>

[root@fedora14-node2 cluster]# cman_tool -d join
Validating configuration
calling '/usr/sbin/ccs_config_validate  '
TTL value (256) out of range (0 - 255)
Unable to get the configuration
cman_tool: Not joining, configuration is not valid

Comment 9 errata-xmlrpc 2011-05-19 12:54:45 UTC
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHBA-2011-0537.html