Description of problem:
Messages record their source location with message_source_set.  This uses a totem API to retrieve the current node id to store in the source location.  On receipt of messages, a local response will be given to an ipc connection if the message source set with message_source_set equals the current node id gathered from the totem node id.  Also the synchronization engine heavily uses message_source_set and checks for local messages when processing requests.

Part of totem checks that an interface has not gone up or down once per second.  The checking of the state change of the interface does a memset of 0 bytes for the node id, then sets the nodeid, which is read by the totem function to retrieve the node id.  In some rare circumstances related to timing under heavy load, a message may be inadvertantly ignored because its source address will be set to 0 by the memset operation, but then compared against the valid node id.  This race condition results in messages that are ignored that should not be.


Version-Release number of selected component (if applicable):
openais-0.80.3-21

How reproducible:
Could not reproduce with current ipc, but it is slow.  With the IPC rework (higher performance, more chances for the race to happen) the condition occurs after 10-15 seconds of load.

Steps to Reproduce:
1.
2.
3.
  
Actual results:


Expected results:


Additional info: