Attachment 308452 Details for Bug 450161 – log from hayes-03

log from hayes-03

hayes-03.log (text/plain), 8.75 KB, created by Corey Marthaler on 2008-06-05 16:30:46 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Corey Marthaler

Created: 2008-06-05 16:30:46 UTC

Size: 8.75 KB

patch

obsolete

>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] entering GATHER state from 11. 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] Saving state aru e2 high seq received e2 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] Storing new sequence id for ring 1f4 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] entering COMMIT state. 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] entering RECOVERY state. 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] position [0] member 10.15.89.136: 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] previous ring seq 496 rep 10.15.89.135 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] aru e2 high delivered e2 received flag 1 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] position [1] member 10.15.89.137: 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] previous ring seq 496 rep 10.15.89.135 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] aru e2 high delivered e2 received flag 1 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] Did not need to originate any messages in recovery. 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] New Configuration: 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] Members Left: 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.135)  
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] Members Joined: 
>Jun  5 10:40:28 hayes-03 kernel: dlm: closing connection to node 1
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] New Configuration: 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jun  5 10:40:28 hayes-03 fenced[29572]: fencing deferred to hayes-02
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] Members Left: 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] Members Joined: 
>Jun  5 10:40:28 hayes-03 openais[29554]: [SYNC ] This node is within the primary component and will provide service. 
>Jun  5 10:40:28 hayes-03 openais[29554]: [TOTEM] entering OPERATIONAL state. 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] got nodejoin message 10.15.89.136 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CLM  ] got nodejoin message 10.15.89.137 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CPG  ] got joinlist message from node 3 
>Jun  5 10:40:28 hayes-03 openais[29554]: [CPG  ] got joinlist message from node 2 
>Jun  5 10:40:31 hayes-03 xinetd[2721]: START: qarsh pid=29866 from=10.15.80.47
>Jun  5 10:40:31 hayes-03 qarshd[29866]: Talking to peer 10.15.80.47:35622
>Jun  5 10:40:31 hayes-03 qarshd[29866]: Running cmdline: cman_tool nodes 
>Jun  5 10:40:31 hayes-03 xinetd[2721]: EXIT: qarsh status=0 pid=29866 duration=0(sec)
>Jun  5 10:41:20 hayes-03 kernel: GFS: fsid=HAYES:HAYES0.2: jid=0: Trying to acquire journal lock...
>Jun  5 10:41:20 hayes-03 kernel: GFS: fsid=HAYES:HAYES1.2: jid=0: Trying to acquire journal lock...
>Jun  5 10:41:20 hayes-03 kernel: GFS: fsid=HAYES:HAYES0.2: jid=0: Busy
>Jun  5 10:41:21 hayes-03 kernel: GFS: fsid=HAYES:HAYES1.2: jid=0: Busy
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] entering GATHER state from 11. 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] Saving state aru 3a high seq received 3a 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] Storing new sequence id for ring 1f8 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] entering COMMIT state. 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] entering RECOVERY state. 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] position [0] member 10.15.89.135: 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] previous ring seq 500 rep 10.15.89.135 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] aru a high delivered a received flag 1 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] position [1] member 10.15.89.136: 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] previous ring seq 500 rep 10.15.89.136 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] aru 3a high delivered 3a received flag 1 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] position [2] member 10.15.89.137: 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] previous ring seq 500 rep 10.15.89.136 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] aru 3a high delivered 3a received flag 1 
>Jun  5 10:43:32 hayes-03 openais[29554]: [TOTEM] Did not need to originate any messages in recovery. 
>Jun  5 10:43:32 hayes-03 openais[29554]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jun  5 10:43:32 hayes-03 openais[29554]: [CLM  ] New Configuration: 
>Jun  5 10:43:32 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jun  5 10:43:32 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jun  5 10:43:32 hayes-03 openais[29554]: [CLM  ] Members Left: 
>Jun  5 10:43:32 hayes-03 openais[29554]: [CLM  ] Members Joined: 
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] New Configuration: 
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.135)  
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] Members Left: 
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] Members Joined: 
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.135)  
>Jun  5 10:43:33 hayes-03 openais[29554]: [SYNC ] This node is within the primary component and will provide service. 
>Jun  5 10:43:33 hayes-03 openais[29554]: [TOTEM] entering OPERATIONAL state. 
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] got nodejoin message 10.15.89.135 
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] got nodejoin message 10.15.89.136 
>Jun  5 10:43:33 hayes-03 openais[29554]: [CLM  ] got nodejoin message 10.15.89.137 
>Jun  5 10:43:43 hayes-03 openais[29554]: [TOTEM] entering GATHER state from 12. 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] entering GATHER state from 0. 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] Saving state aru 17 high seq received 17 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] Storing new sequence id for ring 1fc 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] entering COMMIT state. 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] entering RECOVERY state. 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] position [0] member 10.15.89.136: 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] previous ring seq 504 rep 10.15.89.135 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] aru 17 high delivered 17 received flag 1 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] position [1] member 10.15.89.137: 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] previous ring seq 504 rep 10.15.89.135 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] aru 17 high delivered 17 received flag 1 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] Did not need to originate any messages in recovery. 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] New Configuration: 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jun  5 10:43:47 hayes-03 kernel: dlm: closing connection to node 1
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] Members Left: 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.135)  
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] Members Joined: 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] New Configuration: 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] Members Left: 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] Members Joined: 
>Jun  5 10:43:47 hayes-03 openais[29554]: [SYNC ] This node is within the primary component and will provide service. 
>Jun  5 10:43:47 hayes-03 openais[29554]: [TOTEM] entering OPERATIONAL state. 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] got nodejoin message 10.15.89.136 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CLM  ] got nodejoin message 10.15.89.137 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CPG  ] got joinlist message from node 3 
>Jun  5 10:43:47 hayes-03 openais[29554]: [CPG  ] got joinlist message from node 2 
>Jun  5 11:11:48 hayes-03 qarshd[29840]: Sending child 29842 signal 2
>Jun  5 11:11:48 hayes-03 qarshd[29839]: Sending child 29841 signal 2
>Jun  5 11:11:48 hayes-03 xinetd[2721]: EXIT: qarsh status=0 pid=29839 duration=1969(sec)
>Jun  5 11:11:48 hayes-03 xinetd[2721]: EXIT: qarsh status=0 pid=29840 duration=1969(sec)

Actions: View

Attachments on bug 450161: 308449 | 308450 | 308452