Attachment 145097 Details for Bug 221899 – Log file - what is the sequence of the whole file?

Log file - what is the sequence of the whole file?

luci_log.txt (text/plain), 54.31 KB, created by Len DiMaggio on 2007-01-08 20:05:24 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Len DiMaggio

Created: 2007-01-08 20:05:24 UTC

Size: 54.31 KB

patch

obsolete

>
>luci
>Recent log information for tng3-1.lab.msp.redhat.com
>
>Mon Jan  8 10:38:22 2007 ccsd[18013]: Stopping ccsd, SIGTERM received.
>Mon Jan  8 10:38:22 2007 dlm_controld[18041]: groupd is down, exiting
>Mon Jan  8 10:38:22 2007 fenced[18035]: groupd is down, exiting
>Mon Jan  8 10:38:22 2007 gfs_controld[18047]: cluster is down, exiting
>Mon Jan  8 10:38:22 2007 gfs_controld[18047]: groupd connection died
>Mon Jan  8 10:38:22 2007 gfs_controld[18047]: groupd_dispatch error -1 errno 11
>Mon Jan  8 10:38:19 2007 rgmanager: [18351]:  Cluster Service Manager is stopped.
>Mon Jan  8 10:38:11 2007 modclusterd: startup succeeded
>Mon Jan  8 13:29:27 2007 openais[31460]: [CLM ] Members Joined:
>Mon Jan  8 13:29:27 2007 openais[31460]: [CLM ] Members Left:
>Mon Jan  8 13:29:27 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 13:29:27 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.175
>Mon Jan  8 13:29:27 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.176
>Mon Jan  8 13:29:27 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.177
>Mon Jan  8 13:29:27 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.178
>Mon Jan  8 13:29:27 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.178)
>Mon Jan  8 13:29:27 2007 openais[31460]: [CPG ] got joinlist message from node 1
>Mon Jan  8 13:29:27 2007 openais[31460]: [CPG ] got joinlist message from node 2
>Mon Jan  8 13:29:27 2007 openais[31460]: [CPG ] got joinlist message from node 3
>Mon Jan  8 13:29:27 2007 openais[31460]: [CPG ] got joinlist message from node 4
>Mon Jan  8 13:29:27 2007 openais[31460]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 13:29:27 2007 openais[31460]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 13:29:26 2007 openais[31460]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 13:29:26 2007 openais[31460]: [CLM ] Members Joined:
>Mon Jan  8 13:29:26 2007 openais[31460]: [CLM ] Members Left:
>Mon Jan  8 13:29:26 2007 openais[31460]: [CLM ] New Configuration:
>Mon Jan  8 13:29:26 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 13:29:26 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.175)
>Mon Jan  8 13:29:26 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.176)
>Mon Jan  8 13:29:26 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.177)
>Mon Jan  8 13:29:26 2007 openais[31460]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] Saving state aru 32 high seq received 32
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] Sending initial ORF token
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] Storing new sequence id for ring 14
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] aru 32 high delivered 32 received flag 0
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] aru 9 high delivered 9 received flag 0
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] entering COMMIT state.
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] entering GATHER state from 11.
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] position [1] member 10.15.89.175:
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] position [2] member 10.15.89.176:
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] position [3] member 10.15.89.177:
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] position [4] member 10.15.89.178:
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] previous ring seq 16 rep 10.15.89.174
>Mon Jan  8 13:29:26 2007 openais[31460]: [TOTEM] previous ring seq 4 rep 10.15.89.178
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] Members Joined:
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] Members Left:
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] New Configuration:
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.175
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.176
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.177
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.175)
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.176)
>Mon Jan  8 13:29:24 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.177)
>Mon Jan  8 13:29:24 2007 openais[31460]: [CMAN ] quorum regained, resuming activity
>Mon Jan  8 13:29:24 2007 openais[31460]: [CPG ] got joinlist message from node 1
>Mon Jan  8 13:29:24 2007 openais[31460]: [CPG ] got joinlist message from node 2
>Mon Jan  8 13:29:24 2007 openais[31460]: [CPG ] got joinlist message from node 3
>Mon Jan  8 13:29:24 2007 openais[31460]: [CPG ] got joinlist message from node 4
>Mon Jan  8 13:29:24 2007 openais[31460]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] Saving state aru 18 high seq received 18
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] Saving state aru 23 high seq received 23
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] Sending initial ORF token
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] Storing new sequence id for ring 10
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] Storing new sequence id for ring c
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] aru 18 high delivered 18 received flag 0
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] aru 23 high delivered 23 received flag 0
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] aru 9 high delivered 9 received flag 0
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] entering COMMIT state.
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] entering GATHER state from 11.
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] position [1] member 10.15.89.175:
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] position [2] member 10.15.89.176:
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] position [3] member 10.15.89.177:
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] previous ring seq 12 rep 10.15.89.174
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] previous ring seq 4 rep 10.15.89.176
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] previous ring seq 4 rep 10.15.89.177
>Mon Jan  8 13:29:24 2007 openais[31460]: [TOTEM] previous ring seq 8 rep 10.15.89.174
>Mon Jan  8 13:29:23 2007 ccsd[31454]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 13:29:23 2007 ccsd[31454]: Error while processing connect: Connection refused
>Mon Jan  8 13:29:23 2007 openais[31460]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 13:29:23 2007 openais[31460]: [CLM ] Members Joined:
>Mon Jan  8 13:29:23 2007 openais[31460]: [CLM ] Members Left:
>Mon Jan  8 13:29:23 2007 openais[31460]: [CLM ] New Configuration:
>Mon Jan  8 13:29:23 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 13:29:23 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.175
>Mon Jan  8 13:29:23 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 13:29:23 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.175)
>Mon Jan  8 13:29:23 2007 openais[31460]: [CPG ] got joinlist message from node 1
>Mon Jan  8 13:29:23 2007 openais[31460]: [CPG ] got joinlist message from node 2
>Mon Jan  8 13:29:23 2007 openais[31460]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] Saving state aru b high seq received b
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] Sending initial ORF token
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] Storing new sequence id for ring 8
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] aru 9 high delivered 9 received flag 0
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] aru b high delivered b received flag 0
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] entering COMMIT state.
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] entering GATHER state from 11.
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] position [1] member 10.15.89.175:
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] previous ring seq 4 rep 10.15.89.174
>Mon Jan  8 13:29:23 2007 openais[31460]: [TOTEM] previous ring seq 4 rep 10.15.89.175
>Mon Jan  8 13:29:22 2007 ccsd[31454]: Initial status:: Inquorate
>Mon Jan  8 13:29:22 2007 openais[31460]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 13:29:22 2007 openais[31460]: [CLM ] Members Joined:
>Mon Jan  8 13:29:22 2007 openais[31460]: [CLM ] Members Left:
>Mon Jan  8 13:29:22 2007 openais[31460]: [CLM ] New Configuration:
>Mon Jan  8 13:29:22 2007 openais[31460]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 13:29:22 2007 openais[31460]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 13:29:22 2007 openais[31460]: [CMAN ] CMAN 2.0.52 (built Dec 15 2006 12:27:54) started
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] AIS Executive Service RELEASE 'subrev 1324 version 0.80.2'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] AIS Executive Service: started and ready to provide service.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Copyright (C) 2006 Red Hat, Inc.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais CMAN membership service 2.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais availability management framework B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais checkpoint service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais cluster closed process group service v1.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais cluster membership service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais configuration service'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais distributed locking service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais event service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais extended virtual synchrony service'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Registering service handler 'openais message service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] Using default multicast address of 239.192.163.88
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_amf loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_cfg loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_ckpt loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_clm loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_cman loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_cpg loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_evs loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_evt loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_lck loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [MAIN ] openais component openais_msg loaded.
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais CMAN membership service 2.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais availability management framework B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais checkpoint service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais cluster closed process group service v1.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais cluster membership service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais configuration service'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais distributed locking service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais event service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais extended virtual synchrony service'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SERV ] Initialising service handler 'openais message service B.01.01'
>Mon Jan  8 13:29:22 2007 openais[31460]: [SYNC ] Not using a virtual synchrony filter.
>Mon Jan  8 13:29:22 2007 openais[31460]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Created or loaded sequence id 0.10.15.89.174 for this ring.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] RRP mode set to none.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] RRP threshold (10 problem count)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] RRP token expired timeout (247 ms)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] RRP token problem counter (2000 ms)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Receive multicast socket recv buffer size (219136 bytes).
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Saving state aru 0 high seq received 0
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Sending initial ORF token
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Storing new sequence id for ring 4
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] The network interface [10.15.89.174] is now up.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Token Timeout (5000 ms) retransmit timeout (247 ms)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] Transmit multicast socket send buffer size (219136 bytes).
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] aru 0 high delivered 0 received flag 0
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] entering COMMIT state.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] entering GATHER state from 15.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] heartbeat_failures_allowed (0)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] join (60 ms) send_join (0 ms) consensus (4800 ms) merge (200 ms)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] max_network_delay (50 ms)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] previous ring seq 0 rep 10.15.89.174
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] send threads (0 threads)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1500
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] token hold (187 ms) retransmits before loss (20 retrans)
>Mon Jan  8 13:29:22 2007 openais[31460]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages)
>Mon Jan  8 13:29:19 2007 ccsd[31454]: Built: Dec 15 2006 12:27:47
>Mon Jan  8 13:29:19 2007 ccsd[31454]: Copyright (C) Red Hat, Inc. 2004 All rights reserved.
>Mon Jan  8 13:29:19 2007 ccsd[31454]: Starting ccsd 2.0.52:
>Mon Jan  8 13:29:19 2007 ccsd[31454]: cluster.conf (cluster name = tng3-cluster, version = 1) found.
>Mon Jan  8 13:29:19 2007 dlm: DLM (built Dec 15 2006 22:18:44) installed
>Mon Jan  8 13:29:19 2007 gfs2: GFS2 (built Dec 15 2006 22:19:20) installed
>Mon Jan  8 13:29:19 2007 lock_dlm: Lock_DLM (built Dec 15 2006 22:19:33) installed
>Mon Jan  8 09:59:25 2007 ricci: startup succeeded
>Mon Jan  8 09:59:24 2007 oddjobd: oddjobd startup succeeded
>Mon Jan  8 09:59:24 2007 saslauthd[18195]: detach_tty : master pid is: 18195
>Mon Jan  8 09:59:24 2007 saslauthd[18195]: ipc_init : listening on socket: /var/run/saslauthd/mux
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] Members Joined:
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] Members Left:
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] New Configuration:
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.175
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.176
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.177
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.178
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.175)
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.176)
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.177)
>Mon Jan  8 09:58:39 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.178)
>Mon Jan  8 09:58:39 2007 openais[18019]: [CPG ] got joinlist message from node 1
>Mon Jan  8 09:58:39 2007 openais[18019]: [CPG ] got joinlist message from node 2
>Mon Jan  8 09:58:39 2007 openais[18019]: [CPG ] got joinlist message from node 3
>Mon Jan  8 09:58:39 2007 openais[18019]: [CPG ] got joinlist message from node 4
>Mon Jan  8 09:58:39 2007 openais[18019]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] Saving state aru 37 high seq received 37
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] Sending initial ORF token
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] Storing new sequence id for ring 14
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] aru 37 high delivered 37 received flag 0
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] aru 9 high delivered 9 received flag 0
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] entering COMMIT state.
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] entering GATHER state from 11.
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] position [1] member 10.15.89.175:
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] position [2] member 10.15.89.176:
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] position [3] member 10.15.89.177:
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] position [4] member 10.15.89.178:
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] previous ring seq 16 rep 10.15.89.174
>Mon Jan  8 09:58:39 2007 openais[18019]: [TOTEM] previous ring seq 4 rep 10.15.89.178
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] Members Joined:
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] Members Left:
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] New Configuration:
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.175
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.176
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.177
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.175)
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.176)
>Mon Jan  8 09:58:18 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.177)
>Mon Jan  8 09:58:18 2007 openais[18019]: [CPG ] got joinlist message from node 1
>Mon Jan  8 09:58:18 2007 openais[18019]: [CPG ] got joinlist message from node 2
>Mon Jan  8 09:58:18 2007 openais[18019]: [CPG ] got joinlist message from node 3
>Mon Jan  8 09:58:18 2007 openais[18019]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] Saving state aru 2f high seq received 2f
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] Sending initial ORF token
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] Storing new sequence id for ring 10
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] aru 2f high delivered 2f received flag 0
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] aru 9 high delivered 9 received flag 0
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] entering COMMIT state.
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] entering GATHER state from 11.
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] position [1] member 10.15.89.175:
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] position [2] member 10.15.89.176:
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] position [3] member 10.15.89.177:
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] previous ring seq 12 rep 10.15.89.174
>Mon Jan  8 09:58:18 2007 openais[18019]: [TOTEM] previous ring seq 4 rep 10.15.89.177
>Mon Jan  8 09:53:38 2007 fenced[18035]: fencing deferred to prior member
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] Members Joined:
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] Members Left:
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] New Configuration:
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.175
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.176
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.175)
>Mon Jan  8 09:53:13 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.176)
>Mon Jan  8 09:53:13 2007 openais[18019]: [CMAN ] quorum regained, resuming activity
>Mon Jan  8 09:53:13 2007 openais[18019]: [CPG ] got joinlist message from node 1
>Mon Jan  8 09:53:13 2007 openais[18019]: [CPG ] got joinlist message from node 2
>Mon Jan  8 09:53:13 2007 openais[18019]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] Saving state aru 17 high seq received 17
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] Sending initial ORF token
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] Storing new sequence id for ring c
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] aru 17 high delivered 17 received flag 0
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] aru 3 high delivered 1 received flag 0
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] entering COMMIT state.
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] position [1] member 10.15.89.175:
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] position [2] member 10.15.89.176:
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] previous ring seq 4 rep 10.15.89.176
>Mon Jan  8 09:53:13 2007 openais[18019]: [TOTEM] previous ring seq 8 rep 10.15.89.174
>Mon Jan  8 09:53:12 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:12 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:12 2007 openais[18019]: [TOTEM] entering GATHER state from 11.
>Mon Jan  8 09:53:11 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:11 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:10 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:10 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:09 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:09 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:08 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:08 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:07 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:07 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:06 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:06 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:06 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:53:05 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:05 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:04 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:04 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:03 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:03 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:02 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:02 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:01 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:01 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:53:00 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:53:00 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:59 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:59 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:58 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:58 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:57 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:57 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:56 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:56 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:56 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:52:55 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:55 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:54 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:54 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:53 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:53 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:52 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:52 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:51 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:51 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:51 2007 openais[18019]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 09:52:51 2007 openais[18019]: [CLM ] Members Joined:
>Mon Jan  8 09:52:51 2007 openais[18019]: [CLM ] Members Left:
>Mon Jan  8 09:52:51 2007 openais[18019]: [CLM ] New Configuration:
>Mon Jan  8 09:52:51 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 09:52:51 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.175
>Mon Jan  8 09:52:51 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 09:52:51 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.175)
>Mon Jan  8 09:52:51 2007 openais[18019]: [CPG ] got joinlist message from node 1
>Mon Jan  8 09:52:51 2007 openais[18019]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] Saving state aru b high seq received b
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] Sending initial ORF token
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] Storing new sequence id for ring 8
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] aru 9 high delivered 9 received flag 0
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] aru b high delivered b received flag 0
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] entering COMMIT state.
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] entering GATHER state from 11.
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] position [1] member 10.15.89.175:
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] previous ring seq 4 rep 10.15.89.174
>Mon Jan  8 09:52:51 2007 openais[18019]: [TOTEM] previous ring seq 4 rep 10.15.89.175
>Mon Jan  8 09:52:50 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:50 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:49 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:49 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:48 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:48 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:47 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:47 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:46 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:46 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:46 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:52:45 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:45 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:44 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:44 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:43 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:43 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:42 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:42 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:41 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:41 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:40 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:40 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:39 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:39 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:38 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:38 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:37 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:37 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:36 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:36 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:36 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:52:35 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:35 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:34 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:34 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:33 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:33 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:32 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:32 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:31 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:31 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:30 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:30 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:29 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:29 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:28 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:28 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:27 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:27 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:26 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:26 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:26 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:52:25 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:25 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:24 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:24 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:23 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:23 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:22 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:22 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:21 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:21 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:20 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:20 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:19 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:19 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:18 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:18 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:17 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:17 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:16 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:16 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:16 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:52:15 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:15 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:14 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:14 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:13 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:13 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:12 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:12 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:11 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:11 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:10 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:10 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:09 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:09 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:08 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:08 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:07 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:07 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:06 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:06 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:06 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:52:05 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:05 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:04 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:04 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:03 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:03 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:02 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:02 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:01 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:01 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:52:00 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:52:00 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:59 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:59 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:58 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:58 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:57 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:57 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:56 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:56 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:56 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:51:55 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:55 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:54 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:54 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:53 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:53 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:52 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:52 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:51 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:51 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:50 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:50 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:49 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:49 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:48 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:48 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:47 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:47 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:47 2007 fenced[18035]: connect to ccs error -111, check ccsd or cluster status
>Mon Jan  8 09:51:46 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:46 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:45 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:45 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:44 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:44 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:43 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:43 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:42 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:42 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:41 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:41 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:40 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:40 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:39 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:39 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:38 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:38 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:37 2007 ccsd[18013]: Cluster is not quorate. Refusing connection.
>Mon Jan  8 09:51:37 2007 ccsd[18013]: Error while processing connect: Connection refused
>Mon Jan  8 09:51:35 2007 ccsd[18013]: Initial status:: Inquorate
>Mon Jan  8 09:51:35 2007 openais[18019]: [CLM ] CLM CONFIGURATION CHANGE
>Mon Jan  8 09:51:35 2007 openais[18019]: [CLM ] Members Joined:
>Mon Jan  8 09:51:35 2007 openais[18019]: [CLM ] Members Left:
>Mon Jan  8 09:51:35 2007 openais[18019]: [CLM ] New Configuration:
>Mon Jan  8 09:51:35 2007 openais[18019]: [CLM ] got nodejoin message 10.15.89.174
>Mon Jan  8 09:51:35 2007 openais[18019]: [CLM ] r(0) ip(10.15.89.174)
>Mon Jan  8 09:51:35 2007 openais[18019]: [CMAN ] CMAN 2.0.52 (built Dec 15 2006 12:27:54) started
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] AIS Executive Service RELEASE 'subrev 1324 version 0.80.2'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] AIS Executive Service: started and ready to provide service.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Copyright (C) 2006 Red Hat, Inc.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais CMAN membership service 2.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais availability management framework B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais checkpoint service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais cluster closed process group service v1.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais cluster membership service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais configuration service'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais distributed locking service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais event service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais extended virtual synchrony service'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Registering service handler 'openais message service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] Using default multicast address of 239.192.163.88
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_amf loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_cfg loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_ckpt loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_clm loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_cman loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_cpg loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_evs loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_evt loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_lck loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [MAIN ] openais component openais_msg loaded.
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais CMAN membership service 2.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais availability management framework B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais checkpoint service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais cluster closed process group service v1.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais cluster membership service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais configuration service'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais distributed locking service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais event service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais extended virtual synchrony service'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SERV ] Initialising service handler 'openais message service B.01.01'
>Mon Jan  8 09:51:35 2007 openais[18019]: [SYNC ] Not using a virtual synchrony filter.
>Mon Jan  8 09:51:35 2007 openais[18019]: [SYNC ] This node is within the primary component and will provide service.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Created or loaded sequence id 0.10.15.89.174 for this ring.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Creating commit token because I am the rep.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Did not need to originate any messages in recovery.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] RRP mode set to none.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] RRP threshold (10 problem count)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] RRP token expired timeout (247 ms)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] RRP token problem counter (2000 ms)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Receive multicast socket recv buffer size (219136 bytes).
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Saving state aru 0 high seq received 0
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Sending initial ORF token
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Storing new sequence id for ring 4
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] The network interface [10.15.89.174] is now up.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Token Timeout (5000 ms) retransmit timeout (247 ms)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] Transmit multicast socket send buffer size (219136 bytes).
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] aru 0 high delivered 0 received flag 0
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] entering COMMIT state.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] entering GATHER state from 15.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] entering OPERATIONAL state.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] entering RECOVERY state.
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] heartbeat_failures_allowed (0)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] join (60 ms) send_join (0 ms) consensus (4800 ms) merge (200 ms)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] max_network_delay (50 ms)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] position [0] member 10.15.89.174:
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] previous ring seq 0 rep 10.15.89.174
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] send threads (0 threads)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1500
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] token hold (187 ms) retransmits before loss (20 retrans)
>Mon Jan  8 09:51:35 2007 openais[18019]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages)
>Mon Jan  8 09:51:32 2007 ccsd[18013]: Built: Dec 15 2006 12:27:47
>Mon Jan  8 09:51:32 2007 ccsd[18013]: Copyright (C) Red Hat, Inc. 2004 All rights reserved.
>Mon Jan  8 09:51:32 2007 ccsd[18013]: Starting ccsd 2.0.52:
>Mon Jan  8 09:51:32 2007 ccsd[18013]: cluster.conf (cluster name = tng3-cluster, version = 1) found.
>Mon Jan  8 09:51:31 2007 ccsd[17948]: Stopping ccsd, SIGTERM received.
>Mon Jan  8 09:51:01 2007 ccsd[17948]: Unable to connect to cluster infrastructure after 60 seconds.
>Mon Jan  8 09:50:31 2007 ccsd[17948]: Unable to connect to cluster infrastructure after 30 seconds.
>Mon Jan  8 09:50:03 2007 ccsd[17948]: Local version # : 1
>Mon Jan  8 09:50:03 2007 ccsd[17948]: Local version # : 2
>Mon Jan  8 09:50:03 2007 ccsd[17948]: Remote copy of cluster.conf (version = 2) found.
>Mon Jan  8 09:50:03 2007 ccsd[17948]: Remote copy of cluster.conf is from quorate node.
>Mon Jan  8 09:50:03 2007 ccsd[17948]: Remote version #: 1
>Mon Jan  8 09:50:03 2007 ccsd[17948]: Searching cluster for valid copy.
>Mon Jan  8 09:50:03 2007 ccsd[17948]: Switching to remote copy.
>Mon Jan  8 09:50:03 2007 ccsd[17948]: Unable to parse /etc/cluster/cluster.conf
>Mon Jan  8 09:50:02 2007 ccsd[17948]: Built: Dec 15 2006 12:27:47
>Mon Jan  8 09:50:02 2007 ccsd[17948]: Copyright (C) Red Hat, Inc. 2004 All rights reserved.
>Mon Jan  8 09:50:02 2007 ccsd[17948]: Starting ccsd 2.0.52:
>Mon Jan  8 09:50:02 2007 dlm: DLM (built Dec 15 2006 22:18:44) installed
>Mon Jan  8 09:50:02 2007 gfs2: GFS2 (built Dec 15 2006 22:19:20) installed
>Mon Jan  8 09:50:02 2007 lock_dlm: Lock_DLM (built Dec 15 2006 22:19:33) installed
>Mon Jan  8 09:45:04 2007 smartd[2058]: Device: /dev/sdc, Temperature changed -2 Celsius to 44 Celsius since last report
>Mon Jan  8 09:37:32 2007 exiting: on signal 15
>Mon Jan  8 09:37:32 2007 klogd: klogd 1.4.1, log source = /proc/kmsg started.
>Mon Jan  8 09:37:32 2007 syslogd: 1.4.1: restart.
>Mon Jan  8 09:37:30 2007 kernel: Kernel log daemon terminating.
>Mon Jan  8 09:37:30 2007 kernel: Kernel logging (proc) stopped.
>Mon Jan  8 09:04:37 2007 dhclient: DHCPACK from 10.15.89.100
>Mon Jan  8 09:04:37 2007 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67
>Mon Jan  8 09:04:37 2007 dhclient: bound to 10.15.89.174 -- renewal in 8999 seconds.
>Mon Jan  8 12:27:53 2007 rgmanager: [26805]:  Cluster Service Manager is stopped.
>Mon Jan  8 12:25:13 2007 rgmanager: [26503]:  Cluster Service Manager is stopped.
>Mon Jan  8 13:48:49 2007 ccsd[31454]: Stopping ccsd, SIGTERM received.
>Mon Jan  8 13:48:49 2007 dlm_controld[31488]: groupd is down, exiting
>Mon Jan  8 13:48:49 2007 fenced[31482]: cluster is down, exiting
>Mon Jan  8 13:48:49 2007 gfs_controld[31494]: cluster is down, exiting
>Mon Jan  8 13:48:49 2007 gfs_controld[31494]: groupd connection died
>Mon Jan  8 13:48:49 2007 gfs_controld[31494]: groupd_dispatch error -1 errno 11
>Mon Jan  8 13:48:46 2007 rgmanager: [32741]:  Cluster Service Manager is stopped.
>Mon Jan  8 11:34:35 2007 dhclient: DHCPACK from 10.15.89.100
>Mon Jan  8 11:34:35 2007 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67
>Mon Jan  8 11:34:35 2007 dhclient: bound to 10.15.89.174 -- renewal in 9542 seconds.
>Mon Jan  8 11:07:59 2007 rgmanager: [20614]:  Cluster Service Manager is stopped.
>

Actions: View

Attachments on bug 221899: 145097