Attachment 312923 Details for Bug 457107 – log from hayes-03

log from hayes-03

hayes-03.log (text/plain), 38.77 KB, created by Corey Marthaler on 2008-07-29 19:08:50 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Corey Marthaler

Created: 2008-07-29 19:08:50 UTC

Size: 38.77 KB

patch

obsolete

>Jul 29 13:38:29 hayes-03 kernel: DLM (built Jul 17 2008 18:05:19) installed
>Jul 29 13:38:29 hayes-03 kernel: GFS2 (built Jul 17 2008 18:05:45) installed
>Jul 29 13:38:29 hayes-03 kernel: Lock_DLM (built Jul 17 2008 18:05:51) installed
>Jul 29 13:38:29 hayes-03 ccsd[3125]: Starting ccsd 2.0.86: 
>Jul 29 13:38:29 hayes-03 ccsd[3125]:  Built: Jul 17 2008 15:38:59 
>Jul 29 13:38:29 hayes-03 ccsd[3125]:  Copyright (C) Red Hat, Inc.  2004  All rights reserved. 
>Jul 29 13:38:29 hayes-03 ccsd[3125]: cluster.conf (cluster name = HAYES, version = 2) found. 
>Jul 29 13:38:32 hayes-03 ccsd[3125]: Remote copy of cluster.conf is from quorate node. 
>Jul 29 13:38:32 hayes-03 ccsd[3125]:  Local version # : 2 
>Jul 29 13:38:32 hayes-03 ccsd[3125]:  Remote version #: 2 
>Jul 29 13:38:32 hayes-03 openais[3132]: [MAIN ] AIS Executive Service RELEASE 'subrev 1358 version 0.80.3' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Copyright (C) 2006 Red Hat, Inc. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] AIS Executive Service: started and ready to provide service. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Using default multicast address of 239.192.8.209 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_cpg loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais cluster closed process group service v1.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_cfg loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais configuration service' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_msg loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais message service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_lck loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais distributed locking service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_evt loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais event service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_ckpt loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais checkpoint service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_amf loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais availability management framework B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_clm loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais cluster membership service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_evs loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais extended virtual synchrony service' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] openais component openais_cman loaded. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [MAIN ] Registering service handler 'openais CMAN membership service 2.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Token Timeout (10000 ms) retransmit timeout (495 ms) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] token hold (386 ms) retransmits before loss (20 retrans) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] join (60 ms) send_join (0 ms) consensus (4800 ms) merge (200 ms) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1500 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] send threads (0 threads) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] RRP token expired timeout (495 ms) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] RRP token problem counter (2000 ms) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] RRP threshold (10 problem count) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] RRP mode set to none. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] heartbeat_failures_allowed (0) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] max_network_delay (50 ms) 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Receive multicast socket recv buffer size (262142 bytes). 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Transmit multicast socket send buffer size (262142 bytes). 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] The network interface [10.15.89.137] is now up. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Created or loaded sequence id 652.10.15.89.137 for this ring. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] entering GATHER state from 15. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais extended virtual synchrony service' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais cluster membership service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais availability management framework B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais checkpoint service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais event service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais distributed locking service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais message service B.01.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais configuration service' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais cluster closed process group service v1.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SERV ] Initialising service handler 'openais CMAN membership service 2.01' 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CMAN ] CMAN 2.0.86 (built Jul 17 2008 15:39:03) started 
>Jul 29 13:38:33 hayes-03 openais[3132]: [SYNC ] Not using a virtual synchrony filter. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Creating commit token because I am the rep. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Saving state aru 0 high seq received 0 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Storing new sequence id for ring 290 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] entering COMMIT state. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] entering RECOVERY state. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] position [0] member 10.15.89.137: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] previous ring seq 652 rep 10.15.89.137 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] aru 0 high delivered 0 received flag 1 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Did not need to originate any messages in recovery. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Sending initial ORF token 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] New Configuration: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] Members Left: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] Members Joined: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] New Configuration: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] Members Left: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] Members Joined: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jul 29 13:38:33 hayes-03 openais[3132]: [SYNC ] This node is within the primary component and will provide service. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] entering OPERATIONAL state. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] got nodejoin message 10.15.89.137 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] entering GATHER state from 11. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Saving state aru a high seq received a 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Storing new sequence id for ring 2a0 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] entering COMMIT state. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] entering RECOVERY state. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] position [0] member 10.15.89.135: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] previous ring seq 668 rep 10.15.89.135 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] aru 18 high delivered 18 received flag 1 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] position [1] member 10.15.89.136: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] previous ring seq 668 rep 10.15.89.135 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] aru 18 high delivered 18 received flag 1 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] position [2] member 10.15.89.137: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] previous ring seq 656 rep 10.15.89.137 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] aru a high delivered a received flag 1 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] Did not need to originate any messages in recovery. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] New Configuration: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] Members Left: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] Members Joined: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] New Configuration: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.135)  
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] Members Left: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] Members Joined: 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.135)  
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jul 29 13:38:33 hayes-03 openais[3132]: [SYNC ] This node is within the primary component and will provide service. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [TOTEM] entering OPERATIONAL state. 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CMAN ] quorum regained, resuming activity 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] got nodejoin message 10.15.89.135 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] got nodejoin message 10.15.89.136 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CLM  ] got nodejoin message 10.15.89.137 
>Jul 29 13:38:33 hayes-03 openais[3132]: [CPG  ] got joinlist message from node 1 
>Jul 29 13:38:33 hayes-03 ccsd[3125]: Initial status:: Quorate 
>Jul 29 13:38:43 hayes-03 kernel: dlm: Using TCP for communications
>Jul 29 13:38:43 hayes-03 kernel: dlm: connecting to 2
>Jul 29 13:38:43 hayes-03 kernel: dlm: got connection from 2
>Jul 29 13:38:43 hayes-03 kernel: dlm: connecting to 1
>Jul 29 13:38:44 hayes-03 clvmd: Cluster LVM daemon started - connected to CMAN
>Jul 29 13:39:06 hayes-03 clogd[3257]: Starting clogd: 
>Jul 29 13:39:06 hayes-03 clogd[3257]:  Built: Jul 24 2008 16:59:01  
>Jul 29 13:39:11 hayes-03 kernel: aoe: aoe_init: AoE v22 initialised.
>Jul 29 13:39:11 hayes-03 kernel: aoe: 1.1 isbusy
>Jul 29 13:39:11 hayes-03 kernel: aoe: 0030488d63d2 e1.1 v4467 has 19046937725 sectors
>Jul 29 13:39:11 hayes-03 kernel:  etherd/e1.1: p1 p2 p3 p4 p5
>Jul 29 13:39:11 hayes-03 kernel: aoe: 1.1 isbusy
>Jul 29 13:39:12 hayes-03 last message repeated 2 times
>Jul 29 13:39:16 hayes-03 kernel: dlm: Using TCP for communications
>Jul 29 13:39:16 hayes-03 kernel: dlm: connecting to 2
>Jul 29 13:39:16 hayes-03 kernel: dlm: got connection from 2
>Jul 29 13:39:16 hayes-03 kernel: dlm: connecting to 1
>Jul 29 13:39:17 hayes-03 clvmd: Cluster LVM daemon started - connected to CMAN
>Jul 29 13:39:18 hayes-03 kernel: aoe: 1.1 isbusy
>Jul 29 13:39:18 hayes-03 last message repeated 2 times
>Jul 29 13:39:18 hayes-03 dmeventd[3422]: dmeventd ready for processing.
>Jul 29 13:39:18 hayes-03 dmeventd[3422]: Monitoring mirror device hayes-mirror1 for events 
>Jul 29 13:39:19 hayes-03 lvm[3422]: Loading config file: /etc/lvm/lvm.conf
>Jul 29 13:39:19 hayes-03 lvm[3422]: Opened /etc/lvm/lvm.conf RO
>Jul 29 13:39:19 hayes-03 lvm[3422]: Closed /etc/lvm/lvm.conf
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting log/syslog to 1
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting log/level to 0
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting log/verbose to 0
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting log/indent to 1
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting log/prefix to   
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting log/command_names to 0
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting global/test to 0
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting log/overwrite to 0
>Jul 29 13:39:19 hayes-03 lvm[3422]: log/activation not found in config: defaulting to 0
>Jul 29 13:39:19 hayes-03 lvm[3422]: Logging initialised at Tue Jul 29 13:39:19 2008
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting global/umask to 63
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting devices/dir to /dev
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting global/proc to /proc
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting global/activation to 1
>Jul 29 13:39:19 hayes-03 lvm[3422]: global/suffix not found in config: defaulting to 1
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting global/units to h
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting activation/readahead to auto
>Jul 29 13:39:19 hayes-03 lvm[3422]: devices/preferred_names not found in config file: using built-in preferences
>Jul 29 13:39:19 hayes-03 lvm[3422]: Matcher built with 3 dfa states
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting devices/ignore_suspended_devices to 0
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting devices/cache_dir to /etc/lvm/cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting devices/write_cache_state to 1
>Jul 29 13:39:19 hayes-03 lvm[3422]: Opened /etc/lvm/cache/.cache RO
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-cmirror2_mlog: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/bus/usb/001/001: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/bus/usb/001/002: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/bus/usb/002/001: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/bus/usb/003/001: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cdrom: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cdrom-hda: Aliased to /dev/cdrom in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/console: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/core: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cpu/0/cpuid: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cpu/0/msr: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cpu/1/cpuid: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cpu/1/msr: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cpu/2/cpuid: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cpu/2/msr: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cpu/3/cpuid: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/cpu/3/msr: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251-part1: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251-part2: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-label/boot: Aliased to /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251-part1 in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-path/pci-0000:00:02.1-ide-0:0: Aliased to /dev/cdrom in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-path/pci-0000:03:0e.0-scsi-0:0:0:0: Aliased to /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251 in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-path/pci-0000:03:0e.0-scsi-0:0:0:0-part1: Aliased to /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251-part1 in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-path/pci-0000:03:0e.0-scsi-0:0:0:0-part2: Aliased to /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251-part2 in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/disk/by-uuid/2ffd68da-6ef4-427e-a06c-30d825ecca7c: Aliased to /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251-part1 in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/discover: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/e1.1: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/e1.1p1: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/e1.1p2: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/e1.1p3: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/e1.1p4: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/e1.1p5: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/err: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/interfaces: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/etherd/revalidate: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/fd: Symbolic link to directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/full: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/gpmctl: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/hayes/mirror1: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/hda: Aliased to /dev/cdrom in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/hpet: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/initctl: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/input/event0: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/input/mice: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/kmsg: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/log: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/loop0: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/loop1: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/loop2: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/loop3: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/loop4: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/loop5: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/loop6: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/loop7: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/MAKEDEV: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/control: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror1: Aliased to /dev/hayes/mirror1 in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror1_mimage_0: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror1_mimage_1: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror1_mlog: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/VolGroup00-LogVol00: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/VolGroup00-LogVol01: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mcelog: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/md0: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mem: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/misc/dlm_clvmd: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/misc/dlm-control: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/misc/dlm_plock: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/net/tun: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/null: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/nvram: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/oldmem: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/parport0: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/parport1: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/parport2: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/parport3: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/port: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ppp: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ptmx: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/pts/0: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram0: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram1: Aliased to /dev/ram in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram10: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram11: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram12: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram13: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram14: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram15: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram2: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram3: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram4: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram5: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram6: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram7: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram8: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ram9: Added to device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ramdisk: Aliased to /dev/ram0 in device cache (preferred name)
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/random: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/rawctl: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/root: Aliased to /dev/mapper/VolGroup00-LogVol00 in device cache (preferred name)
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/rtc: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/sda: Aliased to /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251 in device cache (preferred name)
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/sda1: Aliased to /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251-part1 in device cache (preferred name)
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/sda2: Aliased to /dev/disk/by-id/scsi-SATA_WDC_WD800JD-75M_WD-WMAM9VR99251-part2 in device cache (preferred name)
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/sg0: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/snapshot: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/stderr: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/stdin: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/stdout: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/systty: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty0: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty1: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty10: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty11: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty12: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty13: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty14: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty15: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty16: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty17: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty18: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty19: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty2: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty20: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty21: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty22: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty23: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty24: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty25: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty26: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty27: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty28: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty29: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty3: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty30: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty31: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty32: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty33: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty34: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty35: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty36: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty37: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty38: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty39: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty4: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty40: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty41: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty42: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty43: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty44: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty45: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty46: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty47: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty48: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty49: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty5: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty50: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty51: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty52: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty53: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty54: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty55: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty56: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty57: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty58: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty59: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty6: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty60: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty61: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty62: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty63: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty7: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty8: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/tty9: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ttyS0: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ttyS1: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ttyS2: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/ttyS3: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/urandom: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/usbdev1.1_ep00: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/usbdev1.1_ep81: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/usbdev1.2_ep00: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/usbdev1.2_ep81: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/usbdev2.1_ep00: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/usbdev2.1_ep81: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/usbdev3.1_ep00: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/usbdev3.1_ep81: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcs: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcs1: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcs2: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcs3: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcs4: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcs5: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcs6: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcsa: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcsa1: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcsa2: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcsa3: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcsa4: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcsa5: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/vcsa6: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/VolGroup00/LogVol00: Aliased to /dev/root in device cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/VolGroup00/LogVol01: Aliased to /dev/mapper/VolGroup00-LogVol01 in device cache (preferred name)
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/X0R: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/zero: Not a block device
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/hayes/mirror3: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/hayes/mirror4: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror2_mlog: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/hayes/mirror2: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror3_mimage_0: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror3_mlog: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-cmirror1_mlog: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror3_mimage_1: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror4_mlog: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/hayes/cmirror1: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-cmirror2: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror3: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror4: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror4_mimage_2: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror2_mimage_0: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror2: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror2_mimage_1: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/hayes/cmirror2: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-cmirror2_mimage_0: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-cmirror1_mimage_0: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-cmirror1: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror4_mimage_1: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-cmirror2_mimage_1: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-cmirror1_mimage_1: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: /dev/mapper/hayes-mirror4_mimage_0: stat failed: No such file or directory
>Jul 29 13:39:19 hayes-03 lvm[3422]: Loaded persistent filter cache from /etc/lvm/cache/.cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: Closed /etc/lvm/cache/.cache
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting activation/reserved_stack to 256
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting activation/reserved_memory to 8192
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting activation/process_priority to -18
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised format: lvm1
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised format: pool
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised format: lvm2
>Jul 29 13:39:19 hayes-03 lvm[3422]: global/format not found in config: defaulting to lvm2
>Jul 29 13:39:19 hayes-03 lvm[3422]: lvmcache: initialised VG #orphans_lvm1
>Jul 29 13:39:19 hayes-03 lvm[3422]: lvmcache: initialised VG #orphans_pool
>Jul 29 13:39:19 hayes-03 lvm[3422]: lvmcache: initialised VG #orphans_lvm2
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised segtype: striped
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised segtype: zero
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised segtype: error
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised segtype: free
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting dmeventd/snapshot_library to libdevmapper-event-lvm2snapshot.so
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting global/library_dir to /usr/lib64
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised segtype: snapshot
>Jul 29 13:39:19 hayes-03 lvm[3422]: Initialised segtype: mirror
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting backup/retain_days to 30
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting backup/retain_min to 10
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting backup/archive_dir to /etc/lvm/archive
>Jul 29 13:39:19 hayes-03 lvm[3422]: Setting backup/backup_dir to /etc/lvm/backup
>Jul 29 13:39:19 hayes-03 lvm[3422]: Locking memory
>Jul 29 13:39:19 hayes-03 lvm[3422]: memlock_count inc to 1
>Jul 29 13:39:19 hayes-03 lvm[3422]: hayes-mirror1 is now in-sync 
>Jul 29 13:39:19 hayes-03 lvm[3422]: Monitoring mirror device hayes-mirror2 for events 
>Jul 29 13:39:19 hayes-03 lvm[3422]: hayes-mirror2 is now in-sync 
>Jul 29 13:39:19 hayes-03 lvm[3422]: Monitoring mirror device hayes-mirror3 for events 
>Jul 29 13:39:19 hayes-03 lvm[3422]: hayes-mirror3 is now in-sync 
>Jul 29 13:39:19 hayes-03 lvm[3422]: Monitoring mirror device hayes-mirror4 for events 
>Jul 29 13:39:19 hayes-03 lvm[3422]: hayes-mirror4 is now in-sync 
>Jul 29 13:45:24 hayes-03 openais[3132]: [TOTEM] entering GATHER state from 12. 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] entering GATHER state from 0. 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] Saving state aru d7 high seq received d7 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] Storing new sequence id for ring 2a4 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] entering COMMIT state. 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] entering RECOVERY state. 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] position [0] member 10.15.89.136: 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] previous ring seq 672 rep 10.15.89.135 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] aru d7 high delivered d7 received flag 1 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] position [1] member 10.15.89.137: 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] previous ring seq 672 rep 10.15.89.135 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] aru d7 high delivered d7 received flag 1 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] Did not need to originate any messages in recovery. 
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] New Configuration: 
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] Members Left: 
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.135)  
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] Members Joined: 
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] CLM CONFIGURATION CHANGE 
>Jul 29 13:45:29 hayes-03 kernel: dlm: closing connection to node 1
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] New Configuration: 
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.136)  
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] 	r(0) ip(10.15.89.137)  
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] Members Left: 
>Jul 29 13:45:29 hayes-03 openais[3132]: [CLM  ] Members Joined: 
>Jul 29 13:45:29 hayes-03 openais[3132]: [SYNC ] This node is within the primary component and will provide service. 
>Jul 29 13:45:29 hayes-03 openais[3132]: [TOTEM] entering OPERATIONAL state. 
>Jul 29 13:45:29 hayes-03 openais[3132]: [MAIN ] Killing node hayes-02 because it has rejoined the cluster with existing state 
>Jul 29 13:45:29 hayes-03 openais[3132]: [CMAN ] cman killed by node 2 because we rejoined the cluster without a full restart 
>Jul 29 13:45:29 hayes-03 groupd[3144]: cpg_mcast_joined error 2 handle 6b8b456700000000
>Jul 29 13:45:29 hayes-03 gfs_controld[3164]: groupd_dispatch error -1 errno 11
>Jul 29 13:45:29 hayes-03 fenced[3152]: groupd is down, exiting
>Jul 29 13:45:29 hayes-03 gfs_controld[3164]: groupd connection died
>Jul 29 13:45:29 hayes-03 gfs_controld[3164]: cluster is down, exiting
>Jul 29 13:45:29 hayes-03 clogd[3257]: cpg_dispatch failed: SA_AIS_ERR_LIBRARY 
>Jul 29 13:45:29 hayes-03 last message repeated 2 times
>Jul 29 13:45:29 hayes-03 clogd[3257]: Bad callback on cluster/10 
>Jul 29 13:45:29 hayes-03 dlm_controld[3158]: cluster is down, exiting
>Jul 29 13:45:29 hayes-03 clogd[3257]: cpg_dispatch failed: SA_AIS_ERR_LIBRARY 
>Jul 29 13:45:29 hayes-03 kernel: dlm: closing connection to node 3
>Jul 29 13:45:29 hayes-03 kernel: dlm: closing connection to node 2
>Jul 29 13:45:54 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 30 seconds. 
>Jul 29 13:46:24 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 60 seconds. 
>Jul 29 13:46:54 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 90 seconds. 
>Jul 29 13:47:24 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 120 seconds. 
>Jul 29 13:47:54 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 150 seconds. 
>Jul 29 13:48:24 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 180 seconds. 
>Jul 29 13:48:54 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 210 seconds. 
>Jul 29 13:49:24 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 240 seconds. 
>Jul 29 13:49:54 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 270 seconds. 
>Jul 29 13:50:24 hayes-03 ccsd[3125]: Unable to connect to cluster infrastructure after 300 seconds.

Actions: View

Attachments on bug 457107: 312922 | 312923 | 636951