Attachment 309850 Details for Bug 452121 – log from taft-03

log from taft-03

taft-03.log (text/plain), 15.86 KB, created by Corey Marthaler on 2008-06-19 15:20:03 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Corey Marthaler

Created: 2008-06-19 15:20:03 UTC

Size: 15.86 KB

patch

obsolete

>Jun 18 04:06:59 taft-03 qarshd[32142]: Running cmdline: pvs --noheadings -o +pv_uuid 
>Jun 18 04:06:59 taft-03 qarshd[32142]: That's enough 
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror: Creating Wf1jc3r2 (1)
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror: start_server called
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror: cluster_log_serverd ready for work
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror: Node joining
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror: cluster_resume: Setting recovery_halted = 0
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror: server_id=dead, server_valid=0, Wf1jc3r2
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror: trigger = LRT_GET_RESYNC_WORK
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (Wf1jc3r2)
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror:   starter     : 1
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:07:02 taft-03 kernel: dm-cmirror:   node_count  : 0
>Jun 18 04:07:02 taft-03 [5458]: Monitoring mirror device helter_skelter-syncd_secondary_3legs_1 for events 
>Jun 18 04:07:02 taft-03 lvm[5458]: Loading config file: /etc/lvm/lvm.conf
>Jun 18 04:07:02 taft-03 lvm[5458]: Opened /etc/lvm/lvm.conf RO
>Jun 18 04:07:02 taft-03 lvm[5458]: Closed /etc/lvm/lvm.conf
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting log/syslog to 1
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting log/level to 0
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting log/verbose to 0
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting log/indent to 1
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting log/prefix to   
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting log/command_names to 0
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting global/test to 0
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting log/overwrite to 0
>Jun 18 04:07:02 taft-03 lvm[5458]: log/activation not found in config: defaulting to 0
>Jun 18 04:07:02 taft-03 lvm[5458]: Logging initialised at Wed Jun 18 04:07:02 2008
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting global/umask to 63
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting devices/dir to /dev
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting global/proc to /proc
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting global/activation to 1
>Jun 18 04:07:02 taft-03 lvm[5458]: global/suffix not found in config: defaulting to 1
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting global/units to h
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting activation/readahead to auto
>Jun 18 04:07:02 taft-03 lvm[5458]: devices/preferred_names not found in config file: using built-in preferences
>Jun 18 04:07:02 taft-03 lvm[5458]: Matcher built with 3 dfa states
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting devices/ignore_suspended_devices to 0
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting devices/cache_dir to /etc/lvm/cache
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting devices/write_cache_state to 1
>Jun 18 04:07:02 taft-03 lvm[5458]: Opened /etc/lvm/cache/.cache RO
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0003000000000000-part1: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram11: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/VolGroup00/LogVol01: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram10: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0004000000000000-part1: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/VolGroup00/LogVol00: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram12: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram6: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0005000000000000-part1: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram13: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram14: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0007000000000000-part1: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram5: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/mapper/VolGroup00-LogVol00: Aliased to /dev/VolGroup00/LogVol00 in device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:02:0e.0-scsi-0:2:0:0-part1: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram1: Aliased to /dev/ram in device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sda1: Aliased to /dev/disk/by-path/pci-0000:02:0e.0-scsi-0:2:0:0-part1 in device cache (preferred name)
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sdb1: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sdc1: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sdg1: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sdd1: Aliased to /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0003000000000000-part1 in device cache (preferred name)
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sde1: Aliased to /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0004000000000000-part1 in device cache (preferred name)
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sdf1: Aliased to /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0005000000000000-part1 in device cache (preferred name)
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sdh1: Aliased to /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0007000000000000-part1 in device cache (preferred name)
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ramdisk: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/mapper/VolGroup00-LogVol01: Aliased to /dev/VolGroup00/LogVol01 in device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram0: Aliased to /dev/ramdisk in device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/root: Aliased to /dev/VolGroup00/LogVol00 in device cache (preferred name)
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/dm-1: Aliased to /dev/VolGroup00/LogVol01 in device cache (preferred name)
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:02:0e.0-scsi-0:2:0:0-part2: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram2: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/sda2: Aliased to /dev/disk/by-path/pci-0000:02:0e.0-scsi-0:2:0:0-part2 in device cache (preferred name)
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram8: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram9: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/dm-0: Aliased to /dev/root in device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram15: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0001000000000000-part1: Aliased to /dev/sdb1 in device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0006000000000000-part1: Aliased to /dev/sdg1 in device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram3: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram4: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/ram7: Added to device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: /dev/disk/by-path/pci-0000:0b:02.0-fc-0x500805f3000a05b1:0x0002000000000000-part1: Aliased to /dev/sdc1 in device cache
>Jun 18 04:07:02 taft-03 lvm[5458]: Loaded persistent filter cache from /etc/lvm/cache/.cache
>Jun 18 04:07:02 taft-03 lvm[5458]: Closed /etc/lvm/cache/.cache
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting activation/reserved_stack to 256
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting activation/reserved_memory to 8192
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting activation/process_priority to -18
>Jun 18 04:07:02 taft-03 lvm[5458]: Initialised format: lvm1
>Jun 18 04:07:02 taft-03 lvm[5458]: Initialised format: pool
>Jun 18 04:07:02 taft-03 lvm[5458]: Initialised format: lvm2
>Jun 18 04:07:02 taft-03 lvm[5458]: global/format not found in config: defaulting to lvm2
>Jun 18 04:07:02 taft-03 lvm[5458]: lvmcache: initialised VG #orphans_lvm1
>Jun 18 04:07:02 taft-03 lvm[5458]: lvmcache: initialised VG #orphans_pool
>Jun 18 04:07:02 taft-03 lvm[5458]: lvmcache: initialised VG #orphans_lvm2
>Jun 18 04:07:02 taft-03 lvm[5458]: Initialised segtype: striped
>Jun 18 04:07:02 taft-03 lvm[5458]: Initialised segtype: zero
>Jun 18 04:07:02 taft-03 lvm[5458]: Initialised segtype: error
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting dmeventd/snapshot_library to libdevmapper-event-lvm2snapshot.so
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting global/library_dir to /usr/lib64
>Jun 18 04:07:02 taft-03 lvm[5458]: Initialised segtype: snapshot
>Jun 18 04:07:02 taft-03 lvm[5458]: Initialised segtype: mirror
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting backup/retain_days to 30
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting backup/retain_min to 10
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting backup/archive_dir to /etc/lvm/archive
>Jun 18 04:07:02 taft-03 lvm[5458]: Setting backup/backup_dir to /etc/lvm/backup
>Jun 18 04:07:02 taft-03 lvm[5458]: Locking memory
>Jun 18 04:07:02 taft-03 lvm[5458]: memlock_count inc to 1
>Jun 18 04:07:02 taft-03 lvm[5458]: Parsing: _memlock_inc
>Jun 18 04:07:07 taft-03 kernel: dm-cmirror: Node joining
>Jun 18 04:07:07 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (Wf1jc3r2)
>Jun 18 04:07:07 taft-03 kernel: dm-cmirror:   starter     : 3
>Jun 18 04:07:07 taft-03 kernel: dm-cmirror:   co-ordinator: 3
>Jun 18 04:07:07 taft-03 kernel: dm-cmirror:   node_count  : 1
>Jun 18 04:07:12 taft-03 kernel: dm-cmirror: Node joining
>Jun 18 04:07:13 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (Wf1jc3r2)
>Jun 18 04:07:13 taft-03 kernel: dm-cmirror:   starter     : 4
>Jun 18 04:07:13 taft-03 kernel: dm-cmirror:   co-ordinator: 4
>Jun 18 04:07:13 taft-03 kernel: dm-cmirror:   node_count  : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (none)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 4
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 4
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: Creating jObOWCeF (1)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: cluster_resume: Setting recovery_halted = 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: server_id=dead, server_valid=0, jObOWCeF
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: trigger = LRT_GET_RESYNC_WORK
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 3
>Jun 18 04:07:15 taft-03 lvm[5458]: Monitoring mirror device helter_skelter-syncd_secondary_3legs_2 for events 
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 3
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 2
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 2
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 2
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 3
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_SELECTION(11): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 4
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 2
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 4
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_SELECTION(11): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 3
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 2
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_SELECTION(11): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 2
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 3
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_MASTER_ASSIGN(12): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 4
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 2
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_SELECTION(11): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 4
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_MASTER_ASSIGN(12): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 3
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: I'm the cluster mirror log server for jObOWCeF
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: Disk Resume::  jObOWCeF (active)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Live nodes        :: 4
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   In-Use Regions    :: 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Good IUR's        :: 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Bad IUR's         :: 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Sync count        :: 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Disk Region count :: 18446744073709551615
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Region count      :: 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   NOTE:  Mapping has changed.
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: Marked regions::
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   0 - 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Total = 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: Out-of-sync regions::
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   0 - 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Total = 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: LRT_MASTER_ASSIGN(12): (jObOWCeF)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   starter     : 2
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   node_count  : 1
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: I'm the cluster mirror log server for jObOWCeF
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: Disk Resume::  jObOWCeF (active)
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Live nodes        :: 4
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   In-Use Regions    :: 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Good IUR's        :: 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Bad IUR's         :: 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Sync count        :: 0
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Disk Region count :: 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Region count      :: 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: Marked regions::
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   0 - 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Total = 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror: Out-of-sync regions::
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   0 - 1600
>Jun 18 04:07:15 taft-03 kernel: dm-cmirror:   Total = 1600
>Jun 18 04:08:37 taft-03 qarshd[32509]: Talking to peer 10.15.80.47:35223
>Jun 18 04:08:37 taft-03 qarshd[32509]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_secondary_3legs_1 
>Jun 18 04:08:37 taft-03 qarshd[32509]: That's enough 
>Jun 18 04:08:37 taft-03 qarshd[32512]: Talking to peer 10.15.80.47:35224
>Jun 18 04:08:37 taft-03 qarshd[32512]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_secondary_3legs_2 
>Jun 18 04:08:37 taft-03 kernel: dm-cmirror: server_id=1, server_valid=0, jObOWCeF
>Jun 18 04:08:37 taft-03 kernel: dm-cmirror: trigger = LRT_GET_SYNC_COUNT
>Jun 18 04:08:37 taft-03 kernel: dm-cmirror: LRT_ELECTION(10): (jObOWCeF)
>Jun 18 04:08:37 taft-03 kernel: dm-cmirror:   starter     : 1
>Jun 18 04:08:37 taft-03 kernel: dm-cmirror:   co-ordinator: 1
>Jun 18 04:08:37 taft-03 kernel: dm-cmirror:   node_count  : 0

Actions: View

Attachments on bug 452121: 309850 | 310272 | 310273 | 310277 | 310279