Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 316097 Details for
Bug 461498
RHEL5 cmirror tracker: log failure on 3-way mirror leads to I/O errors
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
log from taft-01
taft-01.log (text/plain), 49.92 KB, created by
Corey Marthaler
on 2008-09-08 16:07:27 UTC
(
hide
)
Description:
log from taft-01
Filename:
MIME Type:
Creator:
Corey Marthaler
Created:
2008-09-08 16:07:27 UTC
Size:
49.92 KB
patch
obsolete
>Sep 7 12:35:27 taft-01 qarshd[8528]: Running cmdline: lvcreate -m 2 -n nonsyncd_log_3legs_1 -L 600M helter_skelter /dev/sdg1:0-1000 /dev/sde1:0-1000 /dev/sdf1:0-1000 /dev/sdh1:0-150 >Sep 7 12:35:29 taft-01 [6259]: Monitoring mirror device helter_skelter-nonsyncd_log_3legs_1 for events >Sep 7 12:35:29 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8528 duration=2(sec) >Sep 7 12:35:29 taft-01 xinetd[6638]: START: qarsh pid=8616 from=10.15.80.47 >Sep 7 12:35:29 taft-01 qarshd[8616]: Talking to peer 10.15.80.47:57456 >Sep 7 12:35:29 taft-01 qarshd[8616]: Running cmdline: lvcreate -m 2 -n nonsyncd_log_3legs_2 -L 600M helter_skelter /dev/sdg1:0-1000 /dev/sde1:0-1000 /dev/sdf1:0-1000 /dev/sdh1:0-150 >Sep 7 12:35:30 taft-01 lvm[6259]: Monitoring mirror device helter_skelter-nonsyncd_log_3legs_2 for events >Sep 7 12:35:30 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8616 duration=1(sec) >Sep 7 12:35:30 taft-01 xinetd[6638]: START: qarsh pid=8720 from=10.15.80.47 >Sep 7 12:35:30 taft-01 qarshd[8720]: Talking to peer 10.15.80.47:57463 >Sep 7 12:35:30 taft-01 qarshd[8720]: Running cmdline: lvcreate -m 2 -n nonsyncd_log_3legs_3 -L 600M helter_skelter /dev/sdg1:0-1000 /dev/sde1:0-1000 /dev/sdf1:0-1000 /dev/sdh1:0-150 >Sep 7 12:35:32 taft-01 lvm[6259]: Monitoring mirror device helter_skelter-nonsyncd_log_3legs_3 for events >Sep 7 12:35:32 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8720 duration=2(sec) >Sep 7 12:35:32 taft-01 xinetd[6638]: START: qarsh pid=8819 from=10.15.80.47 >Sep 7 12:35:32 taft-01 qarshd[8819]: Talking to peer 10.15.80.47:57467 >Sep 7 12:35:32 taft-01 qarshd[8819]: Running cmdline: lvs -a -o +devices >Sep 7 12:35:32 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8819 duration=0(sec) >Sep 7 12:35:32 taft-01 xinetd[6638]: START: qarsh pid=8833 from=10.15.80.47 >Sep 7 12:35:32 taft-01 qarshd[8833]: Talking to peer 10.15.80.47:57468 >Sep 7 12:35:32 taft-01 qarshd[8833]: Running cmdline: dmsetup status helter_skelter-nonsyncd_log_3legs_1 >Sep 7 12:35:32 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8833 duration=0(sec) >Sep 7 12:35:32 taft-01 xinetd[6638]: START: qarsh pid=8835 from=10.15.80.47 >Sep 7 12:35:32 taft-01 qarshd[8835]: Talking to peer 10.15.80.47:57469 >Sep 7 12:35:32 taft-01 qarshd[8835]: Running cmdline: dmsetup status helter_skelter-nonsyncd_log_3legs_2 >Sep 7 12:35:32 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8835 duration=0(sec) >Sep 7 12:35:32 taft-01 xinetd[6638]: START: qarsh pid=8837 from=10.15.80.47 >Sep 7 12:35:32 taft-01 qarshd[8837]: Talking to peer 10.15.80.47:57470 >Sep 7 12:35:32 taft-01 qarshd[8837]: Running cmdline: dmsetup status helter_skelter-nonsyncd_log_3legs_3 >Sep 7 12:35:32 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8837 duration=0(sec) >Sep 7 12:35:32 taft-01 xinetd[6638]: START: qarsh pid=8839 from=10.15.80.47 >Sep 7 12:35:32 taft-01 qarshd[8839]: Talking to peer 10.15.80.47:57471 >Sep 7 12:35:32 taft-01 qarshd[8839]: Running cmdline: cman_tool status >Sep 7 12:35:32 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8839 duration=0(sec) >Sep 7 12:35:32 taft-01 xinetd[6638]: START: qarsh pid=8841 from=10.15.80.47 >Sep 7 12:35:32 taft-01 qarshd[8841]: Talking to peer 10.15.80.47:57472 >Sep 7 12:35:32 taft-01 qarshd[8841]: Running cmdline: gfs_mkfs -J 32M -j 4 -p lock_dlm -t TAFT:gfs1 /dev/helter_skelter/nonsyncd_log_3legs_1 -O >Sep 7 12:36:02 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8841 duration=30(sec) >Sep 7 12:36:02 taft-01 xinetd[6638]: START: qarsh pid=8863 from=10.15.80.47 >Sep 7 12:36:02 taft-01 qarshd[8863]: Talking to peer 10.15.80.47:57521 >Sep 7 12:36:02 taft-01 qarshd[8863]: Running cmdline: gfs_mkfs -J 32M -j 4 -p lock_dlm -t TAFT:gfs2 /dev/helter_skelter/nonsyncd_log_3legs_2 -O >Sep 7 12:36:05 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8863 duration=3(sec) >Sep 7 12:36:05 taft-01 xinetd[6638]: START: qarsh pid=8865 from=10.15.80.47 >Sep 7 12:36:05 taft-01 qarshd[8865]: Talking to peer 10.15.80.47:57529 >Sep 7 12:36:05 taft-01 qarshd[8865]: Running cmdline: gfs_mkfs -J 32M -j 4 -p lock_dlm -t TAFT:gfs3 /dev/helter_skelter/nonsyncd_log_3legs_3 -O >Sep 7 12:36:10 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8865 duration=5(sec) >Sep 7 12:36:10 taft-01 xinetd[6638]: START: qarsh pid=8867 from=10.15.80.47 >Sep 7 12:36:10 taft-01 qarshd[8867]: Talking to peer 10.15.80.47:57551 >Sep 7 12:36:10 taft-01 qarshd[8867]: Running cmdline: mkdir -p /mnt/nonsyncd_log_3legs_1 >Sep 7 12:36:10 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8867 duration=0(sec) >Sep 7 12:36:10 taft-01 xinetd[6638]: START: qarsh pid=8869 from=10.15.80.47 >Sep 7 12:36:10 taft-01 qarshd[8869]: Talking to peer 10.15.80.47:57552 >Sep 7 12:36:10 taft-01 qarshd[8869]: Running cmdline: mount /dev/helter_skelter/nonsyncd_log_3legs_1 /mnt/nonsyncd_log_3legs_1 >Sep 7 12:36:10 taft-01 kernel: Trying to join cluster "lock_dlm", "TAFT:gfs1" >Sep 7 12:36:10 taft-01 kernel: Joined cluster. Now mounting FS... >Sep 7 12:36:10 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=0: Trying to acquire journal lock... >Sep 7 12:36:10 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=0: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=0: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=1: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=1: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=1: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=2: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=2: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=2: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=3: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=3: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: jid=3: Done >Sep 7 12:36:11 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8869 duration=1(sec) >Sep 7 12:36:11 taft-01 xinetd[6638]: START: qarsh pid=8899 from=10.15.80.47 >Sep 7 12:36:11 taft-01 qarshd[8899]: Talking to peer 10.15.80.47:57553 >Sep 7 12:36:11 taft-01 qarshd[8899]: Running cmdline: mkdir -p /mnt/nonsyncd_log_3legs_2 >Sep 7 12:36:11 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8899 duration=0(sec) >Sep 7 12:36:11 taft-01 xinetd[6638]: START: qarsh pid=8903 from=10.15.80.47 >Sep 7 12:36:11 taft-01 qarshd[8903]: Talking to peer 10.15.80.47:57554 >Sep 7 12:36:11 taft-01 qarshd[8903]: Running cmdline: mount /dev/helter_skelter/nonsyncd_log_3legs_2 /mnt/nonsyncd_log_3legs_2 >Sep 7 12:36:11 taft-01 kernel: Trying to join cluster "lock_dlm", "TAFT:gfs2" >Sep 7 12:36:11 taft-01 kernel: Joined cluster. Now mounting FS... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=0: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=0: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=0: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=1: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=1: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=1: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=2: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=2: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=2: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=3: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=3: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs2.0: jid=3: Done >Sep 7 12:36:11 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8903 duration=0(sec) >Sep 7 12:36:11 taft-01 qarshd[8939]: Talking to peer 10.15.80.47:57555 >Sep 7 12:36:11 taft-01 xinetd[6638]: START: qarsh pid=8939 from=10.15.80.47 >Sep 7 12:36:11 taft-01 qarshd[8939]: Running cmdline: mkdir -p /mnt/nonsyncd_log_3legs_3 >Sep 7 12:36:11 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8939 duration=0(sec) >Sep 7 12:36:11 taft-01 xinetd[6638]: START: qarsh pid=8943 from=10.15.80.47 >Sep 7 12:36:11 taft-01 qarshd[8943]: Talking to peer 10.15.80.47:57556 >Sep 7 12:36:11 taft-01 qarshd[8943]: Running cmdline: mount /dev/helter_skelter/nonsyncd_log_3legs_3 /mnt/nonsyncd_log_3legs_3 >Sep 7 12:36:11 taft-01 kernel: Trying to join cluster "lock_dlm", "TAFT:gfs3" >Sep 7 12:36:11 taft-01 kernel: Joined cluster. Now mounting FS... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=0: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=0: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=0: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=1: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=1: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=1: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=2: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=2: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=2: Done >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=3: Trying to acquire journal lock... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=3: Looking at journal... >Sep 7 12:36:11 taft-01 kernel: GFS: fsid=TAFT:gfs3.0: jid=3: Done >Sep 7 12:36:11 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8943 duration=0(sec) >Sep 7 12:36:15 taft-01 xinetd[6638]: START: qarsh pid=8987 from=10.15.80.47 >Sep 7 12:36:15 taft-01 qarshd[8987]: Talking to peer 10.15.80.47:43012 >Sep 7 12:36:15 taft-01 qarshd[8987]: Running cmdline: mkdir -p /mnt/nonsyncd_log_3legs_1/checkit >Sep 7 12:36:16 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8987 duration=1(sec) >Sep 7 12:36:16 taft-01 xinetd[6638]: START: qarsh pid=8989 from=10.15.80.47 >Sep 7 12:36:16 taft-01 qarshd[8989]: Talking to peer 10.15.80.47:43013 >Sep 7 12:36:16 taft-01 qarshd[8989]: Running cmdline: /usr/tests/sts-rhel5.3/bin/checkit -w /mnt/nonsyncd_log_3legs_1/checkit -f /tmp/checkit_nonsyncd_log_3legs_1 -n 100 >Sep 7 12:36:17 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8989 duration=1(sec) >Sep 7 12:36:17 taft-01 xinetd[6638]: START: qarsh pid=8991 from=10.15.80.47 >Sep 7 12:36:17 taft-01 qarshd[8991]: Talking to peer 10.15.80.47:43014 >Sep 7 12:36:17 taft-01 qarshd[8991]: Running cmdline: mkdir -p /mnt/nonsyncd_log_3legs_2/checkit >Sep 7 12:36:17 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8991 duration=0(sec) >Sep 7 12:36:17 taft-01 xinetd[6638]: START: qarsh pid=8993 from=10.15.80.47 >Sep 7 12:36:17 taft-01 qarshd[8993]: Talking to peer 10.15.80.47:43015 >Sep 7 12:36:17 taft-01 qarshd[8993]: Running cmdline: /usr/tests/sts-rhel5.3/bin/checkit -w /mnt/nonsyncd_log_3legs_2/checkit -f /tmp/checkit_nonsyncd_log_3legs_2 -n 100 >Sep 7 12:36:18 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8993 duration=1(sec) >Sep 7 12:36:18 taft-01 xinetd[6638]: START: qarsh pid=8995 from=10.15.80.47 >Sep 7 12:36:18 taft-01 qarshd[8995]: Talking to peer 10.15.80.47:43017 >Sep 7 12:36:18 taft-01 qarshd[8995]: Running cmdline: mkdir -p /mnt/nonsyncd_log_3legs_3/checkit >Sep 7 12:36:18 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8995 duration=0(sec) >Sep 7 12:36:18 taft-01 xinetd[6638]: START: qarsh pid=8997 from=10.15.80.47 >Sep 7 12:36:18 taft-01 qarshd[8997]: Talking to peer 10.15.80.47:43018 >Sep 7 12:36:18 taft-01 qarshd[8997]: Running cmdline: /usr/tests/sts-rhel5.3/bin/checkit -w /mnt/nonsyncd_log_3legs_3/checkit -f /tmp/checkit_nonsyncd_log_3legs_3 -n 100 >Sep 7 12:36:19 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=8997 duration=1(sec) >Sep 7 12:36:30 taft-01 xinetd[6638]: START: qarsh pid=9001 from=10.15.80.47 >Sep 7 12:36:30 taft-01 qarshd[9001]: Talking to peer 10.15.80.47:43039 >Sep 7 12:36:30 taft-01 qarshd[9001]: Running cmdline: /usr/tests/sts-rhel5.3/bin/xiogen -f buffered -m random -s write,writev -t 100 -T 1000000 -F 1000000:/mnt/nonsyncd_log_3legs_2/taft-01_load | /usr/tests/sts-rhel5.3/bin/xdoio -v >Sep 7 12:36:30 taft-01 xinetd[6638]: START: qarsh pid=9003 from=10.15.80.47 >Sep 7 12:36:30 taft-01 qarshd[9003]: Talking to peer 10.15.80.47:43040 >Sep 7 12:36:30 taft-01 xinetd[6638]: START: qarsh pid=9004 from=10.15.80.47 >Sep 7 12:36:30 taft-01 qarshd[9004]: Talking to peer 10.15.80.47:43041 >Sep 7 12:36:30 taft-01 qarshd[9004]: Running cmdline: /usr/tests/sts-rhel5.3/bin/xiogen -f buffered -m random -s write,writev -t 100 -T 1000000 -F 1000000:/mnt/nonsyncd_log_3legs_3/taft-01_load | /usr/tests/sts-rhel5.3/bin/xdoio -v >Sep 7 12:36:30 taft-01 qarshd[9003]: Running cmdline: /usr/tests/sts-rhel5.3/bin/xiogen -f buffered -m random -s write,writev -t 100 -T 1000000 -F 1000000:/mnt/nonsyncd_log_3legs_1/taft-01_load | /usr/tests/sts-rhel5.3/bin/xdoio -v >Sep 7 12:36:30 taft-01 lvm[6259]: helter_skelter-nonsyncd_log_3legs_2 is now in-sync >Sep 7 12:36:30 taft-01 lvm[6259]: helter_skelter-nonsyncd_log_3legs_3 is now in-sync >Sep 7 12:36:30 taft-01 lvm[6259]: helter_skelter-nonsyncd_log_3legs_1 is now in-sync >Sep 7 12:36:47 taft-01 xinetd[6638]: START: qarsh pid=9016 from=10.15.80.47 >Sep 7 12:36:47 taft-01 qarshd[9016]: Talking to peer 10.15.80.47:43053 >Sep 7 12:36:47 taft-01 qarshd[9016]: Running cmdline: /usr/tests/sts-rhel5.3/bin/checkit -w /mnt/nonsyncd_log_3legs_1/checkit -f /tmp/checkit_nonsyncd_log_3legs_1 -v >Sep 7 12:36:54 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=9016 duration=7(sec) >Sep 7 12:36:54 taft-01 xinetd[6638]: START: qarsh pid=9018 from=10.15.80.47 >Sep 7 12:36:54 taft-01 qarshd[9018]: Talking to peer 10.15.80.47:43055 >Sep 7 12:36:54 taft-01 qarshd[9018]: Running cmdline: /usr/tests/sts-rhel5.3/bin/checkit -w /mnt/nonsyncd_log_3legs_2/checkit -f /tmp/checkit_nonsyncd_log_3legs_2 -v >Sep 7 12:37:00 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=9018 duration=6(sec) >Sep 7 12:37:00 taft-01 xinetd[6638]: START: qarsh pid=9020 from=10.15.80.47 >Sep 7 12:37:00 taft-01 qarshd[9020]: Talking to peer 10.15.80.47:43056 >Sep 7 12:37:00 taft-01 qarshd[9020]: Running cmdline: /usr/tests/sts-rhel5.3/bin/checkit -w /mnt/nonsyncd_log_3legs_3/checkit -f /tmp/checkit_nonsyncd_log_3legs_3 -v >Sep 7 12:37:06 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=9020 duration=6(sec) >Sep 7 12:37:59 taft-01 xinetd[6638]: START: qarsh pid=9024 from=10.15.80.47 >Sep 7 12:37:59 taft-01 qarshd[9024]: Talking to peer 10.15.80.47:43068 >Sep 7 12:37:59 taft-01 qarshd[9024]: Running cmdline: echo offline > /sys/block/sdh/device/state >Sep 7 12:37:59 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=9024 duration=0(sec) >Sep 7 12:37:59 taft-01 clogd[6162]: [mSnPP2Pa] rw_log: write failure: Input/output error >Sep 7 12:37:59 taft-01 clogd[6162]: [mSnPP2Pa] Error writing to disk log >Sep 7 12:37:59 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:37:59 taft-01 clogd[6162]: [4A2Z7in7] rw_log: write failure: Input/output error >Sep 7 12:37:59 taft-01 clogd[6162]: [4A2Z7in7] Error writing to disk log >Sep 7 12:37:59 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:37:59 taft-01 clogd[6162]: [4A2Z7in7] rw_log: write failure: Input/output error >Sep 7 12:37:59 taft-01 clogd[6162]: [4A2Z7in7] Error writing to disk log >Sep 7 12:37:59 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 clogd[6162]: [mSnPP2Pa] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [mSnPP2Pa] Error writing to disk log >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 clogd[6162]: [mSnPP2Pa] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [mSnPP2Pa] Error writing to disk log >Sep 7 12:38:03 taft-01 clogd[6162]: [4A2Z7in7] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [4A2Z7in7] Error writing to disk log >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 clogd[6162]: [QMBOp9bA] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [QMBOp9bA] Error writing to disk log >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 clogd[6162]: [mSnPP2Pa] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [mSnPP2Pa] Error writing to disk log >Sep 7 12:38:03 taft-01 lvm[6259]: Log device, 253:2, has failed. >Sep 7 12:38:03 taft-01 lvm[6259]: Device failure in helter_skelter-nonsyncd_log_3legs_1 >Sep 7 12:38:03 taft-01 lvm[6259]: WARNING: dev_open(/etc/lvm/lvm.conf) called while suspended >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 clogd[6162]: [4A2Z7in7] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [4A2Z7in7] Error writing to disk log >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 clogd[6162]: [mSnPP2Pa] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [mSnPP2Pa] Error writing to disk log >Sep 7 12:38:03 taft-01 clogd[6162]: [QMBOp9bA] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [QMBOp9bA] Error writing to disk log >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 clogd[6162]: [4A2Z7in7] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [4A2Z7in7] Error writing to disk log >Sep 7 12:38:03 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:03 taft-01 clogd[6162]: [QMBOp9bA] rw_log: write failure: Input/output error >Sep 7 12:38:03 taft-01 clogd[6162]: [QMBOp9bA] Error writing to disk log >Sep 7 12:38:03 taft-01 lvm[6259]: WARNING: dev_open(/dev/ramdisk) called while suspended >Sep 7 12:38:03 taft-01 last message repeated 2 times >Sep 7 12:38:03 taft-01 lvm[6259]: WARNING: dev_open(/dev/cdrom) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/md0) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/root) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/VolGroup00/LogVol01) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram2) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda2) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mlog) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mlog) called while suspended >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 last message repeated 3 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mlog) called while suspended >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram3) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_0) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram4) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram5) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_2) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram6) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram7) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mlog) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mlog) called while suspended >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mlog) called while suspended >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram8) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_0) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram9) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram10) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_2) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram11) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram12) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mlog) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mlog) called while suspended >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 last message repeated 3 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mlog) called while suspended >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram13) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_0) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram14) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram15) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_2) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg1) called while suspended >Sep 7 12:38:04 taft-01 last message repeated 2 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdh) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdh1) called while suspended >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdh1) called while suspended >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 last message repeated 3 times >Sep 7 12:38:04 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdh1) called while suspended >Sep 7 12:38:04 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:04 taft-01 xinetd[6638]: START: qarsh pid=9027 from=10.15.80.47 >Sep 7 12:38:04 taft-01 qarshd[9027]: Talking to peer 10.15.80.47:43072 >Sep 7 12:38:04 taft-01 qarshd[9027]: Running cmdline: dd if=/dev/zero of=/mnt/nonsyncd_log_3legs_1/ddfile count=10 bs=4M >Sep 7 12:38:05 taft-01 kernel: sd 1:0:0:7: rejecting I/O to offline device >Sep 7 12:38:05 taft-01 last message repeated 39 times >Sep 7 12:38:05 taft-01 clogd[6162]: [mSnPP2Pa] rw_log: write failure: Input/output error >Sep 7 12:38:05 taft-01 clogd[6162]: [mSnPP2Pa] Error writing to disk log >Sep 7 12:38:05 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: fatal: I/O error >Sep 7 12:38:05 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: block = 61696 >Sep 7 12:38:05 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: function = gfs_logbh_wait >Sep 7 12:38:05 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: file = /builddir/build/BUILD/gfs-kmod-0.1.24/_kmod_build_/src/gfs/dio.c, line = 925 >Sep 7 12:38:05 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: time = 1220809085 >Sep 7 12:38:05 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: about to withdraw from the cluster >Sep 7 12:38:05 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: telling LM to withdraw >Sep 7 12:38:06 taft-01 kernel: GFS: fsid=TAFT:gfs1.0: withdrawn >Sep 7 12:38:06 taft-01 kernel: >Sep 7 12:38:06 taft-01 kernel: Call Trace: >Sep 7 12:38:06 taft-01 kernel: [<ffffffff886000e8>] :gfs:gfs_lm_withdraw+0xc4/0xd3 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff800ba522>] delayacct_end+0x5d/0x86 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff800639de>] __wait_on_bit+0x60/0x6e >Sep 7 12:38:06 taft-01 kernel: [<ffffffff80014f04>] sync_buffer+0x0/0x3f >Sep 7 12:38:06 taft-01 lvm[6259]: Monitoring mirror device helter_skelter-nonsyncd_log_3legs_1 for events >Sep 7 12:38:06 taft-01 lvm[6259]: Another thread is handling an event. Waiting... >Sep 7 12:38:06 taft-01 kernel: [<ffffffff8009de2a>] keventd_create_kthread+0x0/0xc4 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff80063a58>] out_of_line_wait_on_bit+0x6c/0x78 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff88617937>] :gfs:gfs_io_error_bh_i+0x32/0x37 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff885edf21>] :gfs:gfs_logbh_wait+0x51/0x70 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff88602a0c>] :gfs:commit_trans+0x37/0x97 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff88603095>] :gfs:disk_commit+0x39e/0x44b >Sep 7 12:38:06 taft-01 kernel: [<ffffffff80062f4b>] thread_return+0x0/0xdf >Sep 7 12:38:06 taft-01 kernel: [<ffffffff88603a79>] :gfs:log_flush_internal+0x18a/0x26f >Sep 7 12:38:06 taft-01 kernel: [<ffffffff800dbc86>] sync_supers+0x80/0xe1 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff8005633f>] pdflush+0x0/0x1fb >Sep 7 12:38:06 taft-01 kernel: [<ffffffff800c376a>] wb_kupdate+0x2d/0x10d >Sep 7 12:38:06 taft-01 kernel: [<ffffffff8005633f>] pdflush+0x0/0x1fb >Sep 7 12:38:06 taft-01 kernel: [<ffffffff80056490>] pdflush+0x151/0x1fb >Sep 7 12:38:06 taft-01 kernel: [<ffffffff800c373d>] wb_kupdate+0x0/0x10d >Sep 7 12:38:06 taft-01 kernel: [<ffffffff8003258b>] kthread+0xfe/0x132 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff8005dfb1>] child_rip+0xa/0x11 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff8009de2a>] keventd_create_kthread+0x0/0xc4 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff8003248d>] kthread+0x0/0x132 >Sep 7 12:38:06 taft-01 kernel: [<ffffffff8005dfa7>] child_rip+0x0/0x11 >Sep 7 12:38:06 taft-01 kernel: >Sep 7 12:38:06 taft-01 clogd[6162]: [4A2Z7in7] rw_log: write failure: Input/output error >Sep 7 12:38:06 taft-01 clogd[6162]: [4A2Z7in7] Error writing to disk log >Sep 7 12:38:06 taft-01 lvm[6259]: Another thread is handling an event. Waiting... >Sep 7 12:38:06 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=9003 duration=96(sec) >Sep 7 12:38:06 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=9027 duration=2(sec) >Sep 7 12:38:06 taft-01 qarshd[9004]: Sending child 9007 signal 2 >Sep 7 12:38:06 taft-01 qarshd[9001]: Sending child 9002 signal 2 >Sep 7 12:38:06 taft-01 clogd[6162]: [QMBOp9bA] rw_log: write failure: Input/output error >Sep 7 12:38:06 taft-01 clogd[6162]: [QMBOp9bA] Error writing to disk log >Sep 7 12:38:06 taft-01 lvm[6259]: Another thread is handling an event. Waiting... >Sep 7 12:38:06 taft-01 clogd[6162]: [QMBOp9bA] rw_log: write failure: Input/output error >Sep 7 12:38:06 taft-01 clogd[6162]: [QMBOp9bA] Error writing to disk log >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Bad device removed from mirror volume, helter_skelter/nonsyncd_log_3legs_1 >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Failed to replace mirror log device in helter_skelter/nonsyncd_log_3legs_1 >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Use 'lvconvert -m 2 helter_skelter/nonsyncd_log_3legs_1' to replace failed devices >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Unable to find substitute device for mirror volume, helter_skelter/nonsyncd_log_3legs_1 >Sep 7 12:38:06 taft-01 lvm[6259]: Monitoring mirror device helter_skelter-nonsyncd_log_3legs_2 for events >Sep 7 12:38:06 taft-01 lvm[6259]: Another thread is handling an event. Waiting... >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Bad device removed from mirror volume, helter_skelter/nonsyncd_log_3legs_2 >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Failed to replace mirror log device in helter_skelter/nonsyncd_log_3legs_2 >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Use 'lvconvert -m 2 helter_skelter/nonsyncd_log_3legs_2' to replace failed devices >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Unable to find substitute device for mirror volume, helter_skelter/nonsyncd_log_3legs_2 >Sep 7 12:38:06 taft-01 clogd[6162]: [QMBOp9bA] rw_log: write failure: Input/output error >Sep 7 12:38:06 taft-01 clogd[6162]: [QMBOp9bA] Error writing to disk log >Sep 7 12:38:06 taft-01 lvm[6259]: Monitoring mirror device helter_skelter-nonsyncd_log_3legs_3 for events >Sep 7 12:38:06 taft-01 lvm[6259]: Another thread is handling an event. Waiting... >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Bad device removed from mirror volume, helter_skelter/nonsyncd_log_3legs_3 >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Failed to replace mirror log device in helter_skelter/nonsyncd_log_3legs_3 >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Use 'lvconvert -m 2 helter_skelter/nonsyncd_log_3legs_3' to replace failed devices >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: Unable to find substitute device for mirror volume, helter_skelter/nonsyncd_log_3legs_3 >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: dev_open(/etc/lvm/lvm.conf) called while suspended >Sep 7 12:38:06 taft-01 lvm[6259]: Log device, 253:7, has failed. >Sep 7 12:38:06 taft-01 lvm[6259]: Device failure in helter_skelter-nonsyncd_log_3legs_2 >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: dev_open(/etc/lvm/lvm.conf) called while suspended >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: dev_open(/dev/ramdisk) called while suspended >Sep 7 12:38:06 taft-01 last message repeated 2 times >Sep 7 12:38:06 taft-01 lvm[6259]: WARNING: dev_open(/dev/cdrom) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/md0) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/root) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/VolGroup00/LogVol01) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram3) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_0) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram4) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram5) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram6) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram7) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram8) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_0) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram9) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram10) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram11) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram12) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram13) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_0) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram14) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram15) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdh) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdh1) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/etc/lvm/lvm.conf) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: Log device, 253:12, has failed. >Sep 7 12:38:07 taft-01 lvm[6259]: Device failure in helter_skelter-nonsyncd_log_3legs_3 >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/etc/lvm/lvm.conf) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ramdisk) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/cdrom) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/md0) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/root) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/VolGroup00/LogVol01) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sda2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram3) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_0) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram4) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram5) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_1_mimage_2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram6) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram7) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram8) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_0) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram9) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram10) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_2_mimage_2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram11) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram12) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram13) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_0) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram14) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/ram15) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/mapper/helter_skelter-nonsyncd_log_3legs_3_mimage_2) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdb1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdc1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdd1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sde1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdf1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdg1) called while suspended >Sep 7 12:38:07 taft-01 last message repeated 2 times >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdh) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/dev/sdh1) called while suspended >Sep 7 12:38:07 taft-01 lvm[6259]: WARNING: dev_open(/etc/lvm/lvm.conf) called while suspended >Sep 7 12:38:08 taft-01 lvm[6259]: No longer monitoring mirror device helter_skelter-nonsyncd_log_3legs_1 for events >Sep 7 12:38:10 taft-01 lvm[6259]: No longer monitoring mirror device helter_skelter-nonsyncd_log_3legs_2 for events >Sep 7 12:38:11 taft-01 qarshd[9004]: Sending child 9007 signal 2 >Sep 7 12:38:11 taft-01 qarshd[9001]: Sending child 9002 signal 2 >Sep 7 12:38:11 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=9001 duration=101(sec) >Sep 7 12:38:11 taft-01 xinetd[6638]: EXIT: qarsh status=0 pid=9004 duration=101(sec) >Sep 7 12:38:12 taft-01 lvm[6259]: No longer monitoring mirror device helter_skelter-nonsyncd_log_3legs_3 for events >Sep 7 14:13:27 taft-01 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Sep 7 14:13:27 taft-01 dhclient: DHCPACK from 10.15.89.100 >Sep 7 14:13:27 taft-01 dhclient: bound to 10.15.89.67 -- renewal in 10313 seconds. >Sep 7 17:05:20 taft-01 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Sep 7 17:05:20 taft-01 dhclient: DHCPACK from 10.15.89.100 >Sep 7 17:05:20 taft-01 dhclient: bound to 10.15.89.67 -- renewal in 9034 seconds. >Sep 7 19:35:54 taft-01 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Sep 7 19:35:54 taft-01 dhclient: DHCPACK from 10.15.89.100 >Sep 7 19:35:54 taft-01 dhclient: bound to 10.15.89.67 -- renewal in 8593 seconds. >Sep 7 21:59:07 taft-01 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Sep 7 21:59:07 taft-01 dhclient: DHCPACK from 10.15.89.100 >Sep 7 21:59:07 taft-01 dhclient: bound to 10.15.89.67 -- renewal in 10297 seconds. >Sep 8 00:50:44 taft-01 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Sep 8 00:50:44 taft-01 dhclient: DHCPACK from 10.15.89.100 >Sep 8 00:50:44 taft-01 dhclient: bound to 10.15.89.67 -- renewal in 10063 seconds. >Sep 8 03:38:27 taft-01 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Sep 8 03:38:27 taft-01 dhclient: DHCPACK from 10.15.89.100 >Sep 8 03:38:27 taft-01 dhclient: bound to 10.15.89.67 -- renewal in 9477 seconds. >Sep 8 04:02:25 taft-01 lvm[6259]: helter_skelter-nonsyncd_log_3legs_2 is now in-sync >Sep 8 04:02:25 taft-01 lvm[6259]: helter_skelter-nonsyncd_log_3legs_3 is now in-sync >Sep 8 06:16:24 taft-01 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Sep 8 06:16:24 taft-01 dhclient: DHCPACK from 10.15.89.100 >Sep 8 06:16:24 taft-01 dhclient: bound to 10.15.89.67 -- renewal in 8464 seconds. >Sep 8 08:37:28 taft-01 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Sep 8 08:37:28 taft-01 dhclient: DHCPACK from 10.15.89.100 >Sep 8 08:37:28 taft-01 dhclient: bound to 10.15.89.67 -- renewal in 10577 seconds. >Sep 8 10:31:40 taft-01 avahi-daemon[6761]: recvmsg(): Resource temporarily unavailable
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 461498
: 316097