Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 310702 Details for
Bug 254225
clustered_log service stuck in update after mirror leg failure + node failure
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
log and kern dump from taft-02
taft-02.log (text/plain), 151.23 KB, created by
Corey Marthaler
on 2008-07-01 18:47:57 UTC
(
hide
)
Description:
log and kern dump from taft-02
Filename:
MIME Type:
Creator:
Corey Marthaler
Created:
2008-07-01 18:47:57 UTC
Size:
151.23 KB
patch
obsolete
>Jul 1 11:08:03 taft-02 qarshd[12083]: Running cmdline: lvcreate -m 1 -n syncd_primary_2legs_2 -L 800M helter_skelter /dev/sde1:0-1000 /dev/sdh1:0-1000 /dev/sdg1:0-150 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: Creating 65rpnvNP (1) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: cluster_resume: Setting recovery_halted = 0 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: server_id=dead, server_valid=0, 65rpnvNP >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: trigger = LRT_GET_RESYNC_WORK >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_ELECTION(10): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 3 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 3 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_ELECTION(10): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 2 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 2 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 0 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_ELECTION(10): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 1 >Jul 1 11:08:03 taft-02 lvm[7189]: Monitoring mirror device helter_skelter-syncd_primary_2legs_2 for events >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_ELECTION(10): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 4 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 2 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_SELECTION(11): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 3 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 3 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_ELECTION(10): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 2 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 4 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_SELECTION(11): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_SELECTION(11): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 4 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 2 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: LRT_MASTER_ASSIGN(12): (65rpnvNP) >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: starter : 3 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: co-ordinator: 1 >Jul 1 11:08:03 taft-02 kernel: dm-cmirror: node_count : 1 >Jul 1 11:08:03 taft-02 qarshd[12083]: That's enough >Jul 1 11:08:03 taft-02 qarshd[12154]: Talking to peer 10.15.80.47:45296 >Jul 1 11:08:03 taft-02 qarshd[12154]: Running cmdline: lvs -a -o +devices >Jul 1 11:08:04 taft-02 qarshd[12154]: That's enough >Jul 1 11:08:04 taft-02 qarshd[12157]: Talking to peer 10.15.80.47:45297 >Jul 1 11:08:04 taft-02 qarshd[12157]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_1 >Jul 1 11:08:04 taft-02 qarshd[12157]: That's enough >Jul 1 11:08:04 taft-02 qarshd[12160]: Talking to peer 10.15.80.47:45298 >Jul 1 11:08:04 taft-02 qarshd[12160]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_2 >Jul 1 11:08:04 taft-02 qarshd[12160]: That's enough >Jul 1 11:08:14 taft-02 qarshd[12165]: Talking to peer 10.15.80.47:45300 >Jul 1 11:08:14 taft-02 qarshd[12165]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_1 >Jul 1 11:08:14 taft-02 qarshd[12165]: That's enough >Jul 1 11:08:14 taft-02 qarshd[12168]: Talking to peer 10.15.80.47:45301 >Jul 1 11:08:14 taft-02 qarshd[12168]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_2 >Jul 1 11:08:14 taft-02 qarshd[12168]: That's enough >Jul 1 11:08:24 taft-02 qarshd[12173]: Talking to peer 10.15.80.47:45303 >Jul 1 11:08:24 taft-02 qarshd[12173]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_1 >Jul 1 11:08:24 taft-02 qarshd[12173]: That's enough >Jul 1 11:08:24 taft-02 qarshd[12176]: Talking to peer 10.15.80.47:45304 >Jul 1 11:08:24 taft-02 qarshd[12176]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_2 >Jul 1 11:08:24 taft-02 qarshd[12176]: That's enough >Jul 1 11:08:34 taft-02 qarshd[12181]: Talking to peer 10.15.80.47:45305 >Jul 1 11:08:34 taft-02 qarshd[12181]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_1 >Jul 1 11:08:34 taft-02 qarshd[12181]: That's enough >Jul 1 11:08:34 taft-02 qarshd[12184]: Talking to peer 10.15.80.47:45306 >Jul 1 11:08:34 taft-02 qarshd[12184]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_2 >Jul 1 11:08:34 taft-02 qarshd[12184]: That's enough >Jul 1 11:08:44 taft-02 qarshd[12189]: Talking to peer 10.15.80.47:45308 >Jul 1 11:08:44 taft-02 qarshd[12189]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_1 >Jul 1 11:08:44 taft-02 qarshd[12189]: That's enough >Jul 1 11:08:44 taft-02 qarshd[12192]: Talking to peer 10.15.80.47:45309 >Jul 1 11:08:44 taft-02 qarshd[12192]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_2 >Jul 1 11:08:44 taft-02 qarshd[12192]: That's enough >Jul 1 11:08:54 taft-02 qarshd[12197]: Talking to peer 10.15.80.47:45310 >Jul 1 11:08:54 taft-02 qarshd[12197]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_1 >Jul 1 11:08:54 taft-02 qarshd[12197]: That's enough >Jul 1 11:08:54 taft-02 qarshd[12200]: Talking to peer 10.15.80.47:45311 >Jul 1 11:08:54 taft-02 qarshd[12200]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_2 >Jul 1 11:08:54 taft-02 qarshd[12200]: That's enough >Jul 1 11:09:04 taft-02 qarshd[12205]: Talking to peer 10.15.80.47:45312 >Jul 1 11:09:04 taft-02 qarshd[12205]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_1 >Jul 1 11:09:04 taft-02 qarshd[12205]: That's enough >Jul 1 11:09:04 taft-02 qarshd[12208]: Talking to peer 10.15.80.47:45313 >Jul 1 11:09:04 taft-02 qarshd[12208]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_2 >Jul 1 11:09:04 taft-02 qarshd[12208]: That's enough >Jul 1 11:09:14 taft-02 qarshd[12213]: Talking to peer 10.15.80.47:45316 >Jul 1 11:09:14 taft-02 qarshd[12213]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_1 >Jul 1 11:09:14 taft-02 qarshd[12213]: That's enough >Jul 1 11:09:14 taft-02 qarshd[12216]: Talking to peer 10.15.80.47:45317 >Jul 1 11:09:14 taft-02 qarshd[12216]: Running cmdline: lvs -o copy_percent --noheadings helter_skelter/syncd_primary_2legs_2 >Jul 1 11:09:14 taft-02 qarshd[12216]: That's enough >Jul 1 11:09:14 taft-02 qarshd[12219]: Talking to peer 10.15.80.47:45322 >Jul 1 11:09:14 taft-02 qarshd[12219]: Running cmdline: gfs_mkfs -J 32M -j 4 -p lock_dlm -t TAFT:gfs1 /dev/helter_skelter/syncd_primary_2legs_1 -O >Jul 1 11:09:15 taft-02 lvm[7189]: helter_skelter-syncd_primary_2legs_1 is now in-sync >Jul 1 11:09:15 taft-02 qarshd[12219]: That's enough >Jul 1 11:09:15 taft-02 qarshd[12221]: Talking to peer 10.15.80.47:45323 >Jul 1 11:09:15 taft-02 qarshd[12221]: Running cmdline: gfs_mkfs -J 32M -j 4 -p lock_dlm -t TAFT:gfs2 /dev/helter_skelter/syncd_primary_2legs_2 -O >Jul 1 11:09:15 taft-02 lvm[7189]: helter_skelter-syncd_primary_2legs_2 is now in-sync >Jul 1 11:09:17 taft-02 qarshd[12221]: That's enough >Jul 1 11:09:22 taft-02 qarshd[12225]: Talking to peer 10.15.80.47:45329 >Jul 1 11:09:22 taft-02 qarshd[12225]: Running cmdline: mkdir -p /mnt/syncd_primary_2legs_1 >Jul 1 11:09:22 taft-02 qarshd[12225]: That's enough >Jul 1 11:09:22 taft-02 qarshd[12227]: Talking to peer 10.15.80.47:45330 >Jul 1 11:09:22 taft-02 qarshd[12227]: Running cmdline: mount -t gfs /dev/helter_skelter/syncd_primary_2legs_1 /mnt/syncd_primary_2legs_1 >Jul 1 11:09:22 taft-02 kernel: Lock_Harness 2.6.9-80.3 (built Jun 4 2008 11:59:08) installed >Jul 1 11:09:22 taft-02 kernel: GFS 2.6.9-80.3 (built Jun 4 2008 11:59:21) installed >Jul 1 11:09:22 taft-02 kernel: GFS: Trying to join cluster "lock_dlm", "TAFT:gfs1" >Jul 1 11:09:22 taft-02 kernel: Lock_DLM (built Jun 4 2008 11:59:10) installed >Jul 1 11:09:24 taft-02 kernel: GFS: fsid=TAFT:gfs1.1: Joined cluster. Now mounting FS... >Jul 1 11:09:24 taft-02 kernel: GFS: fsid=TAFT:gfs1.1: jid=1: Trying to acquire journal lock... >Jul 1 11:09:24 taft-02 kernel: GFS: fsid=TAFT:gfs1.1: jid=1: Looking at journal... >Jul 1 11:09:24 taft-02 kernel: GFS: fsid=TAFT:gfs1.1: jid=1: Done >Jul 1 11:09:24 taft-02 qarshd[12227]: That's enough >Jul 1 11:09:24 taft-02 qarshd[12256]: Talking to peer 10.15.80.47:45331 >Jul 1 11:09:24 taft-02 qarshd[12256]: Running cmdline: mkdir -p /mnt/syncd_primary_2legs_2 >Jul 1 11:09:24 taft-02 qarshd[12256]: That's enough >Jul 1 11:09:24 taft-02 qarshd[12258]: Talking to peer 10.15.80.47:45332 >Jul 1 11:09:24 taft-02 qarshd[12258]: Running cmdline: mount -t gfs /dev/helter_skelter/syncd_primary_2legs_2 /mnt/syncd_primary_2legs_2 >Jul 1 11:09:24 taft-02 kernel: GFS: Trying to join cluster "lock_dlm", "TAFT:gfs2" >Jul 1 11:09:26 taft-02 kernel: GFS: fsid=TAFT:gfs2.1: Joined cluster. Now mounting FS... >Jul 1 11:09:26 taft-02 kernel: GFS: fsid=TAFT:gfs2.1: jid=1: Trying to acquire journal lock... >Jul 1 11:09:26 taft-02 kernel: GFS: fsid=TAFT:gfs2.1: jid=1: Looking at journal... >Jul 1 11:09:26 taft-02 kernel: GFS: fsid=TAFT:gfs2.1: jid=1: Done >Jul 1 11:09:26 taft-02 qarshd[12258]: That's enough >Jul 1 11:09:38 taft-02 qarshd[12292]: Talking to peer 10.15.80.47:45345 >Jul 1 11:09:38 taft-02 qarshd[12292]: Running cmdline: mkdir -p /mnt/syncd_primary_2legs_1/checkit >Jul 1 11:09:38 taft-02 qarshd[12292]: That's enough >Jul 1 11:09:38 taft-02 qarshd[12294]: Talking to peer 10.15.80.47:45346 >Jul 1 11:09:38 taft-02 qarshd[12294]: Running cmdline: /usr/tests/sts-rhel4.7/bin/checkit -w /mnt/syncd_primary_2legs_1/checkit -f /tmp/checkit_syncd_primary_2legs_1 -n 100 >Jul 1 11:09:39 taft-02 qarshd[12294]: That's enough >Jul 1 11:09:39 taft-02 qarshd[12296]: Talking to peer 10.15.80.47:45347 >Jul 1 11:09:39 taft-02 qarshd[12296]: Running cmdline: mkdir -p /mnt/syncd_primary_2legs_2/checkit >Jul 1 11:09:39 taft-02 qarshd[12296]: That's enough >Jul 1 11:09:39 taft-02 qarshd[12298]: Talking to peer 10.15.80.47:45348 >Jul 1 11:09:39 taft-02 qarshd[12298]: Running cmdline: /usr/tests/sts-rhel4.7/bin/checkit -w /mnt/syncd_primary_2legs_2/checkit -f /tmp/checkit_syncd_primary_2legs_2 -n 100 >Jul 1 11:09:40 taft-02 qarshd[12298]: That's enough >Jul 1 11:09:45 taft-02 qarshd[12301]: Talking to peer 10.15.80.47:45360 >Jul 1 11:09:45 taft-02 qarshd[12301]: Running cmdline: /usr/tests/sts-rhel4.7/bin/xiogen -f buffered -m random -s write,writev -t 100 -T 1000000 -F 1000000:/mnt/syncd_primary_2legs_1/taft-02_load | /usr/tests/sts-rhel4.7/bin/xdoio -v >Jul 1 11:09:45 taft-02 qarshd[12305]: Talking to peer 10.15.80.47:45363 >Jul 1 11:09:45 taft-02 qarshd[12305]: Running cmdline: /usr/tests/sts-rhel4.7/bin/xiogen -f buffered -m random -s write,writev -t 100 -T 1000000 -F 1000000:/mnt/syncd_primary_2legs_2/taft-02_load | /usr/tests/sts-rhel4.7/bin/xdoio -v >Jul 1 11:09:48 taft-02 qarshd[12301]: Nothing to do >Jul 1 11:09:48 taft-02 qarshd[12305]: Nothing to do >Jul 1 11:09:51 taft-02 qarshd[12301]: Nothing to do >Jul 1 11:09:51 taft-02 qarshd[12305]: Nothing to do >Jul 1 11:09:54 taft-02 qarshd[12301]: Nothing to do >Jul 1 11:09:54 taft-02 qarshd[12305]: Nothing to do >Jul 1 11:09:57 taft-02 qarshd[12301]: Nothing to do >Jul 1 11:09:57 taft-02 qarshd[12305]: Nothing to do >Jul 1 11:10:00 taft-02 qarshd[12301]: Nothing to do >Jul 1 11:10:00 taft-02 qarshd[12305]: Nothing to do >Jul 1 11:10:03 taft-02 qarshd[12301]: Nothing to do >Jul 1 11:10:03 taft-02 qarshd[12305]: Nothing to do >Jul 1 11:10:03 taft-02 qarshd[12315]: Talking to peer 10.15.80.47:45366 >Jul 1 11:10:03 taft-02 qarshd[12315]: Running cmdline: echo offline > /sys/block/sde/device/state >Jul 1 11:10:03 taft-02 qarshd[12315]: That's enough >Jul 1 11:10:03 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:03 taft-02 lvm[7189]: Mirror device, 253:3, has failed. >Jul 1 11:10:03 taft-02 lvm[7189]: Device failure in helter_skelter-syncd_primary_2legs_1 >Jul 1 11:10:03 taft-02 lvm[7189]: Parsing: vgreduce --config devices{ignore_suspended_devices=1} --removemissing helter_skelter >Jul 1 11:10:03 taft-02 lvm[7189]: Reloading config files >Jul 1 11:10:03 taft-02 lvm[7189]: Wiping internal VG cache >Jul 1 11:10:03 taft-02 lvm[7189]: Loading config file: /etc/lvm/lvm.conf >Jul 1 11:10:03 taft-02 lvm[7189]: WARNING: dev_open(/etc/lvm/lvm.conf) called while suspended >Jul 1 11:10:03 taft-02 lvm[7189]: Opened /etc/lvm/lvm.conf RO >Jul 1 11:10:03 taft-02 lvm[7189]: Closed /etc/lvm/lvm.conf >Jul 1 11:10:03 taft-02 lvm[7189]: Setting log/syslog to 1 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting log/level to 0 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting log/verbose to 0 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting log/indent to 1 >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting log/prefix to >Jul 1 11:10:03 taft-02 lvm[7189]: Setting log/command_names to 0 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting global/test to 0 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting log/overwrite to 0 >Jul 1 11:10:03 taft-02 lvm[7189]: log/activation not found in config: defaulting to 0 >Jul 1 11:10:03 taft-02 lvm[7189]: Logging initialised at Tue Jul 1 11:10:03 2008 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting global/umask to 63 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting devices/dir to /dev >Jul 1 11:10:03 taft-02 lvm[7189]: Setting global/proc to /proc >Jul 1 11:10:03 taft-02 lvm[7189]: Setting global/activation to 1 >Jul 1 11:10:03 taft-02 lvm[7189]: global/suffix not found in config: defaulting to 1 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting global/units to h >Jul 1 11:10:03 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:03 taft-02 lvm[7189]: Setting activation/readahead to auto >Jul 1 11:10:03 taft-02 lvm[7189]: devices/preferred_names not found in config file: using built-in preferences >Jul 1 11:10:03 taft-02 lvm[7189]: Matcher built with 3 dfa states >Jul 1 11:10:03 taft-02 lvm[7189]: Setting devices/ignore_suspended_devices to 1 >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:03 taft-02 lvm[7189]: Setting devices/cache_dir to /etc/lvm/cache >Jul 1 11:10:03 taft-02 lvm[7189]: Setting devices/write_cache_state to 1 >Jul 1 11:10:03 taft-02 lvm[7189]: Initialised format: lvm1 >Jul 1 11:10:03 taft-02 lvm[7189]: Initialised format: pool >Jul 1 11:10:03 taft-02 lvm[7189]: Initialised format: lvm2 >Jul 1 11:10:03 taft-02 lvm[7189]: global/format not found in config: defaulting to lvm2 >Jul 1 11:10:03 taft-02 lvm[7189]: lvmcache: initialised VG #orphans_lvm1 >Jul 1 11:10:03 taft-02 lvm[7189]: lvmcache: initialised VG #orphans_pool >Jul 1 11:10:03 taft-02 lvm[7189]: lvmcache: initialised VG #orphans_lvm2 >Jul 1 11:10:03 taft-02 lvm[7189]: Initialised segtype: striped >Jul 1 11:10:03 taft-02 lvm[7189]: Initialised segtype: zero >Jul 1 11:10:03 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:03 taft-02 lvm[7189]: Initialised segtype: error >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 759/65rpnvNP >Jul 1 11:10:03 taft-02 lvm[7189]: Another thread is handling an event. Waiting... >Jul 1 11:10:03 taft-02 lvm[7189]: Setting dmeventd/snapshot_library to libdevmapper-event-lvm2snapshot.so >Jul 1 11:10:03 taft-02 lvm[7189]: Setting global/library_dir to /usr/lib64 >Jul 1 11:10:03 taft-02 lvm[7189]: Initialised segtype: snapshot >Jul 1 11:10:03 taft-02 lvm[7189]: Initialised segtype: mirror >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 759/65rpnvNP >Jul 1 11:10:03 taft-02 lvm[7189]: Processing: vgreduce --config devices{ignore_suspended_devices=1} --removemissing helter_skelter >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 759/65rpnvNP >Jul 1 11:10:03 taft-02 lvm[7189]: O_DIRECT will be used >Jul 1 11:10:03 taft-02 lvm[7189]: Setting global/locking_type to 3 >Jul 1 11:10:03 taft-02 lvm[7189]: Cluster locking selected. >Jul 1 11:10:03 taft-02 lvm[7189]: Finding volume group "helter_skelter" >Jul 1 11:10:03 taft-02 lvm[7189]: Locking VG V_helter_skelter PW B (0x4) >Jul 1 11:10:03 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 759/65rpnvNP >Jul 1 11:10:03 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:03 taft-02 last message repeated 2 times >Jul 1 11:10:03 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:03 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 759/65rpnvNP >Jul 1 11:10:03 taft-02 last message repeated 2 times >Jul 1 11:10:03 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:03 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 759/65rpnvNP >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 759/65rpnvNP >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 767/3P2k7cK1 >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:04 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:04 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:04 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 760/65rpnvNP >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 768/3P2k7cK1 >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 769/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 769/3P2k7cK1 >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 769/3P2k7cK1 >Jul 1 11:10:05 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:05 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:05 taft-02 last message repeated 2 times >Jul 1 11:10:06 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:06 taft-02 last message repeated 3 times >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:06 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: LOG INFO: >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: uuid: LVM-3ch9Xihjw0QZaZmo6GdgncXiQK1GGfXDWUlsf7AkKeD0aNfVvPbOJdHe3P2k7cK1 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: uuid_ref : 1 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: log type : disk >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: ?region_count: 1600 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: ?sync_count : 0 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: ?sync_search : 0 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: in_sync : YES >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: suspended : NO >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: recovery_halted : NO >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: server_id : 1 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: server_valid: YES >Jul 1 11:10:06 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 769/3P2k7cK1 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: cluster_presuspend: recovery halted on 3P2k7cK1(1) >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 769/3P2k7cK1 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 769/3P2k7cK1 >Jul 1 11:10:06 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 769/3P2k7cK1 >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: cluster_postsuspend >Jul 1 11:10:06 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:06 taft-02 last message repeated 2 times >Jul 1 11:10:06 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:06 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:06 taft-02 qarshd[12301]: Nothing to do >Jul 1 11:10:06 taft-02 qarshd[12305]: Nothing to do >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: LRT_MASTER_LEAVING(13): (3P2k7cK1) >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: starter : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: co-ordinator: 0 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: node_count : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: LRT_ELECTION(10): (3P2k7cK1) >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: starter : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: co-ordinator: 57005 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: node_count : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: LRT_SELECTION(11): (3P2k7cK1) >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: starter : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: co-ordinator: 57005 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: node_count : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: LRT_MASTER_ASSIGN(12): (3P2k7cK1) >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: starter : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: co-ordinator: 57005 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: node_count : 1 >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Removing 3P2k7cK1 (1) >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: 0 region user structures freed >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:08 taft-02 last message repeated 2 times >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 last message repeated 4 times >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:08 taft-02 last message repeated 2 times >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 last message repeated 3 times >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:08 taft-02 last message repeated 2 times >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 last message repeated 3 times >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 761/65rpnvNP >Jul 1 11:10:08 taft-02 last message repeated 2 times >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 762/65rpnvNP >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 last message repeated 3 times >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 762/65rpnvNP >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: LOG INFO: >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: uuid: LVM-3ch9Xihjw0QZaZmo6GdgncXiQK1GGfXDFHuWUQA2h2mBe8QyrXSDLqBj65rpnvNP >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: uuid_ref : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: log type : disk >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: ?region_count: 1600 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: ?sync_count : 0 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: ?sync_search : 0 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: in_sync : YES >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: suspended : NO >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: recovery_halted : NO >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: server_id : 1 >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: server_valid: YES >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 762/65rpnvNP >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 762/65rpnvNP >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: cluster_presuspend: recovery halted on 65rpnvNP(1) >Jul 1 11:10:08 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: Notifying server(1) of sync change: 762/65rpnvNP >Jul 1 11:10:08 taft-02 kernel: dm-cmirror: cluster_postsuspend >Jul 1 11:10:08 taft-02 qarshd[12352]: Talking to peer 10.15.80.47:45370 >Jul 1 11:10:08 taft-02 qarshd[12352]: Running cmdline: dd if=/dev/zero of=/mnt/syncd_primary_2legs_1/ddfile count=10 bs=4M >Jul 1 11:10:08 taft-02 qarshd[12352]: That's enough >Jul 1 11:10:08 taft-02 qarshd[12354]: Talking to peer 10.15.80.47:45371 >Jul 1 11:10:08 taft-02 qarshd[12354]: Running cmdline: sync >Jul 1 11:10:27 taft-02 kernel: CMAN: node taft-01 has been removed from the cluster : Missed too many heartbeats >Jul 1 11:10:27 taft-02 kernel: CMAN: Started transition, generation 16 >Jul 1 11:10:28 taft-02 kernel: CMAN: Finished transition, generation 16 >Jul 1 11:10:58 taft-02 fenced[6391]: taft-01 not a cluster member after 30 sec post_fail_delay >Jul 1 11:10:58 taft-02 fenced[6391]: fencing node "taft-01" >Jul 1 11:11:12 taft-02 fenced[6391]: fence "taft-01" success >Jul 1 11:11:13 taft-02 kernel: dm-cmirror: A cluster mirror log member has failed. >Jul 1 11:11:14 taft-02 kernel: GFS: fsid=TAFT:gfs2.1: jid=0: Trying to acquire journal lock... >Jul 1 11:11:14 taft-02 kernel: GFS: fsid=TAFT:gfs1.1: jid=0: Trying to acquire journal lock... >Jul 1 11:11:14 taft-02 kernel: GFS: fsid=TAFT:gfs1.1: jid=0: Busy >Jul 1 11:11:14 taft-02 kernel: GFS: fsid=TAFT:gfs2.1: jid=0: Busy >Jul 1 11:11:58 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:11:58 taft-02 kernel: dm-cmirror: Removing 65rpnvNP (1) >Jul 1 11:11:58 taft-02 kernel: dm-cmirror: 0 region user structures freed >Jul 1 11:14:53 taft-02 kernel: scsi1 (0:4): rejecting I/O to offline device >Jul 1 11:43:06 taft-02 dhclient: DHCPREQUEST on eth0 to 10.15.89.100 port 67 >Jul 1 11:43:07 taft-02 dhclient: DHCPACK from 10.15.89.100 >Jul 1 11:43:07 taft-02 dhclient: bound to 10.15.89.68 -- renewal in 9446 seconds. >Jul 1 13:18:38 taft-02 kernel: SysRq : Show State >Jul 1 13:18:38 taft-02 kernel: >Jul 1 13:18:38 taft-02 kernel: sibling >Jul 1 13:18:38 taft-02 kernel: task PC pid father child younger older >Jul 1 13:18:38 taft-02 kernel: init S 000000000000000b 0 1 0 2 (NOTLB) >Jul 1 13:18:38 taft-02 kernel: 00000101fffa1d58 0000000000000002 0000010037e26200 0000010037e26200 >Jul 1 13:18:38 taft-02 kernel: 0000000000000000 0000000000000246 00000101fffa1e58 0000000380191e2d >Jul 1 13:18:38 taft-02 kernel: 000001000693c7f0 0000000000000c39 >Jul 1 13:18:38 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:38 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:38 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:38 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:38 taft-02 kernel: migration/0 S 00000100010687e0 0 2 1 3 (L-TLB) >Jul 1 13:18:47 taft-02 qarshd[12354]: Nothing to do >Jul 1 13:18:47 taft-02 kernel: 00000101fff19ec8 0000000000000046 00000100010687e0 0000001900000072 >Jul 1 13:18:47 taft-02 kernel: 0000010215e42030 0000000000000072 0000010001061a40 0000000000000001 >Jul 1 13:18:47 taft-02 kernel: 00000101fff807f0 00000000000001e4 >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff80135895>{migration_thread+323} <ffffffff80135752>{migration_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: ksoftirqd/0 S 0000000000000000 0 3 1 4 2 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101fff1df08 0000000000000046 00000101fff807f0 000000190000006f >Jul 1 13:18:47 taft-02 kernel: 000001020baa1030 000000000000006f 0000010001061a40 0000000000000000 >Jul 1 13:18:47 taft-02 kernel: 00000101fff80030 0000000000000123 >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff8013d9f0>{ksoftirqd+0} <ffffffff8013da2c>{ksoftirqd+60} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: migration/1 S 00000100010707e0 0 4 1 5 3 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101fff1fec8 0000000000000046 00000100010707e0 0000001900000074 >Jul 1 13:18:47 taft-02 kernel: 00000102129c87f0 0000000000000074 0000010001069a40 0000000100000001 >Jul 1 13:18:47 taft-02 kernel: 00000101fff817f0 000000000000012a >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff80135895>{migration_thread+323} <ffffffff80135752>{migration_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: ksoftirqd/1 S 0000000000000000 0 5 1 6 4 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101fff51f08 0000000000000046 00000102129c87f0 0000000000000246 >Jul 1 13:18:47 taft-02 kernel: 00000101fff50000 0000000000000246 000001000106bcc0 0000000100000000 >Jul 1 13:18:47 taft-02 kernel: 00000101fff81030 000000000000014a >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff8013d9f0>{ksoftirqd+0} <ffffffff8013da2c>{ksoftirqd+60} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: migration/2 S 00000100010607e0 0 6 1 7 5 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101fff55ec8 0000000000000046 00000100010607e0 0000001900000072 >Jul 1 13:18:47 taft-02 kernel: 0000010215e42030 0000000000000072 0000010001071a40 0000000200000001 >Jul 1 13:18:47 taft-02 kernel: 00000101fff287f0 00000000000001aa >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff80135895>{migration_thread+323} <ffffffff80135752>{migration_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: ksoftirqd/2 S 0000000000000000 0 7 1 8 6 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000100dff07f08 0000000000000046 00000102129c87f0 000000190000006f >Jul 1 13:18:47 taft-02 kernel: 000001020d1cf7f0 000000000000006f 0000010001071a40 0000000200000000 >Jul 1 13:18:47 taft-02 kernel: 00000101fff28030 0000000000000172 >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff8013d9f0>{ksoftirqd+0} <ffffffff8013da2c>{ksoftirqd+60} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: migration/3 S 00000100010607e0 0 8 1 9 7 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000100dff09ec8 0000000000000046 00000100010607e0 0000001900000075 >Jul 1 13:18:47 taft-02 kernel: 00000102129c87f0 0000000000000075 0000010001079a40 0000000300000001 >Jul 1 13:18:47 taft-02 kernel: 00000101fff647f0 00000000000001e0 >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff80135895>{migration_thread+323} <ffffffff80135752>{migration_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: ksoftirqd/3 S 0000000000000000 0 9 1 10 8 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000100dff4df08 0000000000000046 00000101fff647f0 0000000000000246 >Jul 1 13:18:47 taft-02 kernel: 00000101fff6d010 0000000000000246 000001000107bcc0 0000000300000000 >Jul 1 13:18:47 taft-02 kernel: 00000101fff64030 00000000000000c2 >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff8013d9f0>{ksoftirqd+0} <ffffffff8013da2c>{ksoftirqd+60} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: events/0 S ffffffff8022f841 0 10 1 14 11 9 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101ffcb3e68 0000000000000046 ffffffff803e7e80 0000000000000246 >Jul 1 13:18:47 taft-02 kernel: 0000000000000246 0000000000000246 0000000100d30b86 0000000000000246 >Jul 1 13:18:47 taft-02 kernel: 00000101ffc8f7f0 00000000000001fc >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff8022f841>{flush_to_ldisc+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: events/1 S ffffffff80164d4a 0 11 1 12248 12 10 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101ffcb5e68 0000000000000046 000001000693c030 000001000106bec0 >Jul 1 13:18:47 taft-02 kernel: 0000000000000005 0000000000000246 0000000100d30f24 0000000100000246 >Jul 1 13:18:47 taft-02 kernel: 00000101ffc8f030 0000000000000edc >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff80164d4a>{cache_reap+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: events/2 S ffffffff80164d4a 0 12 1 555 13 11 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101ffcb9e68 0000000000000046 000001000693f7f0 0000001900000072 >Jul 1 13:18:47 taft-02 kernel: 0000010215e42030 0000000000000246 0000000100d30b62 0000000200000246 >Jul 1 13:18:47 taft-02 kernel: 00000101ffc917f0 00000000000015a3 >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff80164d4a>{cache_reap+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: events/3 S ffffffff80164d4a 0 13 1 1107 67 12 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101ffcbbe68 0000000000000046 000001000693f030 0000000000000000 >Jul 1 13:18:47 taft-02 kernel: 0000010006a32758 0000000000000246 0000000100d30f50 0000000300000246 >Jul 1 13:18:47 taft-02 kernel: 00000101ffc91030 0000000000000e7e >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff80164d4a>{cache_reap+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: khelper S 00000102123a9c18 0 14 10 15 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000101ffccde68 0000000000000046 00000100010687e0 0000001900000074 >Jul 1 13:18:47 taft-02 kernel: 000001020c8687f0 0000000000000074 0000010001071a40 0000000200000001 >Jul 1 13:18:47 taft-02 kernel: 00000101ffc927f0 0000000000000591 >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff80148129>{__call_usermodehelper+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: kacpid S 00000100dff60040 0 15 10 63 14 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 00000100dfdf1e68 0000000000000046 0000000000000000 0000000000000071 >Jul 1 13:18:47 taft-02 kernel: 0000000000000000 0000000000000002 ffffffff80483800 0000000000000000 >Jul 1 13:18:47 taft-02 kernel: 00000101ffc92030 00000000000008f6 >Jul 1 13:18:47 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80134752>{__wake_up_common+67} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:47 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:47 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:47 taft-02 kernel: >Jul 1 13:18:47 taft-02 kernel: kblockd/0 S 0000010217aa7600 0 63 10 64 15 (L-TLB) >Jul 1 13:18:47 taft-02 kernel: 0000010037c37e68 0000000000000046 0000010006946000 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 000001020c8687f0 0000000000000074 0000010001061a40 0000000017aa7420 >Jul 1 13:18:48 taft-02 kernel: 00000100dfdd57f0 0000000000064571 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80254483>{blk_unplug_work+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: kblockd/1 S 0000010217897da0 0 64 10 65 63 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037c59e68 0000000000000046 676e696e6e616373 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 00000102162d1030 0000000000000074 0000010001069a40 0000000117897bc0 >Jul 1 13:18:48 taft-02 kernel: 00000100dfdd5030 00000000000005ee >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80254483>{blk_unplug_work+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: kblockd/2 S ffffffff80254483 0 65 10 66 64 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037c5de68 0000000000000046 0000010006946000 0000010006a049c0 >Jul 1 13:18:48 taft-02 kernel: 00000102179fa548 ffffffffa004786b 00000102178aeb80 0000000217aa7420 >Jul 1 13:18:48 taft-02 kernel: 0000010037c0a7f0 0000000000000386 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa004786b>{:qla2xxx:qla2x00_queuecommand+1212} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80254483>{blk_unplug_work+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: kblockd/3 S 0000010217897da0 0 66 10 102 65 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037c5fe68 0000000000000046 676e696e6e616373 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 00000102129c87f0 0000000000000074 0000010001079a40 0000000317897bc0 >Jul 1 13:18:48 taft-02 kernel: 0000010037c0a030 000000000000052f >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80254483>{blk_unplug_work+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: khubd S 00000101ffdbdc00 0 67 1 104 13 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037c81e78 0000000000000046 00000102163116e0 ffffffff8029c3be >Jul 1 13:18:48 taft-02 kernel: 0000000300000000 ffffffff80427af0 0000000000000000 0000000000000001 >Jul 1 13:18:48 taft-02 kernel: 0000010037c4a7f0 0000000000008944 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8029c3be>{fs_create_file+325} <ffffffff80293e59>{hub_thread+2579} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff80293446>{hub_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: pdflush S ffffffff8014c590 0 102 10 103 66 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037c83ec8 0000000000000046 000005d46d3a7068 000001020b84e7f0 >Jul 1 13:18:48 taft-02 kernel: 00000100010687e0 0000000000000001 0000010037c83e58 0000000380132b13 >Jul 1 13:18:48 taft-02 kernel: 0000010037c4a030 00000000000001e2 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8013303e>{try_to_wake_up+876} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80161c10>{pdflush+191} <ffffffff80161b51>{pdflush+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: pdflush D ffffffff803173f8 0 103 10 105 102 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037ca7c68 0000000000000046 000000000000ffff 0000000000190000 >Jul 1 13:18:48 taft-02 kernel: 0000000000000206 ffffffffa00b9d34 0000000000209bea 0000000100000008 >Jul 1 13:18:48 taft-02 kernel: 0000010037c617f0 0000000000000cda >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa00b9d34>{:dm_mod:dm_request+335} <ffffffff8025445f>{generic_unplug_device+24} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa00bbd1a>{:dm_mod:dm_table_unplug_all+49} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8031869a>{io_schedule+38} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017ccd8>{__wait_on_buffer+125} <ffffffff8017cb5e>{bh_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017cb5e>{bh_wake_function+0} <ffffffffa029ed1f>{:gfs:gfs_logbh_wait+49} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02b3ef2>{:gfs:disk_commit+794} <ffffffff8013303e>{try_to_wake_up+876} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02b40c3>{:gfs:log_refund+111} <ffffffffa02b45da>{:gfs:log_flush_internal+510} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80181996>{sync_supers+167} <ffffffff801611cd>{wb_kupdate+39} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80161c94>{pdflush+323} <ffffffff801611a6>{wb_kupdate+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80161b51>{pdflush+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: aio/0 S 0000010037c34900 0 105 10 106 103 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037ccbe68 0000000000000046 0000000000000000 000000000000006b >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000008 ffffffff80483800 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000010037c987f0 000000000000073b >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134752>{__wake_up_common+67} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: kswapd0 S 0000010037ca9f08 0 104 1 252 67 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037ca9eb8 0000000000000046 0000010037ca9e08 000000000000007d >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000000 ffffffff80483800 000000008013502e >Jul 1 13:18:48 taft-02 kernel: 0000010037c61030 0000000000000f8a >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff801681db>{kswapd+231} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801680f4>{kswapd+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: aio/1 S 0000010037c34980 0 106 10 107 105 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037ccde68 0000000000000046 0000000000000000 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000008 000000000000231e 0000000100000000 >Jul 1 13:18:48 taft-02 kernel: 0000010037c98030 0000000000000b77 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134752>{__wake_up_common+67} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: aio/2 S 0000010037c34a00 0 107 10 108 106 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037cd1e68 0000000000000046 0000000000000000 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000008 000000000000231e 0000000200000000 >Jul 1 13:18:48 taft-02 kernel: 0000010037c997f0 0000000000000de1 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134752>{__wake_up_common+67} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: aio/3 S 0000010037c34a80 0 108 10 552 107 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037cd3e68 0000000000000046 0000000000000000 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000007 0000000000001f36 0000000300000000 >Jul 1 13:18:48 taft-02 kernel: 0000010037c99030 0000000000000ae3 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134752>{__wake_up_common+67} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: kseriod S 0000000000000000 0 252 1 488 104 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010037d29ec8 0000000000000046 0000010037d29e18 0000010000000079 >Jul 1 13:18:48 taft-02 kernel: ffffffff80132b35 0000000000000000 ffffffff80483800 0000000037d12418 >Jul 1 13:18:48 taft-02 kernel: 0000010037ce97f0 00000000000011b6 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80132b35>{deactivate_task+21} <ffffffff80246e9c>{serio_thread+469} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff8013b570>{do_exit+3319} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80246cc7>{serio_thread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: scsi_eh_0 S 0000010037c1a7c0 0 488 1 512 252 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010217841df8 0000000000000046 00000101fff20800 0000010006acb412 >Jul 1 13:18:48 taft-02 kernel: 0000000000000018 0000000000000006 0000000000001b4e 00000002803f7d60 >Jul 1 13:18:48 taft-02 kernel: 0000010006acb030 000000000000337f >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803170fb>{__down_interruptible+203} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80318b1b>{__down_failed_interruptible+53} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0006a20>{:scsi_mod:.text.lock.scsi_error+45} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8013b570>{do_exit+3319} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0005bc6>{:scsi_mod:scsi_error_handler+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: scsi_eh_1 S 0000000000574730 0 512 1 513 488 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010217895df8 0000000000000046 00000102179f8000 0000010006aed412 >Jul 1 13:18:48 taft-02 kernel: 000000000000001e 0000000000000006 0000000000001b12 00000002803f7d60 >Jul 1 13:18:48 taft-02 kernel: 0000010006aed030 0000000000002788 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803170fb>{__down_interruptible+203} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80318b1b>{__down_failed_interruptible+53} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0006a20>{:scsi_mod:.text.lock.scsi_error+45} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa0005bc6>{:scsi_mod:scsi_error_handler+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: qla2300_1_dpc S 00000102179f8000 0 513 1 599 512 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010217879e58 0000000000000046 00000102179fa625 00000001a0072960 >Jul 1 13:18:48 taft-02 kernel: 0000000500000000 ffffffff00000000 00000000040000a0 0000000200084000 >Jul 1 13:18:48 taft-02 kernel: 00000100dffba7f0 00000000000002f4 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa00521a3>{:qla2xxx:__qla2x00_marker+518} <ffffffff803170fb>{__down_interruptible+203} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80318b1b>{__down_failed_interruptible+53} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0047d9d>{:qla2xxx:.text.lock.qla_os+15} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0047244>{:qla2xxx:qla2x00_do_dpc+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: ata/0 S 00000100010707e0 0 552 10 553 108 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010217b6fe68 0000000000000046 0000000000000000 000000190000006a >Jul 1 13:18:48 taft-02 kernel: 00000101ffc8f7f0 000000000000006a 0000010001061a40 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000010006bed030 0000000000000b68 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: ata/1 S ffffffff8014c590 0 553 10 554 552 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010217b69e68 0000000000000046 0000000100000001 0000000000000002 >Jul 1 13:18:48 taft-02 kernel: 0000010006bf69d0 0000000000000008 000000000000231e 0000000100000100 >Jul 1 13:18:48 taft-02 kernel: 0000010006b6b030 0000000000001352 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: ata/2 S ffffffff8014c590 0 554 10 556 553 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010217b6be68 0000000000000046 0000000100000001 0000000000000002 >Jul 1 13:18:48 taft-02 kernel: 0000010006bf69d0 0000000000000008 000000000000231e 0000000200000100 >Jul 1 13:18:48 taft-02 kernel: 0000010006bf6030 0000000000000c19 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: ata/3 S ffffffff8014c590 0 555 12 6428 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010217b65e68 0000000000000046 0000010217b65e18 ffffffff80132a85 >Jul 1 13:18:48 taft-02 kernel: 00000101ffc919d0 0000000000000009 0000000000002706 0000000300000009 >Jul 1 13:18:48 taft-02 kernel: 00000100dff817f0 00000000000013c5 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80132a85>{recalc_task_prio+337} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014874d>{worker_thread+226} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: ata_aux S ffffffff8014c590 0 556 10 6365 554 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010217b67e68 0000000000000046 0000000100000001 0000000000000002 >Jul 1 13:18:48 taft-02 kernel: 0000010006bf69d0 0000000000000008 000000000000231e 0000000000000001 >Jul 1 13:18:48 taft-02 kernel: 0000010006acb7f0 0000000000001385 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014866b>{worker_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014874d>{worker_thread+226} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014866b>{worker_thread+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: kjournald D 0000000000000000 0 599 1 2402 513 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 00000102165c7b08 0000000000000046 676e697070696b73 ffffffff80140a00 >Jul 1 13:18:48 taft-02 kernel: 0000010006bee400 0000010217897bc0 0000010217897bc0 00000003fff20800 >Jul 1 13:18:48 taft-02 kernel: 0000010217bb1030 0000000000000e1a >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a00>{__mod_timer+237} <ffffffff80252d38>{elv_next_request+238} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0007e9d>{:scsi_mod:scsi_request_fn+1100} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8031869a>{io_schedule+38} <ffffffff8017ccd8>{__wait_on_buffer+125} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017cb5e>{bh_wake_function+0} <ffffffff8017cb5e>{bh_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa00cfb4b>{:jbd:journal_commit_transaction+1207} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80317d24>{thread_return+0} <ffffffff80317d7c>{thread_return+88} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80140b77>{del_timer+107} <ffffffffa00d2a54>{:jbd:kjournald+250} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa00d2954>{:jbd:commit_timeout+0} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa00d295a>{:jbd:kjournald+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: kauditd S ffffffff8014c590 0 1107 13 12247 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010216393ea8 0000000000000046 00000004bb31594c 00000101ffc91030 >Jul 1 13:18:48 taft-02 kernel: 00000100010787e0 0000000000000003 00000102163ef030 0000000300000000 >Jul 1 13:18:48 taft-02 kernel: 00000102163ef030 0000000000000c38 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014c590>{keventd_create_kthread+0} <ffffffff80155b20>{kauditd_thread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80155c9f>{kauditd_thread+383} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: udevd S 00000102159033c0 0 2402 1 2988 599 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010215a4fd58 0000000000000006 000001020a45e7f0 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 000001020c97e7f0 0000000000000074 0000010001071a40 0000000200012780 >Jul 1 13:18:48 taft-02 kernel: 0000010215c04030 0000000000001951 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff802ba163>{datagram_poll+39} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e573>{do_select+939} <ffffffff8018e10d>{__pollwait+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e8f2>{sys_select+820} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: kjournald S 0000000000000000 0 2988 1 3541 2402 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010215361e78 0000000000000046 0000010215361dc8 0000010215255af8 >Jul 1 13:18:48 taft-02 kernel: 00000100dff16298 0000000000000005 0000000000000000 00000003000003e8 >Jul 1 13:18:48 taft-02 kernel: 00000100dffbb7f0 0000000000004808 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa00d2b54>{:jbd:kjournald+506} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffffa00d2954>{:jbd:commit_timeout+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa00d295a>{:jbd:kjournald+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: dhclient S 0000000000000007 0 3541 1 3639 2988 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102140add58 0000000000000002 000001000693f7f0 00000102140ade88 >Jul 1 13:18:48 taft-02 kernel: 00000102140add58 0000001000000000 000000d0160b1080 0000000200000246 >Jul 1 13:18:48 taft-02 kernel: 0000010006bf8030 0000000000002e9e >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: syslogd D 0000010214569ef8 0 3639 1 3643 3541 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010214569d98 0000000000000002 00000100010787e0 0000000000000003 >Jul 1 13:18:48 taft-02 kernel: 0000010214569d18 ffffffff80132b13 00000100010787e0 0000000100000003 >Jul 1 13:18:48 taft-02 kernel: 00000102162d1030 0000000000000203 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80132b13>{activate_task+124} <ffffffffa00d2d7c>{:jbd:log_wait_commit+202} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa00cdaaf>{:jbd:journal_stop+536} <ffffffffa00cdb05>{:jbd:journal_force_commit+32} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa00ea949>{:ext3:ext3_force_commit+36} <ffffffff8019b724>{__writeback_single_inode+363} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8019ba63>{sync_inode+52} <ffffffffa00e1043>{:ext3:ext3_sync_file+191} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017d212>{sys_fsync+155} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: klogd S 000000000000006b 0 3643 1 3656 3639 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102146ddbc8 0000000000000006 000001000693c030 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 00000102162d1030 0000000000000074 00000102146ddb98 0000000280132a85 >Jul 1 13:18:48 taft-02 kernel: 0000010215d28030 00000000000006ca >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80163706>{cache_alloc_refill+390} <ffffffff803187d8>{schedule_timeout+257} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8013601c>{prepare_to_wait_exclusive+21} <ffffffff80312441>{unix_wait_for_peer+163} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801347a8>{__wake_up+54} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff80312f53>{unix_dgram_sendmsg+957} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802b41f4>{sock_aio_write+306} <ffffffff8017bba7>{do_sync_write+178} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801389ca>{do_syslog+482} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801968e9>{dnotify_parent+34} <ffffffff8017bcb5>{vfs_write+226} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bd8a>{sys_write+69} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: irqbalance S 0000000000000000 0 3656 1 3667 3643 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102141f3ec8 0000000000000002 0000000000000001 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 000001021fbc5b88 ffffffff8016a3a4 0000000000001000 000000009556d000 >Jul 1 13:18:48 taft-02 kernel: 0000010216284030 000000000001066b >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8016a3a4>{unmap_vmas+1345} <ffffffff80140a38>{__mod_timer+293} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80318863>{schedule_timeout+396} <ffffffff80141462>{process_timeout+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801415a5>{sys_nanosleep+192} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: portmap S 7fffffffffffffff 0 3667 1 3686 3656 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010214141e68 0000000000000002 0000000000000000 ffffffff802b576e >Jul 1 13:18:48 taft-02 kernel: 0000010214140000 00000010802b389f 000000d014141e48 0000000300000246 >Jul 1 13:18:48 taft-02 kernel: 00000102160817f0 0000000000004dd3 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff802b576e>{sys_sendmsg+534} <ffffffff803187d8>{schedule_timeout+257} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80135efc>{add_wait_queue+18} <ffffffff802dd5f3>{tcp_poll+44} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018ec97>{sys_poll+588} <ffffffff8018e10d>{__pollwait+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: rpc.statd S 0000000000000009 0 3686 1 3717 3667 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010214679d58 0000000000000006 0000000000000246 ffffffffa00ec9bf >Jul 1 13:18:48 taft-02 kernel: 00000000000000d0 00000102146bc00c 000000d00000003b 0000000200000246 >Jul 1 13:18:48 taft-02 kernel: 0000010215af77f0 0000000000007023 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa00ec9bf>{:ext3:ext3fs_dirhash+873} <ffffffff803187d8>{schedule_timeout+257} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802dd5f3>{tcp_poll+44} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80191eb2>{dput+189} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: rpc.idmapd S 0000000000000000 0 3717 1 3811 3686 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213c79e58 0000000000000002 000001000693f030 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 00000102162d1030 0000000000000074 0000010001079a40 00000003160a67f0 >Jul 1 13:18:48 taft-02 kernel: 00000102160a67f0 0000000000000634 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff801a1079>{sys_epoll_wait+393} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141da6>{recalc_sigpending+15} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: acpid S 0000000000000005 0 3811 1 3820 3717 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213dbdd58 0000000000000006 00000000486a3df4 000000001dddcc38 >Jul 1 13:18:48 taft-02 kernel: 00000000486a3df4 000000001dddcc38 0000010213dcf8d0 0000000300000246 >Jul 1 13:18:48 taft-02 kernel: 00000102163d67f0 00000000000267f0 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801968e9>{dnotify_parent+34} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: cupsd S 0000000000000004 0 3820 1 3888 3811 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213dffd58 0000000000000006 00000000486a740a 0000000033bdc5f8 >Jul 1 13:18:48 taft-02 kernel: 00000000486a740a 0000000000000246 0000010213edc7d0 0000000100000000 >Jul 1 13:18:48 taft-02 kernel: 000001021677a7f0 000000000003304d >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80191eb2>{dput+189} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: sshd S 0000000000000004 0 3888 1 6241 3907 3820 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213aadd58 0000000000000002 ffffffff803e7e80 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 000001021293f118 0000000000000246 000000d2146dab00 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 00000102142697f0 0000000000c75f9f >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff802dd5f3>{tcp_poll+44} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e573>{do_select+939} <ffffffff8018e10d>{__pollwait+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e8f2>{sys_select+820} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: xinetd S 0000000000000007 0 3907 1 6684 3925 3888 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213abdd58 0000000000000006 0000010208d547f0 0000010213abde88 >Jul 1 13:18:48 taft-02 kernel: 0000010213abdd58 0000000000000246 0000000000000049 00000000802b3d83 >Jul 1 13:18:48 taft-02 kernel: 00000102179ac7f0 00000000000023a3 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff802dd5f3>{tcp_poll+44} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e573>{do_select+939} <ffffffff8018e10d>{__pollwait+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e8f2>{sys_select+820} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: sendmail S 0000000000000005 0 3925 1 3934 3907 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213719d58 0000000000000002 0000010213719d28 ffffffff801ae9ab >Jul 1 13:18:48 taft-02 kernel: fffffffffffffff4 0000000000000246 000000000000002b 000000030c53d015 >Jul 1 13:18:48 taft-02 kernel: 0000010216066030 0000000000001be9 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff801ae9ab>{proc_root_lookup+49} <ffffffff80140a38>{__mod_timer+293} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80318863>{schedule_timeout+396} <ffffffff80141462>{process_timeout+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e573>{do_select+939} <ffffffff8018e10d>{__pollwait+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e8f2>{sys_select+820} <ffffffff80191e2d>{dput+56} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: sendmail S 0000000000000000 0 3934 1 3954 3925 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 000001021302df68 0000000000000002 0000000100d7cf14 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 0000000000000246 ffffffff80140a38 0000000000000004 000000030036f0a4 >Jul 1 13:18:48 taft-02 kernel: 00000102160667f0 000000000000c2da >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff8013cbc2>{do_setitimer+332} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80145342>{sys_pause+23} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: gpm S 00000100010607e0 0 3954 1 4100 3934 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213203d58 0000000000000002 0000000000000003 0000001900000086 >Jul 1 13:18:48 taft-02 kernel: 00000101fff28030 0000000000000086 0000010001071a40 0000000200000246 >Jul 1 13:18:48 taft-02 kernel: 0000010213185030 0000000000005429 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801968e9>{dnotify_parent+34} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: crond S 0000000000000000 0 4100 1 4118 3954 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213051ec8 0000000000000006 0000000000000073 0000010214d12e98 >Jul 1 13:18:48 taft-02 kernel: 0000010214d12e98 ffffffff80191eb2 0000010213051e58 0000000013051ef8 >Jul 1 13:18:48 taft-02 kernel: 00000100dffbb030 0000000000001f12 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80191eb2>{dput+189} <ffffffff80140a38>{__mod_timer+293} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80318863>{schedule_timeout+396} <ffffffff80141462>{process_timeout+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801415a5>{sys_nanosleep+192} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: xfs S 0000000000000004 0 4118 1 4135 4100 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212ee7d58 0000000000000006 000001000693f030 0000010212ee7e88 >Jul 1 13:18:48 taft-02 kernel: 0000010212ee7d58 0000000000000000 0000000000000066 0000000300000246 >Jul 1 13:18:48 taft-02 kernel: 0000010214637030 00000000000041da >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: atd S 0000000000000000 0 4135 1 4145 4118 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212d6fec8 0000000000000002 000001020a5ed820 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 00000101fff39800 0000000000000246 00000000088aa314 000000038018df2c >Jul 1 13:18:48 taft-02 kernel: 0000010006bf87f0 000000000000ebdb >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff801415a5>{sys_nanosleep+192} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: dbus-daemon-1 S 7fffffffffffffff 0 4145 1 4156 4135 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010213281e68 0000000000000002 0000010213281da0 0000000000000100 >Jul 1 13:18:48 taft-02 kernel: 000000000057f500 0000000000000800 0000010213281c68 0000000300000246 >Jul 1 13:18:48 taft-02 kernel: 00000102131857f0 0000000000007f4e >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff80135efc>{add_wait_queue+18} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018ec97>{sys_poll+588} <ffffffff8018e10d>{__pollwait+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017c241>{sys_writev+69} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: hald S 0000000000000656 0 4156 1 4181 4145 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102131abe68 0000000000000002 0000000000000001 0000010037d8c410 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000246 0000000000000000 0000000200000000 >Jul 1 13:18:48 taft-02 kernel: 0000010212c5d030 0000000000000acd >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff802ba13c>{datagram_poll+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018ec97>{sys_poll+588} <ffffffff8018e10d>{__pollwait+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: modclusterd S 00000000000001f5 0 4181 1 4182 4156 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212b0de68 0000000000000006 000001000693f7f0 800000020a0bb065 >Jul 1 13:18:48 taft-02 kernel: 0000010212a7eb40 0000010006bb57f0 0000002a95568888 0000000200000246 >Jul 1 13:18:48 taft-02 kernel: 0000010006bb57f0 00000000000003b9 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018ec97>{sys_poll+588} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: modclusterd R running task 0 4182 1 4183 4181 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: modclusterd S 00000000000001f5 0 4183 1 4224 4182 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212b0fe68 0000000000000006 ffffffff803e7e80 8000000211443065 >Jul 1 13:18:48 taft-02 kernel: 000000004007f9f7 0000000000000246 0000010212b0fe18 0000000015c0b6c0 >Jul 1 13:18:48 taft-02 kernel: 000001021592b7f0 00000000000008e0 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018ec97>{sys_poll+588} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8017bd37>{sys_read+96} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: oddjobd S 0000000000000004 0 4224 1 4244 4183 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102124e7d58 0000000000000006 000001000693c030 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 000001020b576030 0000000000000074 0000010001069a40 0000000100000246 >Jul 1 13:18:48 taft-02 kernel: 00000102179ad030 0000000000001fea >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801968e9>{dnotify_parent+34} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: saslauthd S 00000102124377d0 0 4244 1 4245 4256 4224 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212569e78 0000000000000006 0000010212f39888 00000102146387f0 >Jul 1 13:18:48 taft-02 kernel: 0000000000511b90 0000010037c04dc0 00000102133a3268 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 00000102146387f0 0000000000003a6b >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8018fdb1>{__posix_lock_file+1147} <ffffffff801910ca>{fcntl_setlk+473} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018d387>{sys_fcntl+736} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: saslauthd S 0000000000000000 0 4245 4244 4246 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 000001021259bd58 0000000000000002 0000002a95568b30 0000001900000078 >Jul 1 13:18:48 taft-02 kernel: 00000102146387f0 0000000000000078 0000010001061a40 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 00000102146337f0 000000000000fd82 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff8013601c>{prepare_to_wait_exclusive+21} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802b9a39>{skb_recv_datagram+373} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff80312978>{unix_accept+99} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802b4f6f>{sys_accept+201} <ffffffff80110e1d>{error_exit+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: saslauthd S 0000010037c666a0 0 4246 4244 4247 4245 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212595e78 0000000000000006 00000102125ae5e0 0000001900000078 >Jul 1 13:18:48 taft-02 kernel: 00000102146387f0 0000000000000078 0000010001061a40 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 00000102133d47f0 000000000000dc18 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8018fdb1>{__posix_lock_file+1147} <ffffffff801910ca>{fcntl_setlk+473} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018d387>{sys_fcntl+736} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: saslauthd S 00000100069401a0 0 4247 4244 4248 4246 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102125dfe78 0000000000000002 00000102125c95e0 0000001900000078 >Jul 1 13:18:48 taft-02 kernel: 00000102146387f0 0000000000000078 0000010001061a40 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 0000010215d947f0 000000000000d3d6 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8018fdb1>{__posix_lock_file+1147} <ffffffff801910ca>{fcntl_setlk+473} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018d387>{sys_fcntl+736} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: saslauthd S 0000010006940e20 0 4248 4244 4247 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212601e78 0000000000000006 00000102125ec5e0 000000190000007b >Jul 1 13:18:48 taft-02 kernel: 00000102146387f0 000000000000007b 0000010001061a40 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 00000100dff81030 000000000000ee6d >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8018fdb1>{__posix_lock_file+1147} <ffffffff801910ca>{fcntl_setlk+473} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018d387>{sys_fcntl+736} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: ricci S 00000000000003e9 0 4256 1 4261 4244 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212bb1e68 0000000000000006 000001000693f7f0 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 00000102146377f0 0000000000000246 0000010001071a40 00000002000003e8 >Jul 1 13:18:48 taft-02 kernel: 00000102163ef7f0 000000000000039c >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018ec97>{sys_poll+588} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: login S 0000000000000000 0 4261 1 10054 4262 4256 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102167e5eb8 0000000000000002 000001020b066000 0000010216105ff8 >Jul 1 13:18:48 taft-02 kernel: 0000000100000000 0000000000000000 ffffffff8014925c 0000000300000000 >Jul 1 13:18:48 taft-02 kernel: 00000102179ac030 00000000000050ef >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8014925c>{attach_pid+31} <ffffffff801ef299>{__up_read+16} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801248c9>{do_page_fault+577} <ffffffff8013c679>{do_wait+3413} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014522b>{sys_rt_sigaction+97} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: mingetty S 00000100dff24980 0 4262 1 4263 4261 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102125f7d68 0000000000000002 0000000000000020 0000001900000076 >Jul 1 13:18:48 taft-02 kernel: 0000010212c5d7f0 0000000000000076 0000010001061a40 00000000125f7dd8 >Jul 1 13:18:48 taft-02 kernel: 00000102160a6030 000000000002691d >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80238c11>{complement_pos+12} <ffffffff803187d8>{schedule_timeout+257} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80135efc>{add_wait_queue+18} <ffffffff80231b7d>{read_chan+1080} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff801347a8>{__wake_up+54} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8022c766>{tty_read+230} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bac0>{vfs_read+207} <ffffffff8017bd1c>{sys_read+69} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: mingetty S 0000010212d46cc0 0 4263 1 4264 4262 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102125fdd68 0000000000000002 0000000000000020 0000001900000076 >Jul 1 13:18:48 taft-02 kernel: 0000010212d6a7f0 0000000000000076 0000010001071a40 00000002125fddd8 >Jul 1 13:18:48 taft-02 kernel: 00000102162847f0 000000000003182c >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff80135efc>{add_wait_queue+18} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80231b7d>{read_chan+1080} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801347a8>{__wake_up+54} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8022c766>{tty_read+230} <ffffffff8017bac0>{vfs_read+207} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bd1c>{sys_read+69} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: mingetty S 00000102129b7a80 0 4264 1 4265 4263 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212481d68 0000000000000006 0000000000000020 0000001900000076 >Jul 1 13:18:48 taft-02 kernel: 0000010212c5d7f0 0000000000000076 0000010001061a40 0000000012481dd8 >Jul 1 13:18:48 taft-02 kernel: 00000102179ad7f0 0000000000019bd6 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff80135efc>{add_wait_queue+18} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80231b7d>{read_chan+1080} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801347a8>{__wake_up+54} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8022c766>{tty_read+230} <ffffffff8017bac0>{vfs_read+207} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bd1c>{sys_read+69} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: mingetty S 00000102162cdc80 0 4265 1 4266 4264 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212443d68 0000000000000006 0000000000000020 0000001900000076 >Jul 1 13:18:48 taft-02 kernel: 0000010212d6a7f0 0000000000000076 0000010001071a40 0000000212443dd8 >Jul 1 13:18:48 taft-02 kernel: 0000010214534030 000000000003170a >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff80135efc>{add_wait_queue+18} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80231b7d>{read_chan+1080} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801347a8>{__wake_up+54} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8022c766>{tty_read+230} <ffffffff8017bac0>{vfs_read+207} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bd1c>{sys_read+69} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: mingetty S 00000102116984c0 0 4266 1 4267 4265 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102124b1d68 0000000000000006 0000000000000020 0000001900000076 >Jul 1 13:18:48 taft-02 kernel: 0000010212d6a7f0 0000000000000076 0000010001071a40 00000002124b1dd8 >Jul 1 13:18:48 taft-02 kernel: 0000010212c5d7f0 0000000000035767 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff80135efc>{add_wait_queue+18} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80231b7d>{read_chan+1080} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801347a8>{__wake_up+54} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8022c766>{tty_read+230} <ffffffff8017bac0>{vfs_read+207} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bd1c>{sys_read+69} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: mingetty S 0000000000000001 0 4267 1 6301 4266 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010212f25d68 0000000000000006 0000000000000020 0000000000000005 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 ffffffff8023d54e 0000000f00000067 0000000212f25dd8 >Jul 1 13:18:48 taft-02 kernel: 0000010212d6a7f0 000000000002b367 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8023d54e>{do_con_write+7903} <ffffffff803187d8>{schedule_timeout+257} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80135efc>{add_wait_queue+18} <ffffffff80231b7d>{read_chan+1080} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff801347a8>{__wake_up+54} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8022c766>{tty_read+230} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bac0>{vfs_read+207} <ffffffff8017bd1c>{sys_read+69} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: sshd S 0000000000000008 0 6241 3888 6243 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102165a5d58 0000000000000002 00000001803e7e80 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 000001021239ac48 0000000000000246 0000000000003fc0 00000000165a5d80 >Jul 1 13:18:48 taft-02 kernel: 0000010212d6a030 0000000000000d16 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff8022c225>{tty_ldisc_try+60} <ffffffff803187d8>{schedule_timeout+257} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8022c358>{tty_ldisc_deref+103} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801968e9>{dnotify_parent+34} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: bash S 0000007fbffff7b4 0 6243 6241 12418 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010211631eb8 0000000000000002 000000010a7aa000 00000102111c6018 >Jul 1 13:18:48 taft-02 kernel: 0000000100000016 000001020a7abe48 00000102139b6a80 0000000100000000 >Jul 1 13:18:48 taft-02 kernel: 0000010214633030 0000000000003ad5 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff801ef299>{__up_read+16} <ffffffff801248c9>{do_page_fault+577} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8013c679>{do_wait+3413} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141da6>{recalc_sigpending+15} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: ccsd S 000000000000000b 0 6301 1 6302 4267 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010211e4dd58 0000000000000002 000001021593ac80 0000000000000014 >Jul 1 13:18:48 taft-02 kernel: 0000010211e4dd90 0000000000000246 0000000000000246 00000002802b708f >Jul 1 13:18:48 taft-02 kernel: 00000102146377f0 000000000000048d >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: ccsd S 0000000000000009 0 6302 1 6363 6301 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010210e2fd58 0000000000000002 0000000000000001 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000010215779688 0000000000000246 0000010210e2fe80 000000000b391180 >Jul 1 13:18:48 taft-02 kernel: 00000102145347f0 000000000001b2ff >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff802ba163>{datagram_poll+39} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e573>{do_select+939} <ffffffff8018e10d>{__pollwait+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e8f2>{sys_select+820} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: cman_comms S 0000000000190000 0 6363 1 6364 6302 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010211417d98 0000000000000046 ffffffff803e7e80 00000102129c8030 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000001 0000010211417d38 00000000801347a8 >Jul 1 13:18:48 taft-02 kernel: 00000102129c8030 0000000000000194 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa0244c1f>{:cman:send_to_user_port+758} <ffffffffa0246829>{:cman:cluster_kthread+299} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8017bccb>{vfs_write+248} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa02466fe>{:cman:cluster_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: cman_serviced S ffffffff8014c590 0 6365 10 6427 556 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001021150bf08 0000000000000046 000001000693f030 0000000000000002 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000001 0000000000000246 0000000300000003 >Jul 1 13:18:48 taft-02 kernel: 00000102111997f0 0000000000000389 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa02537ed>{:cman:process_recoveries+556} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa024fb11>{:cman:serviced+0} <ffffffffa024fc39>{:cman:serviced+296} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: cman_memb S 0000000000000003 0 6364 1 6372 6363 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010211193e38 0000000000000046 000000000693f7f0 0000010212c6e380 >Jul 1 13:18:48 taft-02 kernel: 000001020c8687f0 0000000000000074 0000000000000003 00000002a02650e0 >Jul 1 13:18:48 taft-02 kernel: 00000102122357f0 00000000000002e6 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa024e3e9>{:cman:membership_kthread+2891} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80133468>{schedule_tail+55} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa024d89e>{:cman:membership_kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: cman_hbeat S 0000010211193dc8 0 6372 1 6391 6364 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 00000102124f5f18 0000000000000046 0000000000000000 0000001900000073 >Jul 1 13:18:48 taft-02 kernel: 00000102163ef7f0 0000010212c6e380 ffffffffa0265400 0000000200000026 >Jul 1 13:18:48 taft-02 kernel: 0000010006bf67f0 0000000000000be8 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa024b858>{:cman:hello_kthread+478} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa024b67a>{:cman:hello_kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: fenced S ffffffff801102f6 0 6391 1 6426 6372 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010211e8ff28 0000000000000006 00000000000018dd ffffff9100000000 >Jul 1 13:18:48 taft-02 kernel: 0000000000507d7d 0000000000000000 0000010211e8fec8 0000000300000010 >Jul 1 13:18:48 taft-02 kernel: 00000102162d17f0 0000000000000fe1 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff801102f6>{system_call+126} <ffffffff8010fe2f>{sys_rt_sigsuspend+199} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8011066b>{ptregscall_common+103} >Jul 1 13:18:48 taft-02 kernel: clvmd S 000000000000000f 0 6426 1 6455 6391 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010211315d58 0000000000000002 000001000693f7f0 0000001900000075 >Jul 1 13:18:48 taft-02 kernel: 00000102093347f0 0000000000000075 0000010001071a40 0000000200000246 >Jul 1 13:18:48 taft-02 kernel: 0000010214269030 0000000000000b1a >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff80133323>{wake_up_new_task+694} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e8f2>{sys_select+820} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: clvmd S 0000000040a000d0 0 6455 1 6456 6426 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010210cbbe58 0000000000000002 0000000000000246 0000000000000003 >Jul 1 13:18:48 taft-02 kernel: 0000010210cbbde8 ffffffff801347a8 ffffffff804aa510 0000000200000202 >Jul 1 13:18:48 taft-02 kernel: 0000010037ce9030 0000000000000cdc >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff801347a8>{__wake_up+54} <ffffffffa0269d23>{:dlm:dlm_read+259} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bac0>{vfs_read+207} <ffffffff8017bd1c>{sys_read+69} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: clvmd D ffffffffa00bd364 0 6456 1 7189 6455 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102123a9bf8 0000000000000002 0000000000086a62 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000000 ffffffff80485dce 0000000000000246 >Jul 1 13:18:48 taft-02 kernel: 0000010212235030 0000000000003c58 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa00bd364>{:dm_mod:dev_suspend+0} <ffffffff80317f68>{wait_for_completion+167} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02545e1>{:cman:kcl_leave_service+249} <ffffffffa028ce13>{:dm_cmirror:cluster_dtr+660} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa01022a3>{:dm_mirror:dm_destroy_dirty_log+10} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0104749>{:dm_mirror:free_context+216} <ffffffffa00baf69>{:dm_mod:table_destroy+72} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa00ba486>{:dm_mod:dm_swap_table+119} <ffffffffa00bd364>{:dm_mod:dev_suspend+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa00bd60e>{:dm_mod:dev_suspend+682} <ffffffffa00be6a2>{:dm_mod:ctl_ioctl+602} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801847f2>{sys_newstat+32} <ffffffff8018db79>{sys_ioctl+853} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: clvmd S 0000000000000001 0 12317 1 12309 12271 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010206bc9d78 0000000000000002 0000000000000016 0000000000000001 >Jul 1 13:18:48 taft-02 kernel: ffffffffa0288d50 0000000000000000 ffffffffa0288d58 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000010208d54030 000000000000cbaa >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff801347a8>{__wake_up+54} <ffffffff803187d8>{schedule_timeout+257} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8016e482>{find_extend_vma+22} <ffffffff80135efc>{add_wait_queue+18} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014db77>{do_futex+531} <ffffffffa026aa4c>{:dlm:dlm_write+2538} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014dfcd>{sys_futex+203} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bda5>{sys_write+96} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: clvmd S 0000000000000001 0 12419 1 12309 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010206943d78 0000000000000002 ffffffffa0288d58 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000010206943d08 ffffffff80134752 0000000100000000 00000002a0288d50 >Jul 1 13:18:48 taft-02 kernel: 00000102093347f0 000000000000a25d >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80134752>{__wake_up_common+67} <ffffffff801347a8>{__wake_up+54} >Jul 1 13:18:48 taft-02 kernel: <ffffffff803187d8>{schedule_timeout+257} <ffffffff8016e482>{find_extend_vma+22} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80135efc>{add_wait_queue+18} <ffffffff8014db77>{do_futex+531} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa026aa4c>{:dlm:dlm_write+2538} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014dfcd>{sys_futex+203} <ffffffff8017bda5>{sys_write+96} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: dlm_astd S 0000010037ca1800 0 6427 10 6429 6365 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 00000102118bfec8 0000000000000046 ffffffff803e7e80 0000001900000069 >Jul 1 13:18:48 taft-02 kernel: 00000101ffc8f7f0 0000000000000069 0000010001061a40 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 00000100dffba030 0000000000000136 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffffa02ee2b3>{:lock_dlm:lock_bast+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0268a43>{:dlm:dlm_astd+314} <ffffffffa0268909>{:dlm:dlm_astd+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: dlm_recvd S ffffffff8014c590 0 6428 12 6430 555 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010210c89ef8 0000000000000046 ffffffffffffffff 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 0000000000000246 ffffffffa0270b9c 0000010001061a40 0000000000000072 >Jul 1 13:18:48 taft-02 kernel: 0000010215c047f0 0000000000000546 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa0270b9c>{:dlm:receive_from_sock+849} <ffffffff8013d498>{__do_softirq+88} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffffa0271037>{:dlm:dlm_recvd+170} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0270f8d>{:dlm:dlm_recvd+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: dlm_sendd S 00000100010607e0 0 6429 10 6427 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010210c8be78 0000000000000046 0000000000000001 0000001900000069 >Jul 1 13:18:48 taft-02 kernel: 0000010215d287f0 0000000000000069 0000010001071a40 0000000200000246 >Jul 1 13:18:48 taft-02 kernel: 0000010006b6b7f0 00000000000009ac >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff802dda0d>{tcp_sendpage+0} <ffffffffa0271342>{:dlm:dlm_sendd+218} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa0271268>{:dlm:dlm_sendd+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: dlm_recoverd S ffffffff803173f8 0 6430 12 6428 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010210c8fea8 0000000000000046 000000000000002f 00000101fff679e8 >Jul 1 13:18:48 taft-02 kernel: 00000000fffffffb 0000000000000000 0000010001061a40 000000038013303e >Jul 1 13:18:48 taft-02 kernel: 0000010006aed7f0 000000000000042f >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa02688a7>{:dlm:wake_astd+27} <ffffffffa0278613>{:dlm:dlm_recoverd+60} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02785d7>{:dlm:dlm_recoverd+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: btimed S 0000000000000100 0 6684 3907 12354 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010211603af8 0000000000000002 ffffffff803e7e80 0000010006a32000 >Jul 1 13:18:48 taft-02 kernel: 000001021178c380 00000100dff17600 0000010006a321d4 0000000000001000 >Jul 1 13:18:48 taft-02 kernel: 0000010216081030 000000000000010d >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff802bcdb6>{dev_queue_xmit+541} <ffffffff803187d8>{schedule_timeout+257} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8013601c>{prepare_to_wait_exclusive+21} <ffffffff802b9a39>{skb_recv_datagram+373} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802f6dd0>{udp_recvmsg+118} <ffffffff802b7462>{sock_common_recvmsg+48} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802b3f08>{sock_recvmsg+284} <ffffffff80189ad5>{link_path_walk+176} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80191eb2>{dput+189} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802b3af3>{sockfd_lookup+16} <ffffffff802b536b>{sys_recvfrom+182} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: dmeventd S 0000000000000006 0 7189 1 12037 6456 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 000001020c1c5d58 0000000000000006 ffffffff803e7e80 0000001900000072 >Jul 1 13:18:48 taft-02 kernel: 000001021592b7f0 0000000000000246 0000010001061a40 00000000000003e7 >Jul 1 13:18:48 taft-02 kernel: 000001020d0b0030 000000000000053f >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801968e9>{dnotify_parent+34} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: dmeventd S 000001020a5a1d48 0 12080 1 12153 12037 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 000001020a5a1bb8 0000000000000006 000001000693f7f0 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 00000102162d1030 0000000000000074 0000010001071a40 000000021426a980 >Jul 1 13:18:48 taft-02 kernel: 0000010006bb5030 0000000000000fc6 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff80135fc0>{prepare_to_wait+21} >Jul 1 13:18:48 taft-02 kernel: <ffffffff803138d0>{unix_stream_recvmsg+622} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff802b40ae>{sock_aio_read+297} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802b41f4>{sock_aio_write+306} <ffffffff8017b9c5>{do_sync_read+178} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802b5293>{sys_sendto+208} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801968e9>{dnotify_parent+34} <ffffffff8017bad3>{vfs_read+226} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bd1c>{sys_read+69} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: dmeventd S 00000100010607e0 0 12153 1 12250 12080 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 000001020a217d78 0000000000000006 00000100010707e0 0000001900000064 >Jul 1 13:18:48 taft-02 kernel: 0000010006bb5030 0000000000000064 0000010001071a40 0000000200000005 >Jul 1 13:18:48 taft-02 kernel: 000001020baa17f0 000000000000699a >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff8016e482>{find_extend_vma+22} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80135efc>{add_wait_queue+18} <ffffffff8014db77>{do_futex+531} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff8014dfcd>{sys_futex+203} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: bash R running task 0 10054 4261 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: cluster_log_s S 0000000000000000 0 12037 1 12080 7189 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020a8c59d8 0000000000000046 000001000693f030 0000001900000073 >Jul 1 13:18:48 taft-02 kernel: 00000102129c8030 0000000000000073 0000010001061a40 000000031468e200 >Jul 1 13:18:48 taft-02 kernel: 0000010215e427f0 00000000000000d2 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff80318d35>{_spin_unlock_irqrestore+47} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8013601c>{prepare_to_wait_exclusive+21} <ffffffff802b9a39>{skb_recv_datagram+373} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff802db918>{ip_push_pending_frames+855} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff802f6dd0>{udp_recvmsg+118} >Jul 1 13:18:48 taft-02 kernel: <ffffffff802b7462>{sock_common_recvmsg+48} <ffffffff802b3f08>{sock_recvmsg+284} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8013303e>{try_to_wake_up+876} <ffffffff80134752>{__wake_up_common+67} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801347a8>{__wake_up+54} <ffffffff80132a85>{recalc_task_prio+337} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff80140a38>{__mod_timer+293} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa028f154>{:dm_cmirror:my_recvmsg+265} <ffffffffa028f03c>{:dm_cmirror:set_sigusr1+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa028f03c>{:dm_cmirror:set_sigusr1+0} <ffffffffa028dbce>{:dm_cmirror:cluster_log_serverd+784} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa028d8be>{:dm_cmirror:cluster_log_serverd+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: dlm_recoverd S 00000100010787e0 0 12247 13 12249 1107 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020a0bdea8 0000000000000046 000000000000002f 0000001900000073 >Jul 1 13:18:48 taft-02 kernel: 00000102129c8030 0000000000000073 0000010001069a40 00000001010707e0 >Jul 1 13:18:48 taft-02 kernel: 000001021592b030 0000000000014f28 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa0278613>{:dlm:dlm_recoverd+60} <ffffffffa02785d7>{:dlm:dlm_recoverd+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: lock_dlm1 S 0000000000000000 0 12248 11 12262 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020c7ebe58 0000000000000046 000001021fb55060 0000001900000069 >Jul 1 13:18:48 taft-02 kernel: 000001020c828030 0000000000000069 0000010001069a40 00000001069124a8 >Jul 1 13:18:48 taft-02 kernel: 000001020c828030 00000000000000c9 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa02f2560>{:lock_dlm:dlm_async+356} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02f23fc>{:lock_dlm:dlm_async+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: lock_dlm2 S 0000000000000000 0 12249 13 12263 12247 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020a659e58 0000000000000046 0000010006b6b7f0 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 000001000693c7f0 0000000000000074 0000010001071a40 00000002a029e083 >Jul 1 13:18:48 taft-02 kernel: 0000010215d287f0 0000000000000132 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa02f2560>{:lock_dlm:dlm_async+356} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02f23fc>{:lock_dlm:dlm_async+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_scand S 0000000000000000 0 12250 1 12251 12153 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020b2bbea8 0000000000000046 000001000693f030 0000010209c2b494 >Jul 1 13:18:48 taft-02 kernel: 0000000000000005 0000000000000000 0000000000000000 0000000300000000 >Jul 1 13:18:48 taft-02 kernel: 000001020c8287f0 0000000000029c39 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffffa029c6d1>{:gfs:gfs_scand+137} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa029c648>{:gfs:gfs_scand+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_glockd S 0000000000000000 0 12251 1 12252 12250 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020bd3bed8 0000000000000046 0000000000000001 ffffffffa02a9867 >Jul 1 13:18:48 taft-02 kernel: 00000102138ea700 0000010208fab040 ffffffffa02ea660 0000000208fab148 >Jul 1 13:18:48 taft-02 kernel: 000001021677a030 0000000000004b2d >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa02a9867>{:gfs:gfs_glock_drop_th+290} <ffffffffa02a8255>{:gfs:unlock_on_glock+37} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029c7d6>{:gfs:gfs_glockd+185} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029c71d>{:gfs:gfs_glockd+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: gfs_recoverd S 0000000000000000 0 12252 1 12253 12251 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020b7e9ea8 0000000000000046 000001000693f030 0000001900000069 >Jul 1 13:18:48 taft-02 kernel: 00000102111997f0 0000000000000069 0000010001079a40 000000030000000d >Jul 1 13:18:48 taft-02 kernel: 000001020d0b07f0 000000000000016f >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffffa029c897>{:gfs:gfs_recoverd+137} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa029c80e>{:gfs:gfs_recoverd+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_logd S 0000000000000000 0 12253 1 12254 12252 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020a111e38 0000000000000046 000001000693c030 ffffffffa02a8a9e >Jul 1 13:18:48 taft-02 kernel: 0000000300000000 000001020a111e30 000001020a111e38 0000000100000246 >Jul 1 13:18:48 taft-02 kernel: 0000010006bed7f0 0000000000000196 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa02a8a9e>{:gfs:glock_wait_internal+710} <ffffffff80140a38>{__mod_timer+293} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80318863>{schedule_timeout+396} <ffffffff80141462>{process_timeout+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029c9df>{:gfs:gfs_logd+252} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801d37a3>{dummy_d_instantiate+0} <ffffffffa029c8e3>{:gfs:gfs_logd+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_quotad S 0000000000000000 0 12254 1 12255 12253 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020bc21e98 0000000000000046 000001000693c030 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 0000010212c5d030 0000000000000074 0000010001069a40 00000001010607e0 >Jul 1 13:18:48 taft-02 kernel: 000001020c97e030 000000000000010c >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffffa029cbde>{:gfs:gfs_quotad+428} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa029ca32>{:gfs:gfs_quotad+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_inoded S 0000000000000000 0 12255 1 12266 12254 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020b501ea8 0000000000000046 000001000693f030 0000001900000073 >Jul 1 13:18:48 taft-02 kernel: 0000010006bed7f0 0000000000000073 0000010001079a40 0000000300000003 >Jul 1 13:18:48 taft-02 kernel: 0000010217bb17f0 000000000000016b >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffffa029ccb8>{:gfs:gfs_inoded+137} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa029cc2f>{:gfs:gfs_inoded+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: dlm_recoverd S 0000000000000000 0 12262 11 12264 12248 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020cbffea8 0000000000000046 000000000000002f 00000102179f65e8 >Jul 1 13:18:48 taft-02 kernel: 00000000fffffffb 0000000000000000 0000010001071a40 000000028013303e >Jul 1 13:18:48 taft-02 kernel: 000001020d2cf7f0 0000000000019871 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa02688a7>{:dlm:wake_astd+27} <ffffffffa0278613>{:dlm:dlm_recoverd+60} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02785d7>{:dlm:dlm_recoverd+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: lock_dlm1 S 0000000000000000 0 12263 13 12249 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020c4d3e58 0000000000000046 000001000693c030 0000001900000069 >Jul 1 13:18:48 taft-02 kernel: 000001020baa1030 0000000000000069 0000010001069a40 0000000100000000 >Jul 1 13:18:48 taft-02 kernel: 000001020baa1030 0000000000000138 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80134875>{complete+53} <ffffffffa02f2560>{:lock_dlm:dlm_async+356} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffffa02f23fc>{:lock_dlm:dlm_async+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c567>{kthread+200} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c49f>{kthread+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: lock_dlm2 S 0000000000000000 0 12264 11 12356 12262 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020b7f7e58 0000000000000046 000001020b783520 0000001900000069 >Jul 1 13:18:48 taft-02 kernel: 000001020b72c030 0000000000000069 0000010001071a40 0000000200000001 >Jul 1 13:18:48 taft-02 kernel: 000001020b72c030 00000000000000cf >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffffa02f2560>{:lock_dlm:dlm_async+356} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02f23fc>{:lock_dlm:dlm_async+0} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_scand S 0000000000000000 0 12266 1 12267 12255 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020baa3ea8 0000000000000046 000001000693f030 000001020baa3f14 >Jul 1 13:18:48 taft-02 kernel: 000001020853e3e8 ffffffffffffffef 0000000300000000 00000003107f2500 >Jul 1 13:18:48 taft-02 kernel: 00000102133d4030 0000000000029cd6 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff801347a8>{__wake_up+54} <ffffffff80140a38>{__mod_timer+293} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80318863>{schedule_timeout+396} <ffffffff80141462>{process_timeout+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029c6d1>{:gfs:gfs_scand+137} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029c648>{:gfs:gfs_scand+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: gfs_glockd D 0000010208b24948 0 12267 1 12268 12266 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020c839d78 0000000000000046 000001020c839ce8 ffffffff80132b13 >Jul 1 13:18:48 taft-02 kernel: 00000100010607e0 000000000000000f 00000100dffba030 0000000100000000 >Jul 1 13:18:48 taft-02 kernel: 000001020b72c7f0 0000000000002d72 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80132b13>{activate_task+124} <ffffffff803189bc>{__down_write+134} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02b440e>{:gfs:log_flush_internal+50} <ffffffffa02ab883>{:gfs:inode_go_sync+71} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02a9810>{:gfs:gfs_glock_drop_th+203} <ffffffffa02a8001>{:gfs:run_queue+314} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02a8255>{:gfs:unlock_on_glock+37} <ffffffffa02a834b>{:gfs:gfs_reclaim_glock+234} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029c75a>{:gfs:gfs_glockd+61} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80134701>{default_wake_function+0} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029c71d>{:gfs:gfs_glockd+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: gfs_recoverd S 0000000000000000 0 12268 1 12269 12267 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020c175ea8 0000000000000046 000001000693f030 0000001900000069 >Jul 1 13:18:48 taft-02 kernel: 00000102111997f0 0000000000000069 0000010001079a40 000000030000000d >Jul 1 13:18:48 taft-02 kernel: 000001020a45e030 0000000000000147 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffffa029c897>{:gfs:gfs_recoverd+137} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa029c80e>{:gfs:gfs_recoverd+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_logd D 0000000000000000 0 12269 1 12270 12268 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020cb9be38 0000000000000046 000001000693c030 0000001900000000 >Jul 1 13:18:48 taft-02 kernel: 0000010206939030 0000000100000074 0000010001079a40 0000000100000002 >Jul 1 13:18:48 taft-02 kernel: 0000010214638030 00000000000012f3 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff803189bc>{__down_write+134} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02b3527>{:gfs:gfs_ail_empty+56} <ffffffffa029c930>{:gfs:gfs_logd+77} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80133468>{schedule_tail+55} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801d37a3>{dummy_d_instantiate+0} <ffffffffa029c8e3>{:gfs:gfs_logd+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_quotad D 0000000000000000 0 12270 1 12271 12269 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020c27fe98 0000000000000046 000001000693c030 0000001900000074 >Jul 1 13:18:48 taft-02 kernel: 000001020c8687f0 0000000000000074 0000010001069a40 0000000100000003 >Jul 1 13:18:48 taft-02 kernel: 0000010211199030 000000000000253f >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff803189bc>{__down_write+134} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02c541e>{:gfs:gfs_quota_sync+226} <ffffffffa029cb4d>{:gfs:gfs_quotad+283} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fd3>{child_rip+8} <ffffffffa029ca32>{:gfs:gfs_quotad+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: gfs_inoded D 0000000000000000 0 12271 1 12317 12270 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 000001020d2d5e98 0000000000000046 000001020d2d5ea8 ffffffff80317d7c >Jul 1 13:18:48 taft-02 kernel: 000001000693f030 0000000000000000 000005ca50891e25 000000030d2cf030 >Jul 1 13:18:48 taft-02 kernel: 000001020b84e030 00000000000015fb >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80317d7c>{thread_return+88} <ffffffff803189bc>{__down_write+134} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02cbcad>{:gfs:unlinked_find+115} <ffffffffa02cc30c>{:gfs:gfs_unlinked_dealloc+25} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029cc71>{:gfs:gfs_inoded+66} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029cc2f>{:gfs:gfs_inoded+0} <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: xdoio D ffffff00107c2000 0 12309 1 12419 12317 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 0000010206a65bf8 0000000000000002 0000000000000001 0000000000000001 >Jul 1 13:18:48 taft-02 kernel: 0000000000000000 0000000000000000 0000010006a9d5c0 0000000206a65bc0 >Jul 1 13:18:48 taft-02 kernel: 0000010206939030 000000000001b090 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80316fc3>{__down+147} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8015e025>{generic_file_write_nolock+158} <ffffffff80318ae1>{__down_failed+53} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa029fa48>{:gfs:.text.lock.dio+95} <ffffffffa02cb4ec>{:gfs:gfs_trans_add_bh+205} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02bd7e3>{:gfs:do_write_buf+1138} <ffffffffa02bc657>{:gfs:walk_vm+278} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02bd371>{:gfs:do_write_buf+0} <ffffffffa02bd371>{:gfs:do_write_buf+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffffa02bda42>{:gfs:__gfs_write+201} <ffffffff8017bca2>{vfs_write+207} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017bd8a>{sys_write+69} <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: >Jul 1 13:18:48 taft-02 kernel: qarshd S 0000000000000001 0 12354 3907 12355 6684 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 00000102032f1d58 0000000000000002 0000000000000031 00000102032f1e88 >Jul 1 13:18:48 taft-02 kernel: 00000102032f1d58 0000000000000246 0000000000000031 00000000802b3d83 >Jul 1 13:18:48 taft-02 kernel: 000001020d2cf030 00000000000018cc >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80140a38>{__mod_timer+293} <ffffffff80318863>{schedule_timeout+396} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80141462>{process_timeout+0} <ffffffff8018e573>{do_select+939} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8018e10d>{__pollwait+0} <ffffffff8018e8f2>{sys_select+820} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: sync D 0000000000000000 0 12355 12354 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 000001020338fe88 0000000000000006 000001020338fe38 ffffffff80132a85 >Jul 1 13:18:48 taft-02 kernel: 0000010205adc7f0 0000000000000206 00000000c0000100 0000000100000009 >Jul 1 13:18:48 taft-02 kernel: 0000010205adc7f0 0000000000009ca3 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff80132a85>{recalc_task_prio+337} <ffffffff80132b13>{activate_task+124} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80316fc3>{__down+147} <ffffffff80134701>{default_wake_function+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80318ae1>{__down_failed+53} <ffffffff801824be>{.text.lock.super+25} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8017d09e>{do_sync+33} <ffffffff8017d0e2>{sys_sync+11} >Jul 1 13:18:48 taft-02 kernel: <ffffffff801102f6>{system_call+126} >Jul 1 13:18:48 taft-02 kernel: pdflush S ffffffff8014c590 0 12356 11 12264 (L-TLB) >Jul 1 13:18:48 taft-02 kernel: 0000010202c3dec8 0000000000000046 000001020b84e7f0 0000000000000000 >Jul 1 13:18:48 taft-02 kernel: 000001020b84e7f0 0000010001069120 0000010215c0b6c0 00000001010687e0 >Jul 1 13:18:48 taft-02 kernel: 000001020b84e7f0 0000000000000868 >Jul 1 13:18:48 taft-02 kernel: Call Trace:<ffffffff801349d2>{set_user_nice+259} <ffffffff8014c590>{keventd_create_kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80161c10>{pdflush+191} <ffffffff80161b51>{pdflush+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c567>{kthread+200} <ffffffff80110fd3>{child_rip+8} >Jul 1 13:18:48 taft-02 kernel: <ffffffff8014c590>{keventd_create_kthread+0} <ffffffff8014c49f>{kthread+0} >Jul 1 13:18:48 taft-02 kernel: <ffffffff80110fcb>{child_rip+0} >Jul 1 13:18:48 taft-02 kernel: lvs S 000001020a7abd48 0 12418 6243 (NOTLB) >Jul 1 13:18:48 taft-02 kernel: 000001020a7abbb8 0000000000000002 ffffffff803e7e80 0000010206f70280 >Jul 1 13:18:48 taft-02 kernel: 0000000000000021 000001021791c180 0000000000000246 00000000a00526d0 >Jul 1 13:18:49 taft-02 kernel: 000001020a4b87f0 0000000000000cd6 >Jul 1 13:18:49 taft-02 kernel: Call Trace:<ffffffff803187d8>{schedule_timeout+257} <ffffffff80135fc0>{prepare_to_wait+21} >Jul 1 13:18:49 taft-02 kernel: <ffffffff803138d0>{unix_stream_recvmsg+622} <ffffffff801360c4>{autoremove_wake_function+0} >Jul 1 13:18:49 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff802b40ae>{sock_aio_read+297} >Jul 1 13:18:49 taft-02 kernel: <ffffffff802b41f4>{sock_aio_write+306} <ffffffff8017b9c5>{do_sync_read+178} >Jul 1 13:18:49 taft-02 kernel: <ffffffff80189fc9>{__user_walk+94} <ffffffff8018448c>{vfs_stat64+24} >Jul 1 13:18:49 taft-02 kernel: <ffffffff801360c4>{autoremove_wake_function+0} <ffffffff801968e9>{dnotify_parent+34} >Jul 1 13:18:49 taft-02 kernel: <ffffffff8017bad3>{vfs_read+226} <ffffffff8017bd1c>{sys_read+69} >Jul 1 13:18:49 taft-02 kernel: <ffffffff801102f6>{system_call+126}
<b>You cannot view the attachment while viewing its details because your browser does not support IFRAMEs. <a href="attachment.cgi?id=310702">View the attachment on a separate page</a>.</b>
View Attachment As Raw
Actions:
View
Attachments on
bug 254225
:
172454
|
172456
|
251951
|
251961
|
251971
|
251981
|
251991
|
252001
|
252031
|
252041
|
252051
|
252061
| 310702 |
310703
|
310704