Attachment 714384 Details for Bug 924624 – /var/log/messages with the stacktraces

/var/log/messages with the stacktraces

rhel-6-virt-messsages (text/plain), 15.14 KB, created by Jan Synacek on 2013-03-22 09:01:18 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Jan Synacek

Created: 2013-03-22 09:01:18 UTC

Size: 15.14 KB

patch

obsolete

>Mar 21 14:36:02 rhel-6 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="1308" x-info="http://www.rsyslog.com"] rsyslogd was HUPed
>Mar 21 14:39:53 rhel-6 rhsmd: In order for Subscription Manager to provide your system with updates, your system must be registered with the Customer Portal. Please enter your Red Hat login to ensure your system is up-to-date.
>Mar 22 07:28:06 rhel-6 kernel: Clocksource tsc unstable (delta = -124798053927 ns).  Enable clocksource failover by adding clocksource_failover kernel parameter.
>Mar 22 07:32:06 rhel-6 kernel: INFO: task sa1:17477 blocked for more than 120 seconds.
>Mar 22 07:32:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:32:06 rhel-6 kernel: sa1           D 0000000000000000     0 17477  17475 0x00000080
>Mar 22 07:32:06 rhel-6 kernel: ffff88007ab93ce8 0000000000000082 0000000000000000 ffff88007af3e080
>Mar 22 07:32:06 rhel-6 kernel: ffff88007af3e0b8 0000000000000000 ffff88007ab93ca8 ffffffff81064a00
>Mar 22 07:32:06 rhel-6 kernel: ffff88007af3e638 ffff88007ab93fd8 000000000000fb88 ffff88007af3e638
>Mar 22 07:32:06 rhel-6 kernel: Call Trace:
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff81064a00>] ? pick_next_task_fair+0xd0/0x130
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff8150d84a>] ? thread_return+0x1b8/0x76e
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff810669eb>] ? enqueue_rt_entity+0x6b/0x80
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:32:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:34:06 rhel-6 kernel: INFO: task sa1:17477 blocked for more than 120 seconds.
>Mar 22 07:34:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:34:06 rhel-6 kernel: sa1           D 0000000000000000     0 17477  17475 0x00000080
>Mar 22 07:34:06 rhel-6 kernel: ffff88007ab93ce8 0000000000000082 0000000000000000 ffff88007af3e080
>Mar 22 07:34:06 rhel-6 kernel: ffff88007af3e0b8 0000000000000000 ffff88007ab93ca8 ffffffff81064a00
>Mar 22 07:34:06 rhel-6 kernel: ffff88007af3e638 ffff88007ab93fd8 000000000000fb88 ffff88007af3e638
>Mar 22 07:34:06 rhel-6 kernel: Call Trace:
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff81064a00>] ? pick_next_task_fair+0xd0/0x130
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8150d84a>] ? thread_return+0x1b8/0x76e
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff810669eb>] ? enqueue_rt_entity+0x6b/0x80
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:34:06 rhel-6 kernel: INFO: task ksmtuned:17487 blocked for more than 120 seconds.
>Mar 22 07:34:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:34:06 rhel-6 kernel: ksmtuned      D 0000000000000000     0 17487  17486 0x00000080
>Mar 22 07:34:06 rhel-6 kernel: ffff88007ad75ce8 0000000000000082 0000000000000000 0000000000000000
>Mar 22 07:34:06 rhel-6 kernel: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>Mar 22 07:34:06 rhel-6 kernel: ffff88007988dab8 ffff88007ad75fd8 000000000000fb88 ffff88007988dab8
>Mar 22 07:34:06 rhel-6 kernel: Call Trace:
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffffa008bbf0>] ? ext4_file_open+0x0/0x130 [ext4]
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8117e434>] ? nameidata_to_filp+0x54/0x70
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff812771e9>] ? cpumask_next_and+0x29/0x50
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:34:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:36:06 rhel-6 kernel: INFO: task sa1:17477 blocked for more than 120 seconds.
>Mar 22 07:36:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:36:06 rhel-6 kernel: sa1           D 0000000000000000     0 17477  17475 0x00000080
>Mar 22 07:36:06 rhel-6 kernel: ffff88007ab93ce8 0000000000000082 0000000000000000 ffff88007af3e080
>Mar 22 07:36:06 rhel-6 kernel: ffff88007af3e0b8 0000000000000000 ffff88007ab93ca8 ffffffff81064a00
>Mar 22 07:36:06 rhel-6 kernel: ffff88007af3e638 ffff88007ab93fd8 000000000000fb88 ffff88007af3e638
>Mar 22 07:36:06 rhel-6 kernel: Call Trace:
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff81064a00>] ? pick_next_task_fair+0xd0/0x130
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8150d84a>] ? thread_return+0x1b8/0x76e
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff810669eb>] ? enqueue_rt_entity+0x6b/0x80
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:36:06 rhel-6 kernel: INFO: task ksmtuned:17487 blocked for more than 120 seconds.
>Mar 22 07:36:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:36:06 rhel-6 kernel: ksmtuned      D 0000000000000000     0 17487  17486 0x00000080
>Mar 22 07:36:06 rhel-6 kernel: ffff88007ad75ce8 0000000000000082 0000000000000000 0000000000000000
>Mar 22 07:36:06 rhel-6 kernel: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>Mar 22 07:36:06 rhel-6 kernel: ffff88007988dab8 ffff88007ad75fd8 000000000000fb88 ffff88007988dab8
>Mar 22 07:36:06 rhel-6 kernel: Call Trace:
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffffa008bbf0>] ? ext4_file_open+0x0/0x130 [ext4]
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8117e434>] ? nameidata_to_filp+0x54/0x70
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff812771e9>] ? cpumask_next_and+0x29/0x50
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:36:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:38:06 rhel-6 kernel: INFO: task sa1:17477 blocked for more than 120 seconds.
>Mar 22 07:38:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:38:06 rhel-6 kernel: sa1           D 0000000000000000     0 17477  17475 0x00000080
>Mar 22 07:38:06 rhel-6 kernel: ffff88007ab93ce8 0000000000000082 0000000000000000 ffff88007af3e080
>Mar 22 07:38:06 rhel-6 kernel: ffff88007af3e0b8 0000000000000000 ffff88007ab93ca8 ffffffff81064a00
>Mar 22 07:38:06 rhel-6 kernel: ffff88007af3e638 ffff88007ab93fd8 000000000000fb88 ffff88007af3e638
>Mar 22 07:38:06 rhel-6 kernel: Call Trace:
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff81064a00>] ? pick_next_task_fair+0xd0/0x130
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8150d84a>] ? thread_return+0x1b8/0x76e
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff810669eb>] ? enqueue_rt_entity+0x6b/0x80
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:38:06 rhel-6 kernel: INFO: task ksmtuned:17487 blocked for more than 120 seconds.
>Mar 22 07:38:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:38:06 rhel-6 kernel: ksmtuned      D 0000000000000000     0 17487  17486 0x00000080
>Mar 22 07:38:06 rhel-6 kernel: ffff88007ad75ce8 0000000000000082 0000000000000000 0000000000000000
>Mar 22 07:38:06 rhel-6 kernel: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>Mar 22 07:38:06 rhel-6 kernel: ffff88007988dab8 ffff88007ad75fd8 000000000000fb88 ffff88007988dab8
>Mar 22 07:38:06 rhel-6 kernel: Call Trace:
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffffa008bbf0>] ? ext4_file_open+0x0/0x130 [ext4]
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8117e434>] ? nameidata_to_filp+0x54/0x70
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff812771e9>] ? cpumask_next_and+0x29/0x50
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:38:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:40:06 rhel-6 kernel: INFO: task sa1:17477 blocked for more than 120 seconds.
>Mar 22 07:40:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:40:06 rhel-6 kernel: sa1           D 0000000000000000     0 17477  17475 0x00000080
>Mar 22 07:40:06 rhel-6 kernel: ffff88007ab93ce8 0000000000000082 0000000000000000 ffff88007af3e080
>Mar 22 07:40:06 rhel-6 kernel: ffff88007af3e0b8 0000000000000000 ffff88007ab93ca8 ffffffff81064a00
>Mar 22 07:40:06 rhel-6 kernel: ffff88007af3e638 ffff88007ab93fd8 000000000000fb88 ffff88007af3e638
>Mar 22 07:40:06 rhel-6 kernel: Call Trace:
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff81064a00>] ? pick_next_task_fair+0xd0/0x130
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8150d84a>] ? thread_return+0x1b8/0x76e
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff810669eb>] ? enqueue_rt_entity+0x6b/0x80
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:40:06 rhel-6 kernel: INFO: task ksmtuned:17487 blocked for more than 120 seconds.
>Mar 22 07:40:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:40:06 rhel-6 kernel: ksmtuned      D 0000000000000000     0 17487  17486 0x00000080
>Mar 22 07:40:06 rhel-6 kernel: ffff88007ad75ce8 0000000000000082 0000000000000000 0000000000000000
>Mar 22 07:40:06 rhel-6 kernel: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>Mar 22 07:40:06 rhel-6 kernel: ffff88007988dab8 ffff88007ad75fd8 000000000000fb88 ffff88007988dab8
>Mar 22 07:40:06 rhel-6 kernel: Call Trace:
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffffa008bbf0>] ? ext4_file_open+0x0/0x130 [ext4]
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8117e434>] ? nameidata_to_filp+0x54/0x70
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff812771e9>] ? cpumask_next_and+0x29/0x50
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:40:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0
>Mar 22 07:42:06 rhel-6 kernel: INFO: task sa1:17477 blocked for more than 120 seconds.
>Mar 22 07:42:06 rhel-6 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>Mar 22 07:42:06 rhel-6 kernel: sa1           D 0000000000000000     0 17477  17475 0x00000080
>Mar 22 07:42:06 rhel-6 kernel: ffff88007ab93ce8 0000000000000082 0000000000000000 ffff88007af3e080
>Mar 22 07:42:06 rhel-6 kernel: ffff88007af3e0b8 0000000000000000 ffff88007ab93ca8 ffffffff81064a00
>Mar 22 07:42:06 rhel-6 kernel: ffff88007af3e638 ffff88007ab93fd8 000000000000fb88 ffff88007af3e638
>Mar 22 07:42:06 rhel-6 kernel: Call Trace:
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff81064a00>] ? pick_next_task_fair+0xd0/0x130
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff8150d84a>] ? thread_return+0x1b8/0x76e
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff8150e555>] schedule_timeout+0x215/0x2e0
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff810669eb>] ? enqueue_rt_entity+0x6b/0x80
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff8150e1d3>] wait_for_common+0x123/0x180
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff81063310>] ? default_wake_function+0x0/0x20
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff8150e2ed>] wait_for_completion+0x1d/0x20
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff8106513c>] sched_exec+0xdc/0xe0
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff81189fc0>] do_execve+0xe0/0x2c0
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff810095ea>] sys_execve+0x4a/0x80
>Mar 22 07:42:06 rhel-6 kernel: [<ffffffff8100b4ca>] stub_execve+0x6a/0xc0

Actions: View

Attachments on bug 924624: 714384