| Summary: | INFO: inconsistent lock state | ||
|---|---|---|---|
| Product: | [Fedora] Fedora | Reporter: | John Schmitt <marmalodak> |
| Component: | kernel | Assignee: | Kernel Maintainer List <kernel-maint> |
| Status: | CLOSED RAWHIDE | QA Contact: | Fedora Extras Quality Assurance <extras-qa> |
| Severity: | unspecified | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | rawhide | CC: | gansalmon, h.reindl, itamar, jonathan, jones.peter.busi, kernel-maint, ktmdms, madhu.chinakonda, marmalodak |
| Target Milestone: | --- | ||
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2013-12-20 01:39:14 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
I believe this should be fixed in tomorrow's rawhide kernel. Please test 3.13.0-0.rc4.git4.1 Will this build show up in fedora-rawhide-kernel-nodebug, that is, a not-debug build? https://fedoraproject.org/wiki/RawhideKernelNodebug Eventually. Though that won't help actually test things because you need the debug options set to see this. Putting it back in needinfo until we know it's fixed. # uname -r
3.13.0-0.rc4.git1.1.fc21.x86_64
Dec 19 15:39:46 localhost kernel: [ 66.989916]
Dec 19 15:39:46 localhost kernel: [ 66.989917] =================================
Dec 19 15:39:46 localhost kernel: [ 66.989917] [ INFO: inconsistent lock state ]
Dec 19 15:39:46 localhost kernel: [ 66.989920] 3.13.0-0.rc4.git1.1.fc21.x86_64 #1 Tainted: G W
Dec 19 15:39:46 localhost kernel: [ 66.989920] ---------------------------------
Dec 19 15:39:46 localhost kernel: [ 66.989921] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage.
Dec 19 15:39:46 localhost kernel: [ 66.989922] httpd/1180 [HC0[0]:SC1[1]:HE1:SE0] takes:
Dec 19 15:39:46 localhost kernel: [ 66.989931] (&(&sk->sk_dst_lock)->rlock){+.?...}, at: [<ffffffff81698873>] __udp4_lib_rcv+0xb73/0xbc0
Dec 19 15:39:46 localhost kernel: [ 66.989931] {SOFTIRQ-ON-W} state was registered at:
Dec 19 15:39:46 localhost kernel: [ 66.989937] [<ffffffff810cf36c>] __lock_acquire+0x5dc/0x1c10
Dec 19 15:39:46 localhost kernel: [ 66.989938] [<ffffffff810d1192>] lock_acquire+0xa2/0x1d0
Dec 19 15:39:46 localhost kernel: [ 66.989941] [<ffffffff8175e18e>] _raw_spin_lock+0x3e/0x80
Dec 19 15:39:46 localhost kernel: [ 66.989943] [<ffffffff816a364d>] inet_bind+0x1dd/0x260
Dec 19 15:39:46 localhost kernel: [ 66.989945] [<ffffffff815fe9d0>] SYSC_bind+0xe0/0x120
Dec 19 15:39:46 localhost kernel: [ 66.989946] [<ffffffff816001be>] SyS_bind+0xe/0x10
Dec 19 15:39:46 localhost kernel: [ 66.989948] [<ffffffff81768429>] system_call_fastpath+0x16/0x1b
Dec 19 15:39:46 localhost kernel: [ 66.989949] irq event stamp: 22820
Dec 19 15:39:46 localhost kernel: [ 66.989952] hardirqs last enabled at (22820): [<ffffffff8107b201>] local_bh_enable+0x71/0xd0
Dec 19 15:39:46 localhost kernel: [ 66.989953] hardirqs last disabled at (22819): [<ffffffff8107b1c5>] local_bh_enable+0x35/0xd0
Dec 19 15:39:46 localhost kernel: [ 66.989954] softirqs last enabled at (22740): [<ffffffff8107adf8>] __do_softirq+0x198/0x430
Dec 19 15:39:46 localhost kernel: [ 66.989955] softirqs last disabled at (22787): [<ffffffff8107b47d>] irq_exit+0xcd/0xe0
Dec 19 15:39:46 localhost kernel: [ 66.989955]
Dec 19 15:39:46 localhost kernel: [ 66.989955] other info that might help us debug this:
Dec 19 15:39:46 localhost kernel: [ 66.989956] Possible unsafe locking scenario:
Dec 19 15:39:46 localhost kernel: [ 66.989956]
Dec 19 15:39:46 localhost kernel: [ 66.989956] CPU0
Dec 19 15:39:46 localhost kernel: [ 66.989956] ----
Dec 19 15:39:46 localhost kernel: [ 66.989957] lock(&(&sk->sk_dst_lock)->rlock);
Dec 19 15:39:46 localhost kernel: [ 66.989957] <Interrupt>
Dec 19 15:39:46 localhost kernel: [ 66.989958] lock(&(&sk->sk_dst_lock)->rlock);
Dec 19 15:39:46 localhost kernel: [ 66.989958]
Dec 19 15:39:46 localhost kernel: [ 66.989958] *** DEADLOCK ***
Dec 19 15:39:46 localhost kernel: [ 66.989958]
Dec 19 15:39:46 localhost kernel: [ 66.989959] 3 locks held by httpd/1180:
Dec 19 15:39:46 localhost kernel: [ 66.989962] #0: (&mm->mmap_sem){++++++}, at: [<ffffffff81762f01>] __do_page_fault+0x101/0x5e0
Dec 19 15:39:46 localhost kernel: [ 66.989965] #1: (rcu_read_lock){.+.+..}, at: [<ffffffff8161bbdb>] __netif_receive_skb_core+0x13b/0xdb0
Dec 19 15:39:46 localhost kernel: [ 66.989969] #2: (rcu_read_lock){.+.+..}, at: [<ffffffff8165fdb3>] ip_local_deliver_finish+0x43/0x460
Dec 19 15:39:46 localhost kernel: [ 66.989969]
Dec 19 15:39:46 localhost kernel: [ 66.989969] stack backtrace:
Dec 19 15:39:46 localhost kernel: [ 66.989971] CPU: 0 PID: 1180 Comm: httpd Tainted: G W 3.13.0-0.rc4.git1.1.fc21.x86_64 #1
Dec 19 15:39:46 localhost kernel: [ 66.989972] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2011
Dec 19 15:39:46 localhost kernel: [ 66.989974] ffffffff825d4b50 ffff880237c03a10 ffffffff8175578d ffff880096e84d70
Dec 19 15:39:46 localhost kernel: [ 66.989975] ffff880237c03a60 ffffffff817514a6 0000000000000001 ffff880000000001
Dec 19 15:39:46 localhost kernel: [ 66.989976] ffff880200000000 0000000000000006 ffff880096e84d70 ffffffff810cdc80
Dec 19 15:39:46 localhost kernel: [ 66.989976] Call Trace:
Dec 19 15:39:46 localhost kernel: [ 66.989979] <IRQ> [<ffffffff8175578d>] dump_stack+0x4d/0x66
Dec 19 15:39:46 localhost kernel: [ 66.989982] [<ffffffff817514a6>] print_usage_bug+0x1f4/0x205
Dec 19 15:39:46 localhost kernel: [ 66.989984] [<ffffffff810cdc80>] ? check_usage_backwards+0x140/0x140
Dec 19 15:39:46 localhost kernel: [ 66.989985] [<ffffffff810ce683>] mark_lock+0x223/0x2b0
Dec 19 15:39:46 localhost kernel: [ 66.989987] [<ffffffff810cf319>] __lock_acquire+0x589/0x1c10
Dec 19 15:39:46 localhost kernel: [ 66.989988] [<ffffffff8107b201>] ? local_bh_enable+0x71/0xd0
Dec 19 15:39:46 localhost kernel: [ 66.989990] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80
Dec 19 15:39:46 localhost kernel: [ 66.989991] [<ffffffff81021a59>] ? sched_clock+0x9/0x10
Dec 19 15:39:46 localhost kernel: [ 66.989992] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80
Dec 19 15:39:46 localhost kernel: [ 66.990002] [<ffffffff81021a59>] ? sched_clock+0x9/0x10
Dec 19 15:39:46 localhost kernel: [ 66.990005] [<ffffffff810b6435>] ? sched_clock_cpu+0xb5/0x100
Dec 19 15:39:46 localhost kernel: [ 66.990007] [<ffffffff810d1192>] lock_acquire+0xa2/0x1d0
Dec 19 15:39:46 localhost kernel: [ 66.990008] [<ffffffff81698873>] ? __udp4_lib_rcv+0xb73/0xbc0
Dec 19 15:39:46 localhost kernel: [ 66.990009] [<ffffffff8175e18e>] _raw_spin_lock+0x3e/0x80
Dec 19 15:39:46 localhost kernel: [ 66.990010] [<ffffffff81698873>] ? __udp4_lib_rcv+0xb73/0xbc0
Dec 19 15:39:46 localhost kernel: [ 66.990012] [<ffffffff81698873>] __udp4_lib_rcv+0xb73/0xbc0
Dec 19 15:39:46 localhost kernel: [ 66.990013] [<ffffffff8169902a>] udp_rcv+0x1a/0x20
Dec 19 15:39:46 localhost kernel: [ 66.990015] [<ffffffff8165feaf>] ip_local_deliver_finish+0x13f/0x460
Dec 19 15:39:46 localhost kernel: [ 66.990016] [<ffffffff8165fdb3>] ? ip_local_deliver_finish+0x43/0x460
Dec 19 15:39:46 localhost kernel: [ 66.990017] [<ffffffff81660bc8>] ip_local_deliver+0x48/0x80
Dec 19 15:39:46 localhost kernel: [ 66.990019] [<ffffffff81660330>] ip_rcv_finish+0x160/0x760
Dec 19 15:39:46 localhost kernel: [ 66.990020] [<ffffffff81660e94>] ip_rcv+0x294/0x3d0
Dec 19 15:39:46 localhost kernel: [ 66.990022] [<ffffffff8161c492>] __netif_receive_skb_core+0x9f2/0xdb0
Dec 19 15:39:46 localhost kernel: [ 66.990023] [<ffffffff8161bbdb>] ? __netif_receive_skb_core+0x13b/0xdb0
Dec 19 15:39:46 localhost kernel: [ 66.990025] [<ffffffff8161c868>] __netif_receive_skb+0x18/0x60
Dec 19 15:39:46 localhost kernel: [ 66.990026] [<ffffffff8161c8e3>] netif_receive_skb+0x33/0x200
Dec 19 15:39:46 localhost kernel: [ 66.990031] [<ffffffffa0099903>] vmxnet3_rq_rx_complete+0x663/0x970 [vmxnet3]
Dec 19 15:39:46 localhost kernel: [ 66.990033] [<ffffffffa009a1aa>] vmxnet3_poll_rx_only+0x3a/0xb0 [vmxnet3]
Dec 19 15:39:46 localhost kernel: [ 66.990035] [<ffffffff810ce902>] ? trace_hardirqs_on_caller+0xb2/0x1d0
Dec 19 15:39:46 localhost kernel: [ 66.990036] [<ffffffff8161cf82>] net_rx_action+0x162/0x370
Dec 19 15:39:46 localhost kernel: [ 66.990037] [<ffffffff8107ad64>] __do_softirq+0x104/0x430
Dec 19 15:39:46 localhost kernel: [ 66.990038] [<ffffffff8107b47d>] irq_exit+0xcd/0xe0
Dec 19 15:39:46 localhost kernel: [ 66.990040] [<ffffffff8176a696>] do_IRQ+0x56/0xc0
Dec 19 15:39:46 localhost kernel: [ 66.990042] [<ffffffff8175f1b2>] common_interrupt+0x72/0x72
Dec 19 15:39:46 localhost kernel: [ 66.990044] <EOI> [<ffffffff810cbd8f>] ? lock_release_holdtime.part.29+0xf/0x190
Dec 19 15:39:46 localhost kernel: [ 66.990045] [<ffffffff810d11aa>] ? lock_acquire+0xba/0x1d0
Dec 19 15:39:46 localhost kernel: [ 66.990047] [<ffffffff81762f01>] ? __do_page_fault+0x101/0x5e0
Dec 19 15:39:46 localhost kernel: [ 66.990048] [<ffffffff810ca32a>] down_read_trylock+0x5a/0x60
Dec 19 15:39:46 localhost kernel: [ 66.990050] [<ffffffff81762f01>] ? __do_page_fault+0x101/0x5e0
Dec 19 15:39:46 localhost kernel: [ 66.990051] [<ffffffff81762f01>] __do_page_fault+0x101/0x5e0
Dec 19 15:39:46 localhost kernel: [ 66.990052] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80
Dec 19 15:39:46 localhost kernel: [ 66.990053] [<ffffffff81021a59>] ? sched_clock+0x9/0x10
Dec 19 15:39:46 localhost kernel: [ 66.990054] [<ffffffff810b6435>] ? sched_clock_cpu+0xb5/0x100
Dec 19 15:39:46 localhost kernel: [ 66.990056] [<ffffffff810cb1dd>] ? trace_hardirqs_off+0xd/0x10
Dec 19 15:39:46 localhost kernel: [ 66.990057] [<ffffffff810b656f>] ? local_clock+0x5f/0x70
Dec 19 15:39:46 localhost kernel: [ 66.990059] [<ffffffff810cbd8f>] ? lock_release_holdtime.part.29+0xf/0x190
Dec 19 15:39:46 localhost kernel: [ 66.990060] [<ffffffff8175f258>] ? retint_swapgs+0x13/0x1b
Dec 19 15:39:46 localhost kernel: [ 66.990062] [<ffffffff8138eb9a>] ? trace_hardirqs_off_thunk+0x3a/0x3c
Dec 19 15:39:46 localhost kernel: [ 66.990064] [<ffffffff817633ee>] do_page_fault+0xe/0x10
Dec 19 15:39:46 localhost kernel: [ 66.990065] [<ffffffff8175f578>] page_fault+0x28/0x30
# uname -r
3.13.0-0.rc4.git1.1.fc21.x86_64
Dec 19 15:39:46 localhost kernel: [ 66.989916]
Dec 19 15:39:46 localhost kernel: [ 66.989917] =================================
Dec 19 15:39:46 localhost kernel: [ 66.989917] [ INFO: inconsistent lock state ]
Dec 19 15:39:46 localhost kernel: [ 66.989920] 3.13.0-0.rc4.git1.1.fc21.x86_64 #1 Tainted: G W
Dec 19 15:39:46 localhost kernel: [ 66.989920] ---------------------------------
Dec 19 15:39:46 localhost kernel: [ 66.989921] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage.
Dec 19 15:39:46 localhost kernel: [ 66.989922] httpd/1180 [HC0[0]:SC1[1]:HE1:SE0] takes:
Dec 19 15:39:46 localhost kernel: [ 66.989931] (&(&sk->sk_dst_lock)->rlock){+.?...}, at: [<ffffffff81698873>] __udp4_lib_rcv+0xb73/0xbc0
Dec 19 15:39:46 localhost kernel: [ 66.989931] {SOFTIRQ-ON-W} state was registered at:
Dec 19 15:39:46 localhost kernel: [ 66.989937] [<ffffffff810cf36c>] __lock_acquire+0x5dc/0x1c10
Dec 19 15:39:46 localhost kernel: [ 66.989938] [<ffffffff810d1192>] lock_acquire+0xa2/0x1d0
Dec 19 15:39:46 localhost kernel: [ 66.989941] [<ffffffff8175e18e>] _raw_spin_lock+0x3e/0x80
Dec 19 15:39:46 localhost kernel: [ 66.989943] [<ffffffff816a364d>] inet_bind+0x1dd/0x260
Dec 19 15:39:46 localhost kernel: [ 66.989945] [<ffffffff815fe9d0>] SYSC_bind+0xe0/0x120
Dec 19 15:39:46 localhost kernel: [ 66.989946] [<ffffffff816001be>] SyS_bind+0xe/0x10
Dec 19 15:39:46 localhost kernel: [ 66.989948] [<ffffffff81768429>] system_call_fastpath+0x16/0x1b
Dec 19 15:39:46 localhost kernel: [ 66.989949] irq event stamp: 22820
Dec 19 15:39:46 localhost kernel: [ 66.989952] hardirqs last enabled at (22820): [<ffffffff8107b201>] local_bh_enable+0x71/0xd0
Dec 19 15:39:46 localhost kernel: [ 66.989953] hardirqs last disabled at (22819): [<ffffffff8107b1c5>] local_bh_enable+0x35/0xd0
Dec 19 15:39:46 localhost kernel: [ 66.989954] softirqs last enabled at (22740): [<ffffffff8107adf8>] __do_softirq+0x198/0x430
Dec 19 15:39:46 localhost kernel: [ 66.989955] softirqs last disabled at (22787): [<ffffffff8107b47d>] irq_exit+0xcd/0xe0
Dec 19 15:39:46 localhost kernel: [ 66.989955]
Dec 19 15:39:46 localhost kernel: [ 66.989955] other info that might help us debug this:
Dec 19 15:39:46 localhost kernel: [ 66.989956] Possible unsafe locking scenario:
Dec 19 15:39:46 localhost kernel: [ 66.989956]
Dec 19 15:39:46 localhost kernel: [ 66.989956] CPU0
Dec 19 15:39:46 localhost kernel: [ 66.989956] ----
Dec 19 15:39:46 localhost kernel: [ 66.989957] lock(&(&sk->sk_dst_lock)->rlock);
Dec 19 15:39:46 localhost kernel: [ 66.989957] <Interrupt>
Dec 19 15:39:46 localhost kernel: [ 66.989958] lock(&(&sk->sk_dst_lock)->rlock);
Dec 19 15:39:46 localhost kernel: [ 66.989958]
Dec 19 15:39:46 localhost kernel: [ 66.989958] *** DEADLOCK ***
Dec 19 15:39:46 localhost kernel: [ 66.989958]
Dec 19 15:39:46 localhost kernel: [ 66.989959] 3 locks held by httpd/1180:
Dec 19 15:39:46 localhost kernel: [ 66.989962] #0: (&mm->mmap_sem){++++++}, at: [<ffffffff81762f01>] __do_page_fault+0x101/0x5e0
Dec 19 15:39:46 localhost kernel: [ 66.989965] #1: (rcu_read_lock){.+.+..}, at: [<ffffffff8161bbdb>] __netif_receive_skb_core+0x13b/0xdb0
Dec 19 15:39:46 localhost kernel: [ 66.989969] #2: (rcu_read_lock){.+.+..}, at: [<ffffffff8165fdb3>] ip_local_deliver_finish+0x43/0x460
Dec 19 15:39:46 localhost kernel: [ 66.989969]
Dec 19 15:39:46 localhost kernel: [ 66.989969] stack backtrace:
Dec 19 15:39:46 localhost kernel: [ 66.989971] CPU: 0 PID: 1180 Comm: httpd Tainted: G W 3.13.0-0.rc4.git1.1.fc21.x86_64 #1
Dec 19 15:39:46 localhost kernel: [ 66.989972] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2011
Dec 19 15:39:46 localhost kernel: [ 66.989974] ffffffff825d4b50 ffff880237c03a10 ffffffff8175578d ffff880096e84d70
Dec 19 15:39:46 localhost kernel: [ 66.989975] ffff880237c03a60 ffffffff817514a6 0000000000000001 ffff880000000001
Dec 19 15:39:46 localhost kernel: [ 66.989976] ffff880200000000 0000000000000006 ffff880096e84d70 ffffffff810cdc80
Dec 19 15:39:46 localhost kernel: [ 66.989976] Call Trace:
Dec 19 15:39:46 localhost kernel: [ 66.989979] <IRQ> [<ffffffff8175578d>] dump_stack+0x4d/0x66
Dec 19 15:39:46 localhost kernel: [ 66.989982] [<ffffffff817514a6>] print_usage_bug+0x1f4/0x205
Dec 19 15:39:46 localhost kernel: [ 66.989984] [<ffffffff810cdc80>] ? check_usage_backwards+0x140/0x140
Dec 19 15:39:46 localhost kernel: [ 66.989985] [<ffffffff810ce683>] mark_lock+0x223/0x2b0
Dec 19 15:39:46 localhost kernel: [ 66.989987] [<ffffffff810cf319>] __lock_acquire+0x589/0x1c10
Dec 19 15:39:46 localhost kernel: [ 66.989988] [<ffffffff8107b201>] ? local_bh_enable+0x71/0xd0
Dec 19 15:39:46 localhost kernel: [ 66.989990] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80
Dec 19 15:39:46 localhost kernel: [ 66.989991] [<ffffffff81021a59>] ? sched_clock+0x9/0x10
Dec 19 15:39:46 localhost kernel: [ 66.989992] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80
Dec 19 15:39:46 localhost kernel: [ 66.990002] [<ffffffff81021a59>] ? sched_clock+0x9/0x10
Dec 19 15:39:46 localhost kernel: [ 66.990005] [<ffffffff810b6435>] ? sched_clock_cpu+0xb5/0x100
Dec 19 15:39:46 localhost kernel: [ 66.990007] [<ffffffff810d1192>] lock_acquire+0xa2/0x1d0
Dec 19 15:39:46 localhost kernel: [ 66.990008] [<ffffffff81698873>] ? __udp4_lib_rcv+0xb73/0xbc0
Dec 19 15:39:46 localhost kernel: [ 66.990009] [<ffffffff8175e18e>] _raw_spin_lock+0x3e/0x80
Dec 19 15:39:46 localhost kernel: [ 66.990010] [<ffffffff81698873>] ? __udp4_lib_rcv+0xb73/0xbc0
Dec 19 15:39:46 localhost kernel: [ 66.990012] [<ffffffff81698873>] __udp4_lib_rcv+0xb73/0xbc0
Dec 19 15:39:46 localhost kernel: [ 66.990013] [<ffffffff8169902a>] udp_rcv+0x1a/0x20
Dec 19 15:39:46 localhost kernel: [ 66.990015] [<ffffffff8165feaf>] ip_local_deliver_finish+0x13f/0x460
Dec 19 15:39:46 localhost kernel: [ 66.990016] [<ffffffff8165fdb3>] ? ip_local_deliver_finish+0x43/0x460
Dec 19 15:39:46 localhost kernel: [ 66.990017] [<ffffffff81660bc8>] ip_local_deliver+0x48/0x80
Dec 19 15:39:46 localhost kernel: [ 66.990019] [<ffffffff81660330>] ip_rcv_finish+0x160/0x760
Dec 19 15:39:46 localhost kernel: [ 66.990020] [<ffffffff81660e94>] ip_rcv+0x294/0x3d0
Dec 19 15:39:46 localhost kernel: [ 66.990022] [<ffffffff8161c492>] __netif_receive_skb_core+0x9f2/0xdb0
Dec 19 15:39:46 localhost kernel: [ 66.990023] [<ffffffff8161bbdb>] ? __netif_receive_skb_core+0x13b/0xdb0
Dec 19 15:39:46 localhost kernel: [ 66.990025] [<ffffffff8161c868>] __netif_receive_skb+0x18/0x60
Dec 19 15:39:46 localhost kernel: [ 66.990026] [<ffffffff8161c8e3>] netif_receive_skb+0x33/0x200
Dec 19 15:39:46 localhost kernel: [ 66.990031] [<ffffffffa0099903>] vmxnet3_rq_rx_complete+0x663/0x970 [vmxnet3]
Dec 19 15:39:46 localhost kernel: [ 66.990033] [<ffffffffa009a1aa>] vmxnet3_poll_rx_only+0x3a/0xb0 [vmxnet3]
Dec 19 15:39:46 localhost kernel: [ 66.990035] [<ffffffff810ce902>] ? trace_hardirqs_on_caller+0xb2/0x1d0
Dec 19 15:39:46 localhost kernel: [ 66.990036] [<ffffffff8161cf82>] net_rx_action+0x162/0x370
Dec 19 15:39:46 localhost kernel: [ 66.990037] [<ffffffff8107ad64>] __do_softirq+0x104/0x430
Dec 19 15:39:46 localhost kernel: [ 66.990038] [<ffffffff8107b47d>] irq_exit+0xcd/0xe0
Dec 19 15:39:46 localhost kernel: [ 66.990040] [<ffffffff8176a696>] do_IRQ+0x56/0xc0
Dec 19 15:39:46 localhost kernel: [ 66.990042] [<ffffffff8175f1b2>] common_interrupt+0x72/0x72
Dec 19 15:39:46 localhost kernel: [ 66.990044] <EOI> [<ffffffff810cbd8f>] ? lock_release_holdtime.part.29+0xf/0x190
Dec 19 15:39:46 localhost kernel: [ 66.990045] [<ffffffff810d11aa>] ? lock_acquire+0xba/0x1d0
Dec 19 15:39:46 localhost kernel: [ 66.990047] [<ffffffff81762f01>] ? __do_page_fault+0x101/0x5e0
Dec 19 15:39:46 localhost kernel: [ 66.990048] [<ffffffff810ca32a>] down_read_trylock+0x5a/0x60
Dec 19 15:39:46 localhost kernel: [ 66.990050] [<ffffffff81762f01>] ? __do_page_fault+0x101/0x5e0
Dec 19 15:39:46 localhost kernel: [ 66.990051] [<ffffffff81762f01>] __do_page_fault+0x101/0x5e0
Dec 19 15:39:46 localhost kernel: [ 66.990052] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80
Dec 19 15:39:46 localhost kernel: [ 66.990053] [<ffffffff81021a59>] ? sched_clock+0x9/0x10
Dec 19 15:39:46 localhost kernel: [ 66.990054] [<ffffffff810b6435>] ? sched_clock_cpu+0xb5/0x100
Dec 19 15:39:46 localhost kernel: [ 66.990056] [<ffffffff810cb1dd>] ? trace_hardirqs_off+0xd/0x10
Dec 19 15:39:46 localhost kernel: [ 66.990057] [<ffffffff810b656f>] ? local_clock+0x5f/0x70
Dec 19 15:39:46 localhost kernel: [ 66.990059] [<ffffffff810cbd8f>] ? lock_release_holdtime.part.29+0xf/0x190
Dec 19 15:39:46 localhost kernel: [ 66.990060] [<ffffffff8175f258>] ? retint_swapgs+0x13/0x1b
Dec 19 15:39:46 localhost kernel: [ 66.990062] [<ffffffff8138eb9a>] ? trace_hardirqs_off_thunk+0x3a/0x3c
Dec 19 15:39:46 localhost kernel: [ 66.990064] [<ffffffff817633ee>] do_page_fault+0xe/0x10
Dec 19 15:39:46 localhost kernel: [ 66.990065] [<ffffffff8175f578>] page_fault+0x28/0x30
You've pasted the backtrace from the original bug report. I'm not sure what you were hoping to convey with that as we already knew it has the problem. Could you please test 3.13.0-0.rc4.git4.1.fc21? You can find it in koji here: http://kojipkgs.fedoraproject.org//packages/kernel/3.13.0/0.rc4.git4.1.fc21/x86_64/kernel-3.13.0-0.rc4.git4.1.fc21.x86_64.rpm I beg your pardon. Multitasking is not one of my strengths. # uname -r 3.13.0-0.rc4.git4.1.fc21.x86_64 I did not see that message in /var/log/messages for this boot. Thanks. Ok. Thank you for testing and confirming. That should be in tomorrow's rawhide compose. When installing the koji version of git4.4 I get this message: Installing : kernel-tools-libs-3.13.0-0.rc4.git4.1.fc21.x86_64 1/13 Installing : kernel-tools-3.13.0-0.rc4.git4.1.fc21.x86_64 2/13 Installing : kernel-3.13.0-0.rc4.git4.1.fc21.x86_64 3/13 Installing : kernel-modules-extra-3.13.0-0.rc4.git4.1.fc21.x86_64 4/13 Installing : kernel-tools-libs-devel-3.13.0-0.rc4.git4.1.fc21.x86_64 5/13 Installing : perf-3.13.0-0.rc4.git4.1.fc21.x86_64 6/13 Updating : kernel-headers-3.13.0-0.rc4.git4.1.fc21.x86_64 7/13 Installing : kernel-devel-3.13.0-0.rc4.git4.1.fc21.x86_64 8/13 Installing : python-perf-3.13.0-0.rc4.git4.1.fc21.x86_64 9/13 Cleanup : kernel-modules-extra-3.13.0-0.rc2.git6.1.fc21.x86_64 10/13 Cleanup : kernel-3.13.0-0.rc2.git6.1.fc21.x86_64 11/13 Cleanup : kernel-headers-3.13.0-0.rc4.git1.1.fc21.x86_64 12/13 Cleanup : kernel-devel-3.13.0-0.rc2.git0.1.fc21.x86_64 13/13 dracut module 'fcoe-uefi' depends on 'fcoe', which can't be installed dracut module 'fcoe' cannot be found or installed. dracut module 'fcoe' cannot be found or installed. dracut module 'fcoe-uefi' depends on 'fcoe', which can't be installed dracut module 'fcoe' cannot be found or installed. dracut module 'fcoe' cannot be found or installed. Verifying : python-perf-3.13.0-0.rc4.git4.1.fc21.x86_64 1/13 Verifying : kernel-modules-extra-3.13.0-0.rc4.git4.1.fc21.x86_64 2/13 Verifying : kernel-devel-3.13.0-0.rc4.git4.1.fc21.x86_64 3/13 Verifying : kernel-headers-3.13.0-0.rc4.git4.1.fc21.x86_64 4/13 Verifying : kernel-tools-3.13.0-0.rc4.git4.1.fc21.x86_64 5/13 Verifying : kernel-tools-libs-devel-3.13.0-0.rc4.git4.1.fc21.x86_64 6/13 Verifying : kernel-3.13.0-0.rc4.git4.1.fc21.x86_64 7/13 Verifying : perf-3.13.0-0.rc4.git4.1.fc21.x86_64 8/13 Verifying : kernel-tools-libs-3.13.0-0.rc4.git4.1.fc21.x86_64 9/13 Verifying : kernel-3.13.0-0.rc2.git6.1.fc21.x86_64 10/13 Verifying : kernel-headers-3.13.0-0.rc4.git1.1.fc21.x86_64 11/13 Verifying : kernel-devel-3.13.0-0.rc2.git0.1.fc21.x86_64 12/13 Verifying : kernel-modules-extra-3.13.0-0.rc2.git6.1.fc21.x86_64 What does *that* mean? I have no idea. The fcoe module is built and shipped in that kernel. Probably should file a new bug against dracut *** Bug 1045481 has been marked as a duplicate of this bug. *** i doubt dracut has anything to do with this
* i reboot my rawhide VM
* i clear /var/log/messages and call "dmesg -c"
* i call "yum upgrade"
* the stacktrace appears
[root@rawhide ~]# yum upgrade
rawhide/x86_64/metalink | 23 kB 00:00:00
rawhide | 4.2 kB 00:00:00
rhsoft-generic | 2.9 kB 00:00:00
(1/3): rhsoft-generic/x86_64/primary_db | 4.6 kB 00:00:00
(2/3): rawhide/x86_64/group_gz | 393 kB 00:00:00
(3/3): rawhide/x86_64/primary_db | 19 MB 00:00:09
No packages marked for update
[root@rawhide ~]# dmesg -c
[ 42.395195] =================================
[ 42.395224] [ INFO: inconsistent lock state ]
[ 42.395254] 3.13.0-0.rc4.git1.1.fc21.x86_64 #1 Tainted: G W
[ 42.395292] ---------------------------------
[ 42.395320] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage.
[ 42.395357] swapper/0/0 [HC0[0]:SC1[1]:HE1:SE0] takes:
[ 42.395389] (&(&sk->sk_dst_lock)->rlock){+.?...}, at: [<ffffffff81698873>] __udp4_lib_rcv+0xb73/0xbc0
[ 42.395616] {SOFTIRQ-ON-W} state was registered at:
[ 42.395645] [<ffffffff810cf36c>] __lock_acquire+0x5dc/0x1c10
[ 42.395698] [<ffffffff810d1192>] lock_acquire+0xa2/0x1d0
[ 42.395745] [<ffffffff8175e18e>] _raw_spin_lock+0x3e/0x80
[ 42.395791] [<ffffffff81606f58>] sock_setsockopt+0x1f8/0xaf0
[ 42.395840] [<ffffffff816003c6>] SyS_setsockopt+0xb6/0xd0
[ 42.395896] [<ffffffff81768429>] system_call_fastpath+0x16/0x1b
[ 42.395948] irq event stamp: 570012
[ 42.395971] hardirqs last enabled at (570012): [<ffffffff8107b201>] local_bh_enable+0x71/0xd0
[ 42.396034] hardirqs last disabled at (570011): [<ffffffff8107b1c5>] local_bh_enable+0x35/0xd0
[ 42.396339] softirqs last enabled at (569990): [<ffffffff81079b12>] _local_bh_enable+0x22/0x50
[ 42.396467] softirqs last disabled at (569991): [<ffffffff8107b47d>] irq_exit+0xcd/0xe0
[ 42.396644]
other info that might help us debug this:
[ 42.396737] Possible unsafe locking scenario:
[ 42.396872] CPU0
[ 42.396935] ----
[ 42.396999] lock(&(&sk->sk_dst_lock)->rlock);
[ 42.397105] <Interrupt>
[ 42.397168] lock(&(&sk->sk_dst_lock)->rlock);
[ 42.397306]
*** DEADLOCK ***
[ 42.397587] 2 locks held by swapper/0/0:
[ 42.397661] #0: (rcu_read_lock){.+.+..}, at: [<ffffffff8161bbdb>] __netif_receive_skb_core+0x13b/0xdb0
[ 42.397899] #1: (rcu_read_lock){.+.+..}, at: [<ffffffff8165fdb3>] ip_local_deliver_finish+0x43/0x460
[ 42.398132]
stack backtrace:
[ 42.398241] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G W 3.13.0-0.rc4.git1.1.fc21.x86_64 #1
[ 42.398382] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/31/2013
[ 42.398701] ffffffff825bb470 ffff88002fc039f0 ffffffff8175578d ffffffff81c134c0
[ 42.398827] ffff88002fc03a40 ffffffff817514a6 0000000000000001 ffffffff00000001
[ 42.398952] ffff880000000000 0000000000000006 ffffffff81c134c0 ffffffff810cdc80
[ 42.399076] Call Trace:
[ 42.399127] <IRQ> [<ffffffff8175578d>] dump_stack+0x4d/0x66
[ 42.399223] [<ffffffff817514a6>] print_usage_bug+0x1f4/0x205
[ 42.399290] [<ffffffff810cdc80>] ? check_usage_backwards+0x140/0x140
[ 42.399360] [<ffffffff810ce683>] mark_lock+0x223/0x2b0
[ 42.399583] [<ffffffff810cf319>] __lock_acquire+0x589/0x1c10
[ 42.399672] [<ffffffff8107b201>] ? local_bh_enable+0x71/0xd0
[ 42.399739] [<ffffffff816c6ee7>] ? ipt_do_table+0x317/0x6b0
[ 42.399805] [<ffffffff810b6435>] ? sched_clock_cpu+0xb5/0x100
[ 42.399872] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80
[ 42.399938] [<ffffffff81021a59>] ? sched_clock+0x9/0x10
[ 42.400001] [<ffffffff810b6435>] ? sched_clock_cpu+0xb5/0x100
[ 42.400068] [<ffffffff810d1192>] lock_acquire+0xa2/0x1d0
[ 42.400132] [<ffffffff81698873>] ? __udp4_lib_rcv+0xb73/0xbc0
[ 42.400198] [<ffffffff8175e18e>] _raw_spin_lock+0x3e/0x80
[ 42.400263] [<ffffffff81698873>] ? __udp4_lib_rcv+0xb73/0xbc0
[ 42.400328] [<ffffffff81698873>] __udp4_lib_rcv+0xb73/0xbc0
[ 42.400393] [<ffffffff8169902a>] udp_rcv+0x1a/0x20
[ 42.400623] [<ffffffff8165feaf>] ip_local_deliver_finish+0x13f/0x460
[ 42.400702] [<ffffffff8165fdb3>] ? ip_local_deliver_finish+0x43/0x460
[ 42.400771] [<ffffffff81660bc8>] ip_local_deliver+0x48/0x80
[ 42.400836] [<ffffffff81660330>] ip_rcv_finish+0x160/0x760
[ 42.400902] [<ffffffff81660e94>] ip_rcv+0x294/0x3d0
[ 42.400965] [<ffffffff8161c492>] __netif_receive_skb_core+0x9f2/0xdb0
[ 42.401034] [<ffffffff8161bbdb>] ? __netif_receive_skb_core+0x13b/0xdb0
[ 42.401104] [<ffffffff8161c868>] __netif_receive_skb+0x18/0x60
[ 42.401170] [<ffffffff8161c8e3>] netif_receive_skb+0x33/0x200
[ 42.401236] [<ffffffff8161de00>] napi_gro_receive+0x80/0xb0
[ 42.401307] [<ffffffffa000f922>] vmxnet3_rq_rx_complete+0x682/0x970 [vmxnet3]
[ 42.401379] [<ffffffffa00101aa>] vmxnet3_poll_rx_only+0x3a/0xb0 [vmxnet3]
[ 42.401625] [<ffffffff810ce902>] ? trace_hardirqs_on_caller+0xb2/0x1d0
[ 42.401696] [<ffffffff8161cf82>] net_rx_action+0x162/0x370
[ 42.401760] [<ffffffff8107ad64>] __do_softirq+0x104/0x430
[ 42.401825] [<ffffffff8107b47d>] irq_exit+0xcd/0xe0
[ 42.401887] [<ffffffff8176a696>] do_IRQ+0x56/0xc0
[ 42.401948] [<ffffffff8175f1b2>] common_interrupt+0x72/0x72
[ 42.402012] <EOI> [<ffffffff810578d6>] ? native_safe_halt+0x6/0x10
[ 42.402109] [<ffffffff810cea2d>] ? trace_hardirqs_on+0xd/0x10
[ 42.402175] [<ffffffff81022934>] default_idle+0x24/0x250
[ 42.402240] [<ffffffff8102342e>] arch_cpu_idle+0x2e/0x40
[ 42.402303] [<ffffffff810e2d65>] cpu_startup_entry+0xc5/0x420
[ 42.402372] [<ffffffff81749f0d>] rest_init+0x13d/0x150
[ 42.402609] [<ffffffff81749dd5>] ? rest_init+0x5/0x150
[ 42.402674] [<ffffffff81f60f8c>] start_kernel+0x469/0x474
[ 42.402740] [<ffffffff81f6092c>] ? repair_env_string+0x5c/0x5c
[ 42.402806] [<ffffffff81f60120>] ? early_idt_handlers+0x120/0x120
[ 42.402874] [<ffffffff81f605de>] x86_64_start_reservations+0x2a/0x2c
[ 42.402943] [<ffffffff81f6071e>] x86_64_start_kernel+0x13e/0x14d
inux /vmlinuz-3.13.0-0.rc4.git1.1.fc21.x86_64 root=UUID=7d0126f3-4a85-43ae-8bb3-fd6675f65d67 ro pnpacpi=off pci=noacpi acpi=noirq audit=0 divider=20 clocksource=hpet audit=0 rd.plymouth=0 plymouth.enable=0 rd.md=0 rd.lvm=0 rd.dm=0 rd.luks=0 selinux=0 net.ifnames=0 biosdevname=0 nodmraid raid=noautodetect nomodeset elevator=deadline printk.time=0 thermal.off=1 nmi_watchdog=0 pcie_aspm=off consoleblank=0 vconsole.font=latarcyrheb-sun16 vconsole.keymap=de-latin1-nodeadkeys locale.LANG=de_DE.UTF-8 https://bugzilla.redhat.com/show_bug.cgi?id=1045462 I created the above bugzilla for the error on installing the new kernel. I agree that the error installing is not related to the lockup issue reported here. (In reply to Harald Reindl from comment #12) > i doubt dracut has anything to do with this > > * i reboot my rawhide VM > * i clear /var/log/messages and call "dmesg -c" > * i call "yum upgrade" > * the stacktrace appears The stacktrace doesn't have anything to do with dracut. I was referring to kevin's issue. > [root@rawhide ~]# yum upgrade > rawhide/x86_64/metalink > | 23 kB 00:00:00 > rawhide > | 4.2 kB 00:00:00 > rhsoft-generic > | 2.9 kB 00:00:00 > (1/3): rhsoft-generic/x86_64/primary_db > | 4.6 kB 00:00:00 > (2/3): rawhide/x86_64/group_gz > | 393 kB 00:00:00 > (3/3): rawhide/x86_64/primary_db > | 19 MB 00:00:09 > No packages marked for update > [root@rawhide ~]# dmesg -c > > [ 42.395195] ================================= > [ 42.395224] [ INFO: inconsistent lock state ] > [ 42.395254] 3.13.0-0.rc4.git1.1.fc21.x86_64 #1 Tainted: G W This is already the kernel known to have the problem. See comment #6, comment #7, and comment #8. If the kernel isn't available to you it's likely because the mirrors haven't updated yet. |
Dec 18 15:14:39 localhost dbus[556]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' Dec 18 15:14:39 localhost kernel: [ 69.064233] Dec 18 15:14:39 localhost kernel: [ 69.064968] ================================= Dec 18 15:14:39 localhost kernel: [ 69.065622] [ INFO: inconsistent lock state ] Dec 18 15:14:39 localhost kernel: [ 69.066270] 3.13.0-0.rc4.git1.1.fc21.x86_64 #1 Tainted: G W Dec 18 15:14:39 localhost kernel: [ 69.066910] --------------------------------- Dec 18 15:14:39 localhost kernel: [ 69.067549] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. Dec 18 15:14:39 localhost kernel: [ 69.068199] hostname-thread/1340 [HC0[0]:SC1[1]:HE1:SE0] takes: Dec 18 15:14:39 localhost kernel: [ 69.068847] (&(&sk->sk_dst_lock)->rlock){+.?...}, at: [<ffffffff81698873>] __udp4_lib_rcv+0xb73/0xbc0 Dec 18 15:14:39 localhost kernel: [ 69.069535] {SOFTIRQ-ON-W} state was registered at: Dec 18 15:14:39 localhost kernel: [ 69.070305] [<ffffffff810cf36c>] __lock_acquire+0x5dc/0x1c10 Dec 18 15:14:39 localhost kernel: [ 69.071066] [<ffffffff810d1192>] lock_acquire+0xa2/0x1d0 Dec 18 15:14:39 localhost kernel: [ 69.071727] [<ffffffff8175e18e>] _raw_spin_lock+0x3e/0x80 Dec 18 15:14:39 localhost kernel: [ 69.072398] [<ffffffff816a364d>] inet_bind+0x1dd/0x260 Dec 18 15:14:39 localhost kernel: [ 69.073060] [<ffffffff815fe9d0>] SYSC_bind+0xe0/0x120 Dec 18 15:14:39 localhost kernel: [ 69.073715] [<ffffffff816001be>] SyS_bind+0xe/0x10 Dec 18 15:14:39 localhost kernel: [ 69.074351] [<ffffffff81768429>] system_call_fastpath+0x16/0x1b Dec 18 15:14:39 localhost kernel: [ 69.074993] irq event stamp: 5358 Dec 18 15:14:39 localhost kernel: [ 69.075621] hardirqs last enabled at (5358): [<ffffffff8107b201>] local_bh_enable+0x71/0xd0 Dec 18 15:14:39 localhost kernel: [ 69.076293] hardirqs last disabled at (5357): [<ffffffff8107b1c5>] local_bh_enable+0x35/0xd0 Dec 18 15:14:39 localhost kernel: [ 69.076933] softirqs last enabled at (4958): [<ffffffff81604fb7>] sk_common_release+0x67/0xf0 Dec 18 15:14:39 localhost kernel: [ 69.077579] softirqs last disabled at (5323): [<ffffffff8107b47d>] irq_exit+0xcd/0xe0 Dec 18 15:14:39 localhost kernel: [ 69.078270] Dec 18 15:14:39 localhost kernel: [ 69.078270] other info that might help us debug this: Dec 18 15:14:39 localhost kernel: [ 69.079575] Possible unsafe locking scenario: Dec 18 15:14:39 localhost kernel: [ 69.079575] Dec 18 15:14:39 localhost kernel: [ 69.080850] CPU0 Dec 18 15:14:39 localhost kernel: [ 69.081477] ---- Dec 18 15:14:39 localhost kernel: [ 69.082086] lock(&(&sk->sk_dst_lock)->rlock); Dec 18 15:14:39 localhost kernel: [ 69.082704] <Interrupt> Dec 18 15:14:39 localhost kernel: [ 69.083313] lock(&(&sk->sk_dst_lock)->rlock); Dec 18 15:14:39 localhost kernel: [ 69.083914] Dec 18 15:14:39 localhost kernel: [ 69.083914] *** DEADLOCK *** Dec 18 15:14:39 localhost kernel: [ 69.083914] Dec 18 15:14:39 localhost kernel: [ 69.085645] 2 locks held by hostname-thread/1340: Dec 18 15:14:39 localhost kernel: [ 69.086235] #0: (rcu_read_lock){.+.+..}, at: [<ffffffff8161bbdb>] __netif_receive_skb_core+0x13b/0xdb0 Dec 18 15:14:39 localhost kernel: [ 69.086850] #1: (rcu_read_lock){.+.+..}, at: [<ffffffff8165fdb3>] ip_local_deliver_finish+0x43/0x460 Dec 18 15:14:39 localhost kernel: [ 69.087450] Dec 18 15:14:39 localhost kernel: [ 69.087450] stack backtrace: Dec 18 15:14:39 localhost kernel: [ 69.088593] CPU: 0 PID: 1340 Comm: hostname-thread Tainted: G W 3.13.0-0.rc4.git1.1.fc21.x86_64 #1 Dec 18 15:14:39 localhost kernel: [ 69.089184] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2011 Dec 18 15:14:39 localhost kernel: [ 69.089798] ffffffff825d4960 ffff880237c03a10 ffffffff8175578d ffff880098feb3a0 Dec 18 15:14:39 localhost kernel: [ 69.090404] ffff880237c03a60 ffffffff817514a6 0000000000000001 ffff880000000001 Dec 18 15:14:39 localhost kernel: [ 69.091016] ffff880200000000 0000000000000006 ffff880098feb3a0 ffffffff810cdc80 Dec 18 15:14:39 localhost kernel: [ 69.091630] Call Trace: Dec 18 15:14:39 localhost kernel: [ 69.092212] <IRQ> [<ffffffff8175578d>] dump_stack+0x4d/0x66 Dec 18 15:14:39 localhost kernel: [ 69.092825] [<ffffffff817514a6>] print_usage_bug+0x1f4/0x205 Dec 18 15:14:39 localhost kernel: [ 69.093433] [<ffffffff810cdc80>] ? check_usage_backwards+0x140/0x140 Dec 18 15:14:39 localhost kernel: [ 69.094024] [<ffffffff810ce683>] mark_lock+0x223/0x2b0 Dec 18 15:14:39 localhost kernel: [ 69.094605] [<ffffffff810cf319>] __lock_acquire+0x589/0x1c10 Dec 18 15:14:39 localhost kernel: [ 69.095190] [<ffffffff8107b201>] ? local_bh_enable+0x71/0xd0 Dec 18 15:14:39 localhost kernel: [ 69.095776] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80 Dec 18 15:14:39 localhost kernel: [ 69.096376] [<ffffffff81021a59>] ? sched_clock+0x9/0x10 Dec 18 15:14:39 localhost kernel: [ 69.096959] [<ffffffff810219e3>] ? native_sched_clock+0x13/0x80 Dec 18 15:14:39 localhost kernel: [ 69.097539] [<ffffffff81021a59>] ? sched_clock+0x9/0x10 Dec 18 15:14:39 localhost kernel: [ 69.098108] [<ffffffff810b6435>] ? sched_clock_cpu+0xb5/0x100 Dec 18 15:14:39 localhost kernel: [ 69.098664] [<ffffffff810d1192>] lock_acquire+0xa2/0x1d0 Dec 18 15:14:39 localhost kernel: [ 69.099205] [<ffffffff81698873>] ? __udp4_lib_rcv+0xb73/0xbc0 Dec 18 15:14:39 localhost kernel: [ 69.099743] [<ffffffff8175e18e>] _raw_spin_lock+0x3e/0x80 Dec 18 15:14:39 localhost kernel: [ 69.100279] [<ffffffff81698873>] ? __udp4_lib_rcv+0xb73/0xbc0 Dec 18 15:14:39 localhost kernel: [ 69.100817] [<ffffffff81698873>] __udp4_lib_rcv+0xb73/0xbc0 Dec 18 15:14:39 localhost kernel: [ 69.101357] [<ffffffff8169902a>] udp_rcv+0x1a/0x20 Dec 18 15:14:39 localhost kernel: [ 69.101897] [<ffffffff8165feaf>] ip_local_deliver_finish+0x13f/0x460 Dec 18 15:14:39 localhost kernel: [ 69.102442] [<ffffffff8165fdb3>] ? ip_local_deliver_finish+0x43/0x460 Dec 18 15:14:39 localhost kernel: [ 69.102988] [<ffffffff81660bc8>] ip_local_deliver+0x48/0x80 Dec 18 15:14:39 localhost kernel: [ 69.103530] [<ffffffff81660330>] ip_rcv_finish+0x160/0x760 Dec 18 15:14:39 localhost kernel: [ 69.104059] [<ffffffff81660e94>] ip_rcv+0x294/0x3d0 Dec 18 15:14:39 localhost kernel: [ 69.104595] [<ffffffff8161c492>] __netif_receive_skb_core+0x9f2/0xdb0 Dec 18 15:14:39 localhost kernel: [ 69.105131] [<ffffffff8161bbdb>] ? __netif_receive_skb_core+0x13b/0xdb0 Dec 18 15:14:39 localhost kernel: [ 69.105825] [<ffffffff8161c868>] __netif_receive_skb+0x18/0x60 Dec 18 15:14:39 localhost kernel: [ 69.106478] [<ffffffff8161c8e3>] netif_receive_skb+0x33/0x200 Dec 18 15:14:39 localhost kernel: [ 69.107049] [<ffffffffa00ae903>] vmxnet3_rq_rx_complete+0x663/0x970 [vmxnet3] Dec 18 15:14:39 localhost kernel: [ 69.107592] [<ffffffffa00af1aa>] vmxnet3_poll_rx_only+0x3a/0xb0 [vmxnet3] Dec 18 15:14:39 localhost kernel: [ 69.108141] [<ffffffff810ce902>] ? trace_hardirqs_on_caller+0xb2/0x1d0 Dec 18 15:14:39 localhost kernel: [ 69.108682] [<ffffffff8161cf82>] net_rx_action+0x162/0x370 Dec 18 15:14:39 localhost kernel: [ 69.109229] [<ffffffff8107ad64>] __do_softirq+0x104/0x430 Dec 18 15:14:39 localhost kernel: [ 69.109775] [<ffffffff8107b47d>] irq_exit+0xcd/0xe0 Dec 18 15:14:39 localhost kernel: [ 69.110321] [<ffffffff8176a696>] do_IRQ+0x56/0xc0 Dec 18 15:14:39 localhost kernel: [ 69.110868] [<ffffffff8175f1b2>] common_interrupt+0x72/0x72 Dec 18 15:14:39 localhost kernel: [ 69.111411] <EOI> [<ffffffff8175f258>] ? retint_swapgs+0x13/0x1b Linux dyn40-73-141.tintri.com 3.13.0-0.rc4.git1.1.fc21.x86_64 #1 SMP Tue Dec 17 20:22:33 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux BOOT_IMAGE=/boot/vmlinuz-3.13.0-0.rc4.git1.1.fc21.x86_64 root=/dev/mapper/testvm-root ro rd.md=0 rd.dm=0 vconsole.keymap=us rd.lvm.lv=testvm/swap rd.luks=0 vconsole.font=latarcyrheb-sun16 rd.lvm.lv=testvm/root fsck.mode=force systemd.log_level=debug systemd.log_target=kmsg log_buf_len=100M enforcing=0 elevator=noop LANG=en_US.UTF-8