Attachment 152847 Details for Bug 236817 – dmesg output for the irqbalance issue

dmesg output for the irqbalance issue

irqbalance_bt.txt (text/plain), 108.09 KB, created by Gurhan Ozen on 2007-04-17 19:43:08 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Gurhan Ozen

Created: 2007-04-17 19:43:08 UTC

Size: 108.09 KB

patch

obsolete

>======================================================
>[ INFO: hard-safe -> hard-unsafe lock order detected ]
>[ 2.6.20-19.el5rt #1
>------------------------------------------------------
>softirq-timer/0/5 [HC0[0]:SC0[0]:HE0:SE1] is trying to acquire:
> ((raw_spinlock_t *)(&lock->wait_lock)){--..}, at: [<ffffffff81068a09>]
>rt_spin_lock_slowlock+0x33/0x1f5
>
>and this task is already holding:
> (xtime_lock){+...}, at: [<ffffffff8109d3b8>] run_timer_softirq+0x53/0x7aa
>which would create a new lock dependency:
> (xtime_lock){+...} -> ((raw_spinlock_t *)(&lock->wait_lock)){--..}
>
>but this new dependency connects a hard-irq-safe lock:
> (xtime_lock){+...}
>... which became hard-irq-safe at:
>  [<ffffffff810af993>] mark_lock+0x79/0x42e
>  [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>  [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>  [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>  [<ffffffff810aca6e>] tick_periodic+0x18/0x70
>  [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>  [<ffffffff81073441>] main_timer_handler+0x11/0x13
>  [<ffffffff81073671>] timer_interrupt+0x12/0x27
>  [<ffffffff8101114b>] handle_IRQ_event+0x59/0xfa
>  [<ffffffff810d2944>] handle_level_irq+0xd0/0x121
>  [<ffffffff81072eea>] do_IRQ+0x12e/0x18c
>  [<ffffffff81062866>] ret_from_intr+0x0/0xf
>  [<ffffffff8199ad57>] console_init+0x0/0x39
>  [<ffffffff8197f676>] start_kernel+0x16f/0x2af
>  [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>  [<ffffffffffffffff>] 0xffffffffffffffff
>
>to a hard-irq-unsafe lock:
> ((raw_spinlock_t *)(&lock->wait_lock)){--..}
>... which became hard-irq-unsafe at:
>...  [<ffffffff810af993>] mark_lock+0x79/0x42e
>  [<ffffffff810afd9b>] mark_held_locks+0x53/0x7a
>  [<ffffffff810aff5c>] trace_hardirqs_on+0x100/0x13e
>  [<ffffffff8106a21f>] __spin_unlock_irqrestore+0x49/0x69
>  [<ffffffff810b7f75>] task_blocks_on_rt_mutex+0x1e3/0x230
>  [<ffffffff81068ab7>] rt_spin_lock_slowlock+0xe1/0x1f5
>  [<ffffffff8106954b>] rt_spin_lock+0x18/0x34
>  [<ffffffff81067b2c>] wait_for_completion+0x2b/0xd5
>  [<ffffffff8109296e>] set_cpus_allowed+0xa1/0xc8
>  [<ffffffff81092adf>] measure_one+0x14a/0x20f
>  [<ffffffff81093a0c>] build_sched_domains+0xe68/0x1338
>  [<ffffffff81093f08>] arch_init_sched_domains+0x2c/0x33
>  [<ffffffff8198fd14>] sched_init_smp+0x1e/0x93
>  [<ffffffff81070813>] init+0x117/0x42f
>  [<ffffffff81063168>] child_rip+0xa/0x12
>  [<ffffffffffffffff>] 0xffffffffffffffff
>
>other info that might help us debug this:
>
>1 lock held by softirq-timer/0/5:
> #0:  (xtime_lock){+...}, at: [<ffffffff8109d3b8>] run_timer_softirq+0x53/0x7aa
>
>the hard-irq-safe lock's dependencies:
>-> (xtime_lock){+...} ops: 0 {
>   initial-use  at:
>                        [<ffffffff810af993>] mark_lock+0x79/0x42e
>                        [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                        [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                        [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                        [<ffffffff81990d1a>] timekeeping_init+0x2a/0xf2
>                        [<ffffffff8197f647>] start_kernel+0x140/0x2af
>                        [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>                        [<ffffffffffffffff>] 0xffffffffffffffff
>   in-hardirq-W at:
>                        [<ffffffff810af993>] mark_lock+0x79/0x42e
>                        [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                        [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                        [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                        [<ffffffff810aca6e>] tick_periodic+0x18/0x70
>                        [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                        [<ffffffff81073441>] main_timer_handler+0x11/0x13
>                        [<ffffffff81073671>] timer_interrupt+0x12/0x27
>                        [<ffffffff8101114b>] handle_IRQ_event+0x59/0xfa
>                        [<ffffffff810d2944>] handle_level_irq+0xd0/0x121
>                        [<ffffffff81072eea>] do_IRQ+0x12e/0x18c
>                        [<ffffffff81062866>] ret_from_intr+0x0/0xf
>                        [<ffffffff8199ad57>] console_init+0x0/0x39
>                        [<ffffffff8197f676>] start_kernel+0x16f/0x2af
>                        [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>                        [<ffffffffffffffff>] 0xffffffffffffffff
> }
> ... key      at: [<ffffffff81501520>] xtime_lock+0x20/0x80
> -> (clocksource_lock){....} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>                          [<ffffffff810ab272>] clocksource_get_next+0x10/0x4f
>                          [<ffffffff81990d2a>] timekeeping_init+0x3a/0xf2
>                          [<ffffffff8197f647>] start_kernel+0x140/0x2af
>                          [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffffffff81501998>] clocksource_lock+0x18/0x80
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>   [<ffffffff810ab272>] clocksource_get_next+0x10/0x4f
>   [<ffffffff81990d2a>] timekeeping_init+0x3a/0xf2
>   [<ffffffff8197f647>] start_kernel+0x140/0x2af
>   [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> -> (__vsyscall_gtod_data.lock){....} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                          [<ffffffff81075490>] update_vsyscall+0x28/0xc1
>                          [<ffffffff8109d707>] run_timer_softirq+0x3a2/0x7aa
>                          [<ffffffff81099cd6>] ksoftirqd+0x113/0x1fd
>                          [<ffffffff81034e12>] kthread+0xf5/0x128
>                          [<ffffffff81063168>] child_rip+0xa/0x12
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffffffff81974220>] sysctl_unix_max_dgram_qlen+0x260/0x2040
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81075490>] update_vsyscall+0x28/0xc1
>   [<ffffffff8109d707>] run_timer_softirq+0x3a2/0x7aa
>   [<ffffffff81099cd6>] ksoftirqd+0x113/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> -> (logbuf_lock){....} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>                          [<ffffffff81017937>] release_console_sem+0x3e/0x1f8
>                          [<ffffffff81096e81>] vprintk+0x2e1/0x352
>                          [<ffffffff81096f59>] printk+0x67/0x69
>                          [<ffffffff8197f563>] start_kernel+0x5c/0x2af
>                          [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffffffff81500e18>] logbuf_lock+0x18/0x80
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>   [<ffffffff81017937>] release_console_sem+0x3e/0x1f8
>   [<ffffffff81096e81>] vprintk+0x2e1/0x352
>   [<ffffffff81096f59>] printk+0x67/0x69
>   [<ffffffff8109d6f4>] run_timer_softirq+0x38f/0x7aa
>   [<ffffffff81099cd6>] ksoftirqd+0x113/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> -> (vga_lock){....} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>                          [<ffffffff81179c70>] vgacon_set_origin+0x3a/0x70
>                          [<ffffffff811b6f7e>] set_origin+0x63/0x9f
>                          [<ffffffff8199b44c>] con_init+0x15d/0x22b
>                          [<ffffffff8199ad7e>] console_init+0x27/0x39
>                          [<ffffffff8197f676>] start_kernel+0x16f/0x2af
>                          [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffffffff81921798>] vga_lock+0x18/0x80
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>   [<ffffffff8117a04e>] vgacon_cursor+0x47/0x1b0
>   [<ffffffff811b65e9>] hide_cursor+0x29/0x65
>   [<ffffffff811badd3>] vt_console_print+0xad/0x23c
>   [<ffffffff81096626>] __call_console_drivers+0x7a/0x93
>   [<ffffffff810966ae>] _call_console_drivers+0x6f/0x73
>   [<ffffffff81017a32>] release_console_sem+0x139/0x1f8
>   [<ffffffff81096e81>] vprintk+0x2e1/0x352
>   [<ffffffff81096f59>] printk+0x67/0x69
>   [<ffffffff8109d6f4>] run_timer_softirq+0x38f/0x7aa
>   [<ffffffff81099cd6>] ksoftirqd+0x113/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>
>the hard-irq-unsafe lock's dependencies:
>-> ((raw_spinlock_t *)(&lock->wait_lock)){--..} ops: 0 {
>   initial-use  at:
>                        [<ffffffff810af993>] mark_lock+0x79/0x42e
>                        [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                        [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                        [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>                        [<ffffffff81068a09>] rt_spin_lock_slowlock+0x33/0x1f5
>                        [<ffffffff8106954b>] rt_spin_lock+0x18/0x34
>                        [<ffffffff81040882>] lock_timer_base+0x25/0x4b
>                        [<ffffffff8101d91c>] __mod_timer+0x3a/0xd3
>                        [<ffffffff8104c623>] mod_timer+0x3d/0x42
>                        [<ffffffff8199b3c3>] con_init+0xd4/0x22b
>                        [<ffffffff8199ad7e>] console_init+0x27/0x39
>                        [<ffffffff8197f676>] start_kernel+0x16f/0x2af
>                        [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>                        [<ffffffffffffffff>] 0xffffffffffffffff
>   softirq-on-W at:
>                        [<ffffffff810af993>] mark_lock+0x79/0x42e
>                        [<ffffffff810afd9b>] mark_held_locks+0x53/0x7a
>                        [<ffffffff810aff76>] trace_hardirqs_on+0x11a/0x13e
>                        [<ffffffff8106a21f>] __spin_unlock_irqrestore+0x49/0x69
>                        [<ffffffff810b7f75>] task_blocks_on_rt_mutex+0x1e3/0x230
>                        [<ffffffff81068ab7>] rt_spin_lock_slowlock+0xe1/0x1f5
>                        [<ffffffff8106954b>] rt_spin_lock+0x18/0x34
>                        [<ffffffff81067b2c>] wait_for_completion+0x2b/0xd5
>                        [<ffffffff8109296e>] set_cpus_allowed+0xa1/0xc8
>                        [<ffffffff81092adf>] measure_one+0x14a/0x20f
>                        [<ffffffff81093a0c>] build_sched_domains+0xe68/0x1338
>                        [<ffffffff81093f08>] arch_init_sched_domains+0x2c/0x33
>                        [<ffffffff8198fd14>] sched_init_smp+0x1e/0x93
>                        [<ffffffff81070813>] init+0x117/0x42f
>                        [<ffffffff81063168>] child_rip+0xa/0x12
>                        [<ffffffffffffffff>] 0xffffffffffffffff
>   hardirq-on-W at:
>                        [<ffffffff810af993>] mark_lock+0x79/0x42e
>                        [<ffffffff810afd9b>] mark_held_locks+0x53/0x7a
>                        [<ffffffff810aff5c>] trace_hardirqs_on+0x100/0x13e
>                        [<ffffffff8106a21f>] __spin_unlock_irqrestore+0x49/0x69
>                        [<ffffffff810b7f75>] task_blocks_on_rt_mutex+0x1e3/0x230
>                        [<ffffffff81068ab7>] rt_spin_lock_slowlock+0xe1/0x1f5
>                        [<ffffffff8106954b>] rt_spin_lock+0x18/0x34
>                        [<ffffffff81067b2c>] wait_for_completion+0x2b/0xd5
>                        [<ffffffff8109296e>] set_cpus_allowed+0xa1/0xc8
>                        [<ffffffff81092adf>] measure_one+0x14a/0x20f
>                        [<ffffffff81093a0c>] build_sched_domains+0xe68/0x1338
>                        [<ffffffff81093f08>] arch_init_sched_domains+0x2c/0x33
>                        [<ffffffff8198fd14>] sched_init_smp+0x1e/0x93
>                        [<ffffffff81070813>] init+0x117/0x42f
>                        [<ffffffff81063168>] child_rip+0xa/0x12
>                        [<ffffffffffffffff>] 0xffffffffffffffff
> }
> ... key      at: [<ffffffff81e8cb4c>] __key.11170+0x0/0x8
> -> ((raw_spinlock_t *)(&p->pi_lock)){....} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>                          [<ffffffff81091b0a>] sched_setscheduler+0x174/0x29e
>                          [<ffffffff810a7ca9>] posix_cpu_thread_call+0x9a/0x14c
>                          [<ffffffff819913fb>] posix_cpu_thread_init+0x24/0x4b
>                          [<ffffffff81070779>] init+0x7d/0x42f
>                          [<ffffffff81063168>] child_rip+0xa/0x12
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffffffff81a2e8cc>] __key.25954+0x0/0x8
>  -> (&rq->rq_lock_key){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>                            [<ffffffff81091249>] init_idle+0xa4/0xd5
>                            [<ffffffff8198ffdb>] sched_init+0x1eb/0x1f0
>                            [<ffffffff8197f58e>] start_kernel+0x87/0x2af
>                            [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff8109030d>] task_running_tick+0x38/0x2d0
>                            [<ffffffff81094420>] scheduler_tick+0xa5/0x116
>                            [<ffffffff8109e222>] update_process_times+0x4c/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff81073441>] main_timer_handler+0x11/0x13
>                            [<ffffffff81073671>] timer_interrupt+0x12/0x27
>                            [<ffffffff8101114b>] handle_IRQ_event+0x59/0xfa
>                            [<ffffffff810d239f>] handle_edge_irq+0x111/0x157
>                            [<ffffffff81072eea>] do_IRQ+0x12e/0x18c
>                            [<ffffffff81062866>] ret_from_intr+0x0/0xf
>                            [<ffffffff8198ac34>] setup_IO_APIC+0x2cc/0x8df
>                            [<ffffffff8198945a>] smp_prepare_cpus+0x323/0x35a
>                            [<ffffffff8107076a>] init+0x6e/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff81000896bf08>] 0xffff81000896bf08
>   -> (&rq->rq_lock_key#2){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff81000897de08>] 0xffff81000897de08
>    -> (&rq->rq_lock_key#3){+...} ops: 0 {
>       initial-use  at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff81092510>] migration_call+0x95/0x452
>                                [<ffffffff8106cec7>]
>notifier_call_chain+0x29/0x3e
>                                [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                                [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                                [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                                [<ffffffff810707c3>] init+0xc7/0x42f
>                                [<ffffffff81063168>] child_rip+0xa/0x12
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>       in-hardirq-W at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                                [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                                [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                                [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                                [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                                [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                                [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                                [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                                [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                                [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                                [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                                [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                                [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>     }
>     ... key      at: [<ffff81000898fd08>] 0xffff81000898fd08
>     -> (&rq->rq_lock_key#4){+...} ops: 0 {
>        initial-use  at:
>                                  [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                  [<ffffffff810b08aa>]
>__lock_acquire+0x4b1/0xb75
>                                  [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                  [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                  [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                  [<ffffffff81092510>] migration_call+0x95/0x452
>                                  [<ffffffff8106cec7>]
>notifier_call_chain+0x29/0x3e
>                                  [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                                  [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                                  [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                                  [<ffffffff810707c3>] init+0xc7/0x42f
>                                  [<ffffffff81063168>] child_rip+0xa/0x12
>                                  [<ffffffffffffffff>] 0xffffffffffffffff
>        in-hardirq-W at:
>                                  [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                  [<ffffffff810b07ec>]
>__lock_acquire+0x3f3/0xb75
>                                  [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                  [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                  [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                  [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                                  [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                                  [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                                  [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                                  [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                                  [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                                  [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                                  [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                                  [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                                  [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                                  [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                                  [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                                  [<ffffffff8107bff5>]
>start_secondary+0x2d7/0x2e6
>                                  [<ffffffffffffffff>] 0xffffffffffffffff
>      }
>      ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>     ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>    ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091428>] double_lock_balance+0x48/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>    -> (&rq->rq_lock_key#4){+...} ops: 0 {
>       initial-use  at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff81092510>] migration_call+0x95/0x452
>                                [<ffffffff8106cec7>]
>notifier_call_chain+0x29/0x3e
>                                [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                                [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                                [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                                [<ffffffff810707c3>] init+0xc7/0x42f
>                                [<ffffffff81063168>] child_rip+0xa/0x12
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>       in-hardirq-W at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                                [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                                [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                                [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                                [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                                [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                                [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                                [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                                [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                                [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                                [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                                [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                                [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>     }
>     ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>    ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091428>] double_lock_balance+0x48/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81090030>] double_rq_lock+0x39/0x3e
>   [<ffffffff8109089e>] __migrate_task+0x6f/0x162
>   [<ffffffff81048ca4>] migration_thread+0x1e1/0x23f
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>   -> (&rq->rq_lock_key#4){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff8104d508>] cpu_idle+0xe3/0xf8
>   [<ffffffff810706da>] rest_init+0x49/0x4b
>   [<ffffffff8197f7b4>] start_kernel+0x2ad/0x2af
>   [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>   -> (&rq->rq_lock_key#3){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff81000898fd08>] 0xffff81000898fd08
>    -> (&rq->rq_lock_key#4){+...} ops: 0 {
>       initial-use  at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff81092510>] migration_call+0x95/0x452
>                                [<ffffffff8106cec7>]
>notifier_call_chain+0x29/0x3e
>                                [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                                [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                                [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                                [<ffffffff810707c3>] init+0xc7/0x42f
>                                [<ffffffff81063168>] child_rip+0xa/0x12
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>       in-hardirq-W at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                                [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                                [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                                [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                                [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                                [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                                [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                                [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                                [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                                [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                                [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                                [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                                [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>     }
>     ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>    ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff8106795d>] preempt_schedule+0x55/0x82
>   [<ffffffff8106a23a>] __spin_unlock_irqrestore+0x64/0x69
>   [<ffffffff8104af55>] try_to_wake_up+0x4c1/0x4d2
>   [<ffffffff81091e32>] wake_up_process+0x12/0x14
>   [<ffffffff81092965>] set_cpus_allowed+0x98/0xc8
>   [<ffffffff81092adf>] measure_one+0x14a/0x20f
>   [<ffffffff81093a0c>] build_sched_domains+0xe68/0x1338
>   [<ffffffff81093f08>] arch_init_sched_domains+0x2c/0x33
>   [<ffffffff8198fd14>] sched_init_smp+0x1e/0x93
>   [<ffffffff81070813>] init+0x117/0x42f
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091b34>] sched_setscheduler+0x19e/0x29e
>   [<ffffffff810a7ca9>] posix_cpu_thread_call+0x9a/0x14c
>   [<ffffffff819913fb>] posix_cpu_thread_init+0x24/0x4b
>   [<ffffffff81070779>] init+0x7d/0x42f
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  -> (&rq->rq_lock_key#2){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff81000897de08>] 0xffff81000897de08
>   -> (&rq->rq_lock_key#3){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff81000898fd08>] 0xffff81000898fd08
>    -> (&rq->rq_lock_key#4){+...} ops: 0 {
>       initial-use  at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff81092510>] migration_call+0x95/0x452
>                                [<ffffffff8106cec7>]
>notifier_call_chain+0x29/0x3e
>                                [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                                [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                                [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                                [<ffffffff810707c3>] init+0xc7/0x42f
>                                [<ffffffff81063168>] child_rip+0xa/0x12
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>       in-hardirq-W at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                                [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                                [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                                [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                                [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                                [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                                [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                                [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                                [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                                [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                                [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                                [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                                [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>     }
>     ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>    ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091428>] double_lock_balance+0x48/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>   -> (&rq->rq_lock_key#4){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091428>] double_lock_balance+0x48/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091b34>] sched_setscheduler+0x19e/0x29e
>   [<ffffffff810a7ca9>] posix_cpu_thread_call+0x9a/0x14c
>   [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>   [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>   [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>   [<ffffffff810b952b>] cpu_up+0x2b/0x42
>   [<ffffffff810707c3>] init+0xc7/0x42f
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  -> (&rq->rq_lock_key#3){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff81000898fd08>] 0xffff81000898fd08
>   -> (&rq->rq_lock_key#4){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091b34>] sched_setscheduler+0x19e/0x29e
>   [<ffffffff810a7ca9>] posix_cpu_thread_call+0x9a/0x14c
>   [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>   [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>   [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>   [<ffffffff810b952b>] cpu_up+0x2b/0x42
>   [<ffffffff810707c3>] init+0xc7/0x42f
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  -> (&rq->rq_lock_key#4){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091b34>] sched_setscheduler+0x19e/0x29e
>   [<ffffffff810a7ca9>] posix_cpu_thread_call+0x9a/0x14c
>   [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>   [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>   [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>   [<ffffffff810b952b>] cpu_up+0x2b/0x42
>   [<ffffffff810707c3>] init+0xc7/0x42f
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff810b7dc9>] task_blocks_on_rt_mutex+0x37/0x230
>   [<ffffffff81068ab7>] rt_spin_lock_slowlock+0xe1/0x1f5
>   [<ffffffff8106954b>] rt_spin_lock+0x18/0x34
>   [<ffffffff81067b2c>] wait_for_completion+0x2b/0xd5
>   [<ffffffff8109296e>] set_cpus_allowed+0xa1/0xc8
>   [<ffffffff81092adf>] measure_one+0x14a/0x20f
>   [<ffffffff81093a0c>] build_sched_domains+0xe68/0x1338
>   [<ffffffff81093f08>] arch_init_sched_domains+0x2c/0x33
>   [<ffffffff8198fd14>] sched_init_smp+0x1e/0x93
>   [<ffffffff81070813>] init+0x117/0x42f
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> -> (&rq->rq_lock_key#2){+...} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                          [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                          [<ffffffff81092510>] migration_call+0x95/0x452
>                          [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                          [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                          [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                          [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                          [<ffffffff810707c3>] init+0xc7/0x42f
>                          [<ffffffff81063168>] child_rip+0xa/0x12
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>    in-hardirq-W at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                          [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                          [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                          [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                          [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                          [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                          [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                          [<ffffffff8109e227>] update_process_times+0x51/0x79
>                          [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                          [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                          [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                          [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                          [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                          [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                          [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffff81000897de08>] 0xffff81000897de08
>  -> (&rq->rq_lock_key#3){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff81000898fd08>] 0xffff81000898fd08
>   -> (&rq->rq_lock_key#4){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091428>] double_lock_balance+0x48/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  -> (&rq->rq_lock_key#4){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091428>] double_lock_balance+0x48/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>   [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>   [<ffffffff81091e07>] wake_up_process_mutex+0x15/0x17
>   [<ffffffff810b74a0>] wakeup_next_waiter+0x1e6/0x1ff
>   [<ffffffff81068917>] rt_spin_lock_slowunlock+0x54/0x72
>   [<ffffffff81069590>] rt_spin_unlock+0x29/0x2d
>   [<ffffffff8109245e>] complete+0x3a/0x57
>   [<ffffffff81048cb3>] migration_thread+0x1f0/0x23f
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> -> (&rq->rq_lock_key){+...} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
>                          [<ffffffff81091249>] init_idle+0xa4/0xd5
>                          [<ffffffff8198ffdb>] sched_init+0x1eb/0x1f0
>                          [<ffffffff8197f58e>] start_kernel+0x87/0x2af
>                          [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>    in-hardirq-W at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                          [<ffffffff8109030d>] task_running_tick+0x38/0x2d0
>                          [<ffffffff81094420>] scheduler_tick+0xa5/0x116
>                          [<ffffffff8109e222>] update_process_times+0x4c/0x79
>                          [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                          [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                          [<ffffffff81073441>] main_timer_handler+0x11/0x13
>                          [<ffffffff81073671>] timer_interrupt+0x12/0x27
>                          [<ffffffff8101114b>] handle_IRQ_event+0x59/0xfa
>                          [<ffffffff810d239f>] handle_edge_irq+0x111/0x157
>                          [<ffffffff81072eea>] do_IRQ+0x12e/0x18c
>                          [<ffffffff81062866>] ret_from_intr+0x0/0xf
>                          [<ffffffff8198ac34>] setup_IO_APIC+0x2cc/0x8df
>                          [<ffffffff8198945a>] smp_prepare_cpus+0x323/0x35a
>                          [<ffffffff8107076a>] init+0x6e/0x42f
>                          [<ffffffff81063168>] child_rip+0xa/0x12
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffff81000896bf08>] 0xffff81000896bf08
>  -> (&rq->rq_lock_key#2){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff81000897de08>] 0xffff81000897de08
>   -> (&rq->rq_lock_key#3){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff81000898fd08>] 0xffff81000898fd08
>    -> (&rq->rq_lock_key#4){+...} ops: 0 {
>       initial-use  at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff81092510>] migration_call+0x95/0x452
>                                [<ffffffff8106cec7>]
>notifier_call_chain+0x29/0x3e
>                                [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                                [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                                [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                                [<ffffffff810707c3>] init+0xc7/0x42f
>                                [<ffffffff81063168>] child_rip+0xa/0x12
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>       in-hardirq-W at:
>                                [<ffffffff810af993>] mark_lock+0x79/0x42e
>                                [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                                [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                                [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                                [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                                [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                                [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                                [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                                [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                                [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                                [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                                [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                                [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                                [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                                [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                                [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                                [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                                [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                                [<ffffffffffffffff>] 0xffffffffffffffff
>     }
>     ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>    ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091428>] double_lock_balance+0x48/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>   -> (&rq->rq_lock_key#4){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091428>] double_lock_balance+0x48/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81090030>] double_rq_lock+0x39/0x3e
>   [<ffffffff8109089e>] __migrate_task+0x6f/0x162
>   [<ffffffff81048ca4>] migration_thread+0x1e1/0x23f
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  -> (&rq->rq_lock_key#4){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff8104d508>] cpu_idle+0xe3/0xf8
>   [<ffffffff810706da>] rest_init+0x49/0x4b
>   [<ffffffff8197f7b4>] start_kernel+0x2ad/0x2af
>   [<ffffffff8197f15a>] _sinittext+0x15a/0x161
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  -> (&rq->rq_lock_key#3){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff81000898fd08>] 0xffff81000898fd08
>   -> (&rq->rq_lock_key#4){+...} ops: 0 {
>      initial-use  at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff81092510>] migration_call+0x95/0x452
>                              [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                              [<ffffffff810a0df3>]
>raw_notifier_call_chain+0x9/0xb
>                              [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                              [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                              [<ffffffff810707c3>] init+0xc7/0x42f
>                              [<ffffffff81063168>] child_rip+0xa/0x12
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>      in-hardirq-W at:
>                              [<ffffffff810af993>] mark_lock+0x79/0x42e
>                              [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                              [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                              [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                              [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                              [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                              [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                              [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                              [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                              [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                              [<ffffffff8109e227>]
>update_process_times+0x51/0x79
>                              [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                              [<ffffffff810acae5>]
>tick_handle_periodic+0x1f/0x62
>                              [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                              [<ffffffff81062f8b>]
>apic_timer_interrupt+0x6b/0x70
>                              [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                              [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                              [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                              [<ffffffffffffffff>] 0xffffffffffffffff
>    }
>    ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>   ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff8106795d>] preempt_schedule+0x55/0x82
>   [<ffffffff8106a23a>] __spin_unlock_irqrestore+0x64/0x69
>   [<ffffffff8104af55>] try_to_wake_up+0x4c1/0x4d2
>   [<ffffffff81091e32>] wake_up_process+0x12/0x14
>   [<ffffffff81092965>] set_cpus_allowed+0x98/0xc8
>   [<ffffffff81092adf>] measure_one+0x14a/0x20f
>   [<ffffffff81093a0c>] build_sched_domains+0xe68/0x1338
>   [<ffffffff81093f08>] arch_init_sched_domains+0x2c/0x33
>   [<ffffffff8198fd14>] sched_init_smp+0x1e/0x93
>   [<ffffffff81070813>] init+0x117/0x42f
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>   [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>   [<ffffffff81091e07>] wake_up_process_mutex+0x15/0x17
>   [<ffffffff810b74a0>] wakeup_next_waiter+0x1e6/0x1ff
>   [<ffffffff81068917>] rt_spin_lock_slowunlock+0x54/0x72
>   [<ffffffff81069590>] rt_spin_unlock+0x29/0x2d
>   [<ffffffff8109245e>] complete+0x3a/0x57
>   [<ffffffff81048cb3>] migration_thread+0x1f0/0x23f
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> -> (&rq->rq_lock_key#3){+...} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                          [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                          [<ffffffff81092510>] migration_call+0x95/0x452
>                          [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                          [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                          [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                          [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                          [<ffffffff810707c3>] init+0xc7/0x42f
>                          [<ffffffff81063168>] child_rip+0xa/0x12
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>    in-hardirq-W at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                          [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                          [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                          [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                          [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                          [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                          [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                          [<ffffffff8109e227>] update_process_times+0x51/0x79
>                          [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                          [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                          [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                          [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                          [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                          [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                          [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffff81000898fd08>] 0xffff81000898fd08
>  -> (&rq->rq_lock_key#4){+...} ops: 0 {
>     initial-use  at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff81092510>] migration_call+0x95/0x452
>                            [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                            [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                            [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                            [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                            [<ffffffff810707c3>] init+0xc7/0x42f
>                            [<ffffffff81063168>] child_rip+0xa/0x12
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>     in-hardirq-W at:
>                            [<ffffffff810af993>] mark_lock+0x79/0x42e
>                            [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                            [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                            [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                            [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                            [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                            [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                            [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                            [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                            [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                            [<ffffffff8109e227>] update_process_times+0x51/0x79
>                            [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                            [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                            [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                            [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                            [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                            [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                            [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                            [<ffffffffffffffff>] 0xffffffffffffffff
>   }
>   ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
>  ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff81091437>] double_lock_balance+0x57/0x60
>   [<ffffffff81066af2>] __sched_text_start+0x382/0xf73
>   [<ffffffff81067adc>] schedule+0xec/0x111
>   [<ffffffff81099c56>] ksoftirqd+0x93/0x1fd
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>   [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>   [<ffffffff81091e07>] wake_up_process_mutex+0x15/0x17
>   [<ffffffff810b74a0>] wakeup_next_waiter+0x1e6/0x1ff
>   [<ffffffff81068917>] rt_spin_lock_slowunlock+0x54/0x72
>   [<ffffffff81069590>] rt_spin_unlock+0x29/0x2d
>   [<ffffffff8109245e>] complete+0x3a/0x57
>   [<ffffffff81048cb3>] migration_thread+0x1f0/0x23f
>   [<ffffffff81034e12>] kthread+0xf5/0x128
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
> -> (&rq->rq_lock_key#4){+...} ops: 0 {
>    initial-use  at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b08aa>] __lock_acquire+0x4b1/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                          [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                          [<ffffffff81092510>] migration_call+0x95/0x452
>                          [<ffffffff8106cec7>] notifier_call_chain+0x29/0x3e
>                          [<ffffffff810a0df3>] raw_notifier_call_chain+0x9/0xb
>                          [<ffffffff810b9473>] _cpu_up+0x48/0xd5
>                          [<ffffffff810b952b>] cpu_up+0x2b/0x42
>                          [<ffffffff810707c3>] init+0xc7/0x42f
>                          [<ffffffff81063168>] child_rip+0xa/0x12
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>    in-hardirq-W at:
>                          [<ffffffff810af993>] mark_lock+0x79/0x42e
>                          [<ffffffff810b07ec>] __lock_acquire+0x3f3/0xb75
>                          [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>                          [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>                          [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>                          [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>                          [<ffffffff81091e32>] wake_up_process+0x12/0x14
>                          [<ffffffff810993b5>] wakeup_softirqd+0x38/0x3a
>                          [<ffffffff81099deb>] raise_softirq+0x2b/0x4b
>                          [<ffffffff81051ab9>] run_local_timers+0xe/0x15
>                          [<ffffffff8109e227>] update_process_times+0x51/0x79
>                          [<ffffffff810acac4>] tick_periodic+0x6e/0x70
>                          [<ffffffff810acae5>] tick_handle_periodic+0x1f/0x62
>                          [<ffffffff8107cc37>]
>smp_apic_timer_interrupt+0x64/0x7f
>                          [<ffffffff81062f8b>] apic_timer_interrupt+0x6b/0x70
>                          [<ffffffff8105b9f4>] mwait_idle+0x5a/0x64
>                          [<ffffffff8104d4c8>] cpu_idle+0xa3/0xf8
>                          [<ffffffff8107bff5>] start_secondary+0x2d7/0x2e6
>                          [<ffffffffffffffff>] 0xffffffffffffffff
>  }
>  ... key      at: [<ffff8100089a1c08>] 0xffff8100089a1c08
> ... acquired at:
>   [<ffffffff810ae911>] add_lock_to_list+0x82/0xb1
>   [<ffffffff810b0dd6>] __lock_acquire+0x9dd/0xb75
>   [<ffffffff810b133b>] lock_acquire+0x4c/0x65
>   [<ffffffff81069bac>] __spin_lock+0x2f/0x3c
>   [<ffffffff810907fd>] task_rq_lock+0x42/0x74
>   [<ffffffff8104aad4>] try_to_wake_up+0x40/0x4d2
>   [<ffffffff81091e07>] wake_up_process_mutex+0x15/0x17
>   [<ffffffff810b74a0>] wakeup_next_waiter+0x1e6/0x1ff
>   [<ffffffff81068917>] rt_spin_lock_slowunlock+0x54/0x72
>   [<ffffffff81069590>] rt_spin_unlock+0x29/0x2d
>   [<ffffffff810a3e98>] __queue_work+0x77/0x7c
>   [<ffffffff810a3ee5>] queue_work+0x48/0x51
>   [<ffffffff810a37e1>] call_usermodehelper_keys+0xed/0x10a
>   [<ffffffff8115f7c3>] kobject_uevent_env+0x420/0x471
>   [<ffffffff8105c7a7>] kobject_uevent+0xb/0xd
>   [<ffffffff8115ef9a>] kobject_register+0x36/0x3e
>   [<ffffffff811ccbed>] sysdev_register+0x5e/0xd4
>   [<ffffffff81073463>] time_init_device+0x20/0x22
>   [<ffffffff8107087e>] init+0x182/0x42f
>   [<ffffffff81063168>] child_rip+0xa/0x12
>   [<ffffffffffffffff>] 0xffffffffffffffff
>
>
>stack backtrace:
>
>Call Trace:
> [<ffffffff8107187f>] dump_trace+0xb6/0x3ce
> [<ffffffff81071bde>] show_trace+0x47/0x78
> [<ffffffff81071c24>] dump_stack+0x15/0x17
> [<ffffffff810b034c>] check_usage+0x283/0x294
> [<ffffffff810b0cf5>] __lock_acquire+0x8fc/0xb75
> [<ffffffff810b133b>] lock_acquire+0x4c/0x65
> [<ffffffff81069de2>] __spin_lock_irqsave+0x36/0x46
> [<ffffffff81068a09>] rt_spin_lock_slowlock+0x33/0x1f5
> [<ffffffff8106954b>] rt_spin_lock+0x18/0x34
> [<ffffffff811c7f32>] serial8250_console_write+0x61/0x148
> [<ffffffff81096626>] __call_console_drivers+0x7a/0x93
> [<ffffffff810966ae>] _call_console_drivers+0x6f/0x73
> [<ffffffff81017a32>] release_console_sem+0x139/0x1f8
> [<ffffffff81096e81>] vprintk+0x2e1/0x352
> [<ffffffff81096f59>] printk+0x67/0x69
> [<ffffffff8109d6f4>] run_timer_softirq+0x38f/0x7aa
> [<ffffffff81099cd6>] ksoftirqd+0x113/0x1fd
> [<ffffffff81034e12>] kthread+0xf5/0x128
> [<ffffffff81063168>] child_rip+0xa/0x12
>
>---------------------------
>| preempt count: 00000002 ]
>| 2-level deep critical section nesting:
>----------------------------------------
>.. [<ffffffff81069b93>] .... __spin_lock+0x16/0x3c
>.....[<ffffffff8109d3b8>] ..   ( <= run_timer_softirq+0x53/0x7aa)
>.. [<ffffffff81069dc9>] .... __spin_lock_irqsave+0x1d/0x46
>.....[<ffffffff81068a09>] ..   ( <= rt_spin_lock_slowlock+0x33/0x1f5)
>
>

Actions: View

Attachments on bug 236817: 152847 | 152848