Bug 1087813 - suspicious RCU usage in drivers/net/ethernet/broadcom/cnic.c [NEEDINFO]
Summary: suspicious RCU usage in drivers/net/ethernet/broadcom/cnic.c
Keywords:
Status: CLOSED INSUFFICIENT_DATA
Alias: None
Product: Fedora
Classification: Fedora
Component: kernel
Version: 22
Hardware: i686
OS: Unspecified
high
high
Target Milestone: ---
Assignee: Kernel Maintainer List
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-04-15 11:26 UTC by Alexander Todorov
Modified: 2015-11-23 17:18 UTC (History)
9 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-11-23 17:18:25 UTC
Type: Bug
Embargoed:
jforbes: needinfo?


Attachments (Terms of Use)
RCU Lockdep Issue (942 bytes, patch)
2014-04-24 06:14 UTC, Tej Parkash
no flags Details | Diff

Description Alexander Todorov 2014-04-15 11:26:15 UTC
Description of problem:


Hardware name: HP ProLiant DL360 G7, BIOS P68 01/28/2011

On that particular hardware it seems that anaconda starts successfully and then hits a problem in the network driver and dies:


Starting installer, one moment...      
  
 
[   90.404233]  
[   90.432418] =============================== 
[   90.511920] [ INFO: suspicious RCU usage. ] 
[   90.511922] 3.15.0-0.rc0.git13.1.fc21.i686 #1 Not tainted 
[   90.511922] ------------------------------- 
[   90.511923] drivers/net/ethernet/broadcom/cnic.c:576 suspicious rcu_dereference_check() usage! 
[   90.511923]  
[   90.511923] other info that might help us debug this: 
[   90.511923]  
[   90.511924]  
[   90.511924] rcu_scheduler_active = 1, debug_locks = 0 
[   90.511925] 3 locks held by anaconda/1320: 
[   90.511932]  #0:  (rtnl_mutex){+.+.+.}, at: [<c09c6474>] rtnl_lock+0x14/0x20 
[   90.511937]  #1:  (&bnx2i_dev_lock){+.+...}, at: [<f80d45df>] bnx2i_ulp_init+0x2f/0x140 [bnx2i] 
[   90.511940]  #2:  (cnic_lock){+.+...}, at: [<f80c8328>] cnic_register_device+0x38/0x2d0 [cnic] 
[   90.511941]  
[   90.511941] stack backtrace: 
[   90.511942] CPU: 3 PID: 1320 Comm: anaconda Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[   90.511943] Hardware name: HP ProLiant DL360 G7, BIOS P68 01/28/2011 
[   90.511946]  00000000 2cd0aecd 00000000 dc0d3cf4 c0ae271d 00000001 dc0d3d1c c04ac226 
[   90.511948]  c0cb548e c0cdb161 00000001 00000000 dc160000 00000001 ec75a2c0 ec75a32c 
[   90.511950]  dc0d3d90 f80c8442 00000003 f80d45df 00000001 df49393c 00000000 ec75a330 
[   90.511951] Call Trace: 
[   90.511956]  [<c0ae271d>] dump_stack+0x48/0x60 
[   90.511959]  [<c04ac226>] lockdep_rcu_suspicious+0xd6/0x100 
[   90.511961]  [<f80c8442>] cnic_register_device+0x152/0x2d0 [cnic] 
[   90.511967]  [<f80d45df>] ? bnx2i_ulp_init+0x2f/0x140 [bnx2i] 
[   90.511969]  [<c04add2b>] ? trace_hardirqs_on+0xb/0x10 
[   90.511972]  [<f80d45df>] ? bnx2i_ulp_init+0x2f/0x140 [bnx2i] 
[   90.511974]  [<f80d45df>] ? bnx2i_ulp_init+0x2f/0x140 [bnx2i] 
[   90.511977]  [<f80d45f9>] bnx2i_ulp_init+0x49/0x140 [bnx2i] 
[   90.511979]  [<f80c65e1>] cnic_register_driver+0xe1/0x180 [cnic] 
[   90.511982]  [<f7d93000>] ? 0xf7d92fff 
[   90.511984]  [<f7d9308b>] bnx2i_mod_init+0x8b/0x1000 [bnx2i] 
[   90.511986]  [<f7d93000>] ? 0xf7d92fff 
[   90.511988]  [<c040049a>] do_one_initcall+0xca/0x1a0 
[   90.511990]  [<f7d93000>] ? 0xf7d92fff 
[   90.511992]  [<c0445777>] ? set_memory_ro+0x37/0x40 
[   90.511995]  [<c04e3b96>] load_module+0x1fe6/0x2480 
[   90.511999]  [<c04dfb99>] ? copy_module_from_fd.isra.45+0x109/0x1a0 
[   90.512001]  [<c04e41ed>] SyS_finit_module+0x8d/0xd0 
[   90.512003]  [<c04a97ab>] ? up_write+0x1b/0x30 
[   90.512005]  [<c056defb>] ? vm_mmap_pgoff+0x9b/0xc0 
[   90.512010]  [<c0af39df>] sysenter_do_call+0x12/0x38 
[   90.512012]  [<c0ae0000>] ? mtrr_check.part.2+0x32/0x57 
[   90.512304] bnx2i [04:00.01]: ISCSI_INIT passed 
[  155.484180] INFO: rcu_sched detected stalls on CPUs/tasks: {} (detected by 7, t=65099 jiffies, g=4371, c=4370, q=172) 
[  155.634698] INFO: Stall ended before state dump start 
[-- MARK -- Tue Apr 15 09:30:01 2014] 
[  242.876747] INFO: task rcu_sched:7 blocked for more than 120 seconds. 
[  243.042488]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  243.114340] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  243.182334] rcu_sched       D f11bf500  6712     7      2 0x00000000 
[  243.243835]  efd8de80 00000092 00000000 f11bf500 00000000 c1058500 efd0adc0 00000000 
[  243.314274]  c1058500 f11bf500 efd0ab20 00000000 00000001 00000000 c0486023 00000000 
[  243.385656]  30a3ed3b 00000000 00000246 00000000 efd8de88 efd8de88 00000086 00000001 
[  243.456517] Call Trace: 
[  243.477461]  [<c0486023>] ? finish_task_switch+0x33/0x100 
[  243.576991]  [<c04c9f73>] ? rcu_gp_kthread+0x113/0x5a0 
[  243.662647]  [<c0ae5a3a>] schedule_preempt_disabled+0x2a/0x80 
[  243.718263]  [<c0ae787a>] mutex_lock_nested+0x16a/0x3d0 
[  243.778106]  [<c04c9f73>] ? rcu_gp_kthread+0x113/0x5a0 
[  243.826221]  [<c04c9f73>] ? rcu_gp_kthread+0x113/0x5a0 
[  243.870357]  [<c04c9f73>] rcu_gp_kthread+0x113/0x5a0 
[  243.917964]  [<c04a3ee0>] ? abort_exclusive_wait+0x90/0x90 
[  243.964365]  [<c04c9e60>] ? __note_gp_changes+0x50/0x50 
[  244.012914]  [<c047bf6c>] kthread+0xbc/0xd0 
[  244.061479]  [<c0af3941>] ret_from_kernel_thread+0x21/0x30 
[  244.165409]  [<c047beb0>] ? insert_kthread_work+0x70/0x70 
[  244.231316] INFO: lockdep is turned off. 
[  244.270312] INFO: task kworker/1:1:63 blocked for more than 120 seconds. 
[  244.329793]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  244.388182] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  244.460685] kworker/1:1     D 00000000  6216    63      2 0x00000000 
[  244.521112] Workqueue: events output_poll_execute [drm_kms_helper] 
[  244.595788]  eea49e0c 00000092 00000000 00000000 00000000 c1058500 ef0fca80 00000001 
[  244.738077]  c1058500 f0b39500 ef0fc7e0 c049cac2 00000046 00000000 00000000 00000000 
[  244.810179]  9cc2c106 00000000 00000246 00000000 eea49e14 eea49e14 00000086 00000001 
[  244.879368] Call Trace: 
[  244.903012]  [<c049cac2>] ? pick_next_task_fair+0x2c2/0xb40 
[  244.956949]  [<f7d80d77>] ? output_poll_execute+0x37/0x170 [drm_kms_helper] 
[  245.021884]  [<c0ae5a3a>] schedule_preempt_disabled+0x2a/0x80 
[  245.077202]  [<c0ae787a>] mutex_lock_nested+0x16a/0x3d0 
[  245.136312]  [<f7d80d77>] ? output_poll_execute+0x37/0x170 [drm_kms_helper] 
[  245.265559]  [<f7d80d77>] ? output_poll_execute+0x37/0x170 [drm_kms_helper] 
[  245.334234]  [<f7d80d77>] output_poll_execute+0x37/0x170 [drm_kms_helper] 
[  245.396228]  [<c0473f6a>] ? process_one_work+0x13a/0x630 
[  245.444195]  [<c0473fe6>] process_one_work+0x1b6/0x630 
[  245.492250]  [<c0473f6a>] ? process_one_work+0x13a/0x630 
[  245.539606]  [<c0474606>] ? worker_thread+0x1a6/0x360 
[  245.589096]  [<c047455c>] worker_thread+0xfc/0x360 
[  245.632191]  [<c0474460>] ? process_one_work+0x630/0x630 
[  245.763130]  [<c047bf6c>] kthread+0xbc/0xd0 
[  245.833377]  [<c0af3941>] ret_from_kernel_thread+0x21/0x30 
[  245.886492]  [<c047beb0>] ? insert_kthread_work+0x70/0x70 
[  245.934200] INFO: lockdep is turned off. 
[  245.974058] INFO: task kworker/u64:1:71 blocked for more than 120 seconds. 
[  246.038932]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  246.097536] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  246.167322] kworker/u64:1   D 00000001  5660    71      2 0x00000000 
[  246.230791] Workqueue: dm_bufio_cache work_fn 
[  246.316551]  f633de28 00000086 00000000 00000001 00000000 c1058500 f6304a80 00000000 
[  246.417558]  c1058500 f0b39500 f63047e0 f633ddf4 c0ae9db8 00000000 00000001 00000000 
[  246.487402]  e616ec1c 00000000 00000246 00000000 f633de30 f633de30 00000082 00000001 
[  246.557099] Call Trace: 
[  246.579130]  [<c0ae9db8>] ? _raw_spin_lock+0x68/0x70 
[  246.624393]  [<c094a37c>] ? work_fn+0x2c/0x110 
[  246.671274]  [<c0ae5a3a>] schedule_preempt_disabled+0x2a/0x80 
[  246.728362]  [<c0ae787a>] mutex_lock_nested+0x16a/0x3d0 
[  246.792154]  [<c094a37c>] ? work_fn+0x2c/0x110 
[  246.877463]  [<c094a37c>] ? work_fn+0x2c/0x110 
[  246.936485]  [<c094a37c>] work_fn+0x2c/0x110 
[  246.977500]  [<c0473fe6>] process_one_work+0x1b6/0x630 
[  247.027341]  [<c0473f6a>] ? process_one_work+0x13a/0x630 
[  247.075288]  [<c0474606>] ? worker_thread+0x1a6/0x360 
[  247.126167]  [<c047455c>] worker_thread+0xfc/0x360 
[  247.170633]  [<c0474460>] ? process_one_work+0x630/0x630 
[  247.224966]  [<c047bf6c>] kthread+0xbc/0xd0 
[  247.268000]  [<c0af3941>] ret_from_kernel_thread+0x21/0x30 
[  247.340112]  [<c047beb0>] ? insert_kthread_work+0x70/0x70 
[  247.440034] INFO: lockdep is turned off. 
[  247.476778] INFO: task kworker/u64:2:553 blocked for more than 120 seconds. 
[  247.542287]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  247.595169] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  247.667312] kworker/u64:2   D c0510f9c  5084   553      2 0x00000000 
[  247.724064] Workqueue: writeback bdi_writeback_workfn (flush-253:0) 
[  247.783139]  edd2f8a4 00000096 00000000 c0510f9c 00000000 c1058500 eddfd8e0 c0510f9c 
[  247.881147]  c1058500 f1071500 eddfd640 edd2f89c c04cf1ba 00000002 00000001 00000000 
[  248.003028]  c0510f9c 00000061 0000008b ffffffff ffffffff 00000018 edd2fce4 edd2fcd0 
[  248.076910] Call Trace: 
[  248.101399]  [<c0510f9c>] ? __delayacct_blkio_start+0x1c/0x20 
[  248.155073]  [<c0510f9c>] ? __delayacct_blkio_start+0x1c/0x20 
[  248.210070]  [<c04cf1ba>] ? ktime_get_ts+0xaa/0x1d0 
[  248.258473]  [<c0510f9c>] ? __delayacct_blkio_start+0x1c/0x20 
[  248.312356]  [<c0ae58b2>] io_schedule+0x92/0x120 
[  248.352863]  [<c068c81d>] sleep_on_shadow_bh+0xd/0x20 
[  248.467676]  [<c0ae5c75>] __wait_on_bit+0x55/0x90 
[  248.556815]  [<c068c810>] ? start_this_handle+0x690/0x690 
[  248.617236]  [<c068c810>] ? start_this_handle+0x690/0x690 
[  248.666478]  [<c0ae5d18>] out_of_line_wait_on_bit+0x68/0x90 
[  248.722055]  [<c04a3f20>] ? autoremove_wake_function+0x40/0x40 
[  248.782447]  [<c068e15e>] do_get_write_access+0x41e/0x5a0 
[  248.834142]  [<c068e300>] jbd2_journal_get_write_access+0x20/0x30 
[  248.892361]  [<c06719df>] __ext4_journal_get_write_access+0x3f/0x80 
[  248.948331]  [<c0679c54>] ext4_mb_mark_diskspace_used+0xd4/0x550 
[  249.040502]  [<c06799d2>] ? ext4_mb_regular_allocator+0x272/0x420 
[  249.141174]  [<c067b576>] ext4_mb_new_blocks+0x3d6/0xb10 
[  249.191572]  [<c059dfc4>] ? __kmalloc+0x104/0x370 
[  249.235292]  [<c059c86c>] ? deactivate_slab+0x3ec/0x5b0 
[  249.282768]  [<c0669bcd>] ? ext4_ext_find_extent+0x25d/0x290 
[  249.335599]  [<c0669bcd>] ? ext4_ext_find_extent+0x25d/0x290 
[  249.385269]  [<c0ae9fc2>] ? _raw_spin_unlock+0x22/0x30 
[  249.431997]  [<c059c856>] ? deactivate_slab+0x3d6/0x5b0 
[  249.478425]  [<c066dfb5>] ext4_ext_map_blocks+0xff5/0x2170 
[  249.538750]  [<c0599457>] ? set_track+0x57/0x110 
[  249.636216]  [<c059b40f>] ? alloc_debug_processing+0xcf/0x170 
[  249.699907]  [<c064129c>] ext4_map_blocks+0x43c/0x640 
[  249.749604]  [<c0644048>] mpage_map_and_submit_extent+0xb8/0x8e0 
[  249.806713]  [<c063ee80>] ? mpage_prepare_extent_to_map+0x260/0x280 
[  249.867779]  [<c06715f0>] ? __ext4_journal_start_sb+0x60/0x160 
[  249.921864]  [<c0644da0>] ext4_writepages+0x530/0x940 
[  249.970845]  [<c055dd0d>] do_writepages+0x1d/0x30 
[  250.017855]  [<c05e5f8f>] __writeback_single_inode+0x3f/0x4d0 
[  250.087617]  [<c05e68ad>] ? writeback_sb_inodes+0x19d/0x3d0 
[  250.192576]  [<c05e6906>] writeback_sb_inodes+0x1f6/0x3d0 
[  250.254077]  [<c05e6b64>] __writeback_inodes_wb+0x84/0xc0 
[  250.308192]  [<c05e6e0a>] wb_writeback+0x26a/0x4e0 
[  250.352650]  [<c05e3400>] ? over_bground_thresh+0x60/0xb0 
[  250.403920]  [<c05e73df>] bdi_writeback_workfn+0x1af/0x5b0 
[  250.455158]  [<c0473fe6>] process_one_work+0x1b6/0x630 
[  250.502451]  [<c0473f6a>] ? process_one_work+0x13a/0x630 
[  250.550622]  [<c0474606>] ? worker_thread+0x1a6/0x360 
[  250.613815]  [<c047455c>] worker_thread+0xfc/0x360 
[  250.707120]  [<c0474460>] ? process_one_work+0x630/0x630 
[  250.779688]  [<c047bf6c>] kthread+0xbc/0xd0 
[  250.827640]  [<c0af3941>] ret_from_kernel_thread+0x21/0x30 
[  250.877861]  [<c047beb0>] ? insert_kthread_work+0x70/0x70 
[  250.927591] INFO: lockdep is turned off. 
[  250.961378] INFO: task loop1:977 blocked for more than 120 seconds. 
[  251.018964]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  251.072707] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  251.150707] loop1           D 00000034  5072   977      2 0x00000000 
[  251.306884]  e92edaa0 00000096 00000000 00000034 00000000 c1058500 f5abd8e0 e92eda44 
[  251.378756]  c1058500 f0c87500 f5abd640 e92eda74 e92eda58 c05a2a1d e92eda60 c05ad4a5 
[  251.448270]  de1ca9e1 00000000 00000246 00000000 e92edaa8 e92edaa8 00000082 00000001 
[  251.517433] Call Trace: 
[  251.542063]  [<c05a2a1d>] ? lookup_page_cgroup_used+0xd/0x30 
[  251.596057]  [<c05ad4a5>] ? mem_cgroup_bad_page_check+0x25/0x30 
[  251.653256]  [<f7c53636>] ? squashfs_readpage+0x7b6/0xd50 [squashfs] 
[  251.714033]  [<c0ae5a3a>] schedule_preempt_disabled+0x2a/0x80 
[  251.830862]  [<c0ae787a>] mutex_lock_nested+0x16a/0x3d0 
[  251.897301]  [<f7c53636>] ? squashfs_readpage+0x7b6/0xd50 [squashfs] 
[  251.957859]  [<f7c53636>] ? squashfs_readpage+0x7b6/0xd50 [squashfs] 
[  252.020029]  [<f7c53636>] squashfs_readpage+0x7b6/0xd50 [squashfs] 
[  252.078091]  [<c055e4b1>] ? __do_page_cache_readahead+0x331/0x380 
[  252.133788]  [<c0550eaa>] ? add_to_page_cache_lru+0x5a/0x90 
[  252.186018]  [<c055e4b1>] __do_page_cache_readahead+0x331/0x380 
[  252.242454]  [<c055e335>] ? __do_page_cache_readahead+0x1b5/0x380 
[  252.329982]  [<c055e5c9>] ondemand_readahead+0xc9/0x3f0 
[  252.427575]  [<c054fc30>] ? find_get_pages_contig+0x30/0x320 
[  252.481242]  [<c055ea3b>] page_cache_sync_readahead+0x3b/0x60 
[  252.537486]  [<c05e99c6>] __generic_file_splice_read+0x666/0x6d0 
[  252.593320]  [<c05e8380>] ? page_cache_pipe_buf_release+0x20/0x20 
[  252.649059]  [<c06bd0c3>] ? avc_has_perm+0x33/0x2f0 
[  252.697299]  [<c06bd1d6>] ? avc_has_perm+0x146/0x2f0 
[  252.744744]  [<c06bd1ea>] ? avc_has_perm+0x15a/0x2f0 
[  252.785770]  [<c06bd0c3>] ? avc_has_perm+0x33/0x2f0 
[  252.855808]  [<c06bf465>] ? inode_has_perm.isra.47+0x45/0x80 
[  252.952836]  [<c06bf777>] ? file_has_perm+0x97/0xa0 
[  253.018195]  [<c05e8966>] ? do_splice_to+0x56/0x70 
[  253.063576]  [<c05e9b28>] generic_file_splice_read+0xf8/0x180 
[  253.123513]  [<c05e8966>] ? do_splice_to+0x56/0x70 
[  253.166387]  [<c05e9a30>] ? __generic_file_splice_read+0x6d0/0x6d0 
[  253.222345]  [<c05e8966>] do_splice_to+0x56/0x70 
[  253.264074]  [<c05e8a1e>] splice_direct_to_actor+0x9e/0x240 
[  253.317182]  [<f7eb4970>] ? do_lo_send_write+0xf0/0xf0 [loop] 
[  253.391244]  [<f7eb67b2>] lo_receive+0xa2/0x180 [loop] 
[  253.492301]  [<c04a3aca>] ? __wake_up+0x1a/0x50 
[  253.534916]  [<c04a3aca>] ? __wake_up+0x1a/0x50 
[  253.576945]  [<f7eb6947>] ? loop_thread+0xb7/0x5d0 [loop] 
[  253.626232]  [<f7eb6ab5>] loop_thread+0x225/0x5d0 [loop] 
[  253.672043]  [<c048f770>] ? default_wake_function+0x10/0x20 
[  253.726235]  [<c04adc7c>] ? trace_hardirqs_on_caller+0x13c/0x1e0 
[  253.780422]  [<c04a3905>] ? __wake_up_common+0x45/0x70 
[  253.826277]  [<c04a3ee0>] ? abort_exclusive_wait+0x90/0x90 
[  253.875001]  [<f7eb6890>] ? lo_receive+0x180/0x180 [loop] 
[  253.998236]  [<c047bf6c>] kthread+0xbc/0xd0 
[  254.074755]  [<c0af3941>] ret_from_kernel_thread+0x21/0x30 
[  254.131591]  [<c047beb0>] ? insert_kthread_work+0x70/0x70 
[  254.182308] INFO: lockdep is turned off. 
[  254.215599] INFO: task loop2:989 blocked for more than 120 seconds. 
[  254.275619]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  254.329235] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  254.399460] loop2           D 00000001  6048   989      2 0x00000000 
[  254.461370]  e7d3bd88 00000086 00000000 00000001 00000000 c1058500 f579ca80 00000000 
[  254.607252]  c1058500 f0b39500 f579c7e0 effb8be0 00000000 f0b399fc c1058500 00000000 
[  254.697887]  12fdffdd 00000000 00000246 00000000 e7d3bd90 e7d3bd90 00000082 00000001 
[  254.766594] Call Trace: 
[  254.789932]  [<c0552c05>] ? generic_file_aio_write+0x45/0xf0 
[  254.837813]  [<c0ae5a3a>] schedule_preempt_disabled+0x2a/0x80 
[  254.890758]  [<c0ae787a>] mutex_lock_nested+0x16a/0x3d0 
[  254.945438]  [<c0552c05>] ? generic_file_aio_write+0x45/0xf0 
[  254.999618]  [<c0552c05>] ? generic_file_aio_write+0x45/0xf0 
[  255.071561]  [<c0552c05>] generic_file_aio_write+0x45/0xf0 
[  255.177219]  [<c05b69fa>] do_sync_write+0x6a/0xa0 
[  255.228043]  [<f7eb4765>] __do_lo_send_write+0x55/0x100 [loop] 
[  255.279117]  [<f7eb484f>] do_lo_send_direct_write+0x3f/0x70 [loop] 
[  255.336514]  [<f7eb6bec>] loop_thread+0x35c/0x5d0 [loop] 
[  255.385806]  [<f7eb4810>] ? __do_lo_send_write+0x100/0x100 [loop] 
[  255.444061]  [<f7eb6890>] ? lo_receive+0x180/0x180 [loop] 
[  255.492820]  [<c047bf6c>] kthread+0xbc/0xd0 
[  255.527996]  [<c0af3941>] ret_from_kernel_thread+0x21/0x30 
[  255.578766]  [<c047beb0>] ? insert_kthread_work+0x70/0x70 
[  255.680623] INFO: lockdep is turned off. 
[  255.747739] INFO: task jbd2/dm-0-8:1060 blocked for more than 120 seconds. 
[  255.809763]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  255.865032] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  255.935232] jbd2/dm-0-8     D c0510f9c  5868  1060      2 0x00000000 
[  255.994583]  ec2add48 00000082 00000000 c0510f9c 00000000 c1058500 e93a58e0 c0510f9c 
[  256.065872]  c1058500 f1071500 e93a5640 ec2add40 c04cf1ba 00000002 00000001 00000000 
[  256.142274]  c0510f9c 00000067 0000008f ffffffff ffffffff 00000018 00650c8f 23765fbf 
[  256.289840] Call Trace: 
[  256.322052]  [<c0510f9c>] ? __delayacct_blkio_start+0x1c/0x20 
[  256.375795]  [<c0510f9c>] ? __delayacct_blkio_start+0x1c/0x20 
[  256.427930]  [<c04cf1ba>] ? ktime_get_ts+0xaa/0x1d0 
[  256.468830]  [<c0510f9c>] ? __delayacct_blkio_start+0x1c/0x20 
[  256.522545]  [<c0ae58b2>] io_schedule+0x92/0x120 
[  256.566737]  [<c05ecbbd>] sleep_on_buffer+0xd/0x20 
[  256.610048]  [<c0ae5c75>] __wait_on_bit+0x55/0x90 
[  256.654170]  [<c05ecbb0>] ? generic_block_bmap+0x90/0x90 
[  256.754545]  [<c05ecbb0>] ? generic_block_bmap+0x90/0x90 
[  256.845283]  [<c0ae5d18>] out_of_line_wait_on_bit+0x68/0x90 
[  256.897909]  [<c04a3f20>] ? autoremove_wake_function+0x40/0x40 
[  256.948419]  [<c05ed8be>] __wait_on_buffer+0x2e/0x30 
[  256.999161]  [<c0690718>] jbd2_journal_commit_transaction+0x1188/0x1e30 
[  257.063680]  [<c04624f1>] ? del_timer_sync+0xb1/0xd0 
[  257.113830]  [<c0462440>] ? try_to_del_timer_sync+0x80/0x80 
[  257.168516]  [<c0695084>] kjournald2+0x134/0x3c0 
[  257.214479]  [<c04a3ee0>] ? abort_exclusive_wait+0x90/0x90 
[  257.301495]  [<c0694f50>] ? commit_timeout+0x10/0x10 
[  257.389605]  [<c047bf6c>] kthread+0xbc/0xd0 
[  257.431774]  [<c0af3941>] ret_from_kernel_thread+0x21/0x30 
[  257.482826]  [<c047beb0>] ? insert_kthread_work+0x70/0x70 
[  257.529782] INFO: lockdep is turned off. 
[  257.567133] INFO: task systemd-journal:1172 blocked for more than 120 seconds. 
[  257.632217]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  257.685197] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  257.753299] systemd-journal D 00000000  5452  1172      1 0x00000000 
[  257.838344]  dfbb1e9c 00000092 00000000 00000000 00000000 c1058500 f59d58e0 00000001 
[  257.969171]  c1058500 f0b39500 f59d5640 dfb74c4c 00000000 24774c8a 00000000 00000246 
[  258.039155]  24774c8a 00000000 00000246 00000000 dfbb1ea4 dfbb1ea4 00000086 00000001 
[  258.112621] Call Trace: 
[  258.139155]  [<c06039ab>] ? ep_scan_ready_list+0x1cb/0x270 
[  258.190137]  [<c0ae5a3a>] schedule_preempt_disabled+0x2a/0x80 
[  258.245544]  [<c0ae787a>] mutex_lock_nested+0x16a/0x3d0 
[  258.295446]  [<c06039ab>] ? ep_scan_ready_list+0x1cb/0x270 
[  258.345850]  [<c06039ab>] ? ep_scan_ready_list+0x1cb/0x270 
[  258.455611]  [<c06039ab>] ep_scan_ready_list+0x1cb/0x270 
[  258.528340]  [<c0604370>] ? ep_eventpoll_release+0x20/0x20 
[  258.577954]  [<c0603b6a>] ep_poll+0xea/0x3d0 
[  258.619758]  [<c0578b41>] ? might_fault+0x51/0xb0 
[  258.659255]  [<c05d740a>] ? __fget_light+0x6a/0x130 
[  258.701921]  [<c0605919>] SyS_epoll_wait+0xa9/0xc0 
[  258.748549]  [<c0af39df>] sysenter_do_call+0x12/0x38 
[  258.792273] INFO: lockdep is turned off. 
[  258.828593] INFO: task systemd-udevd:1206 blocked for more than 120 seconds. 
[  258.907499]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  259.020844] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  259.121480] systemd-udevd   D 00000246  5500  1206      1 0x00000000 
[  259.178031]  dfba1dc8 00000086 00000000 00000246 00000000 c1058500 f5799100 00000000 
[  259.248469]  c1058500 f1071500 f5798e60 00000282 e8304bb0 e8304bb0 e8304ba0 00000001 
[  259.318547]  fa0fb0f1 00000000 00000246 00000000 dfba1dd0 dfba1dd0 00000082 00000001 
[  259.388827] Call Trace: 
[  259.412931]  [<c05c4590>] ? path_lookupat+0x8e0/0x10a0 
[  259.487432]  [<c0ae5a3a>] schedule_preempt_disabled+0x2a/0x80 
[  259.588341]  [<c0ae787a>] mutex_lock_nested+0x16a/0x3d0 
[  259.637901]  [<c05c4590>] ? path_lookupat+0x8e0/0x10a0 
[  259.683040]  [<c05c4590>] ? path_lookupat+0x8e0/0x10a0 
[  259.729095]  [<c05c4590>] path_lookupat+0x8e0/0x10a0 
[  259.774013]  [<c059dd52>] ? kmem_cache_alloc+0x1a2/0x310 
[  259.823994]  [<c05c20af>] ? getname_flags+0x3f/0x170 
[  259.875723]  [<c05c4d75>] filename_lookup+0x25/0xc0 
[  259.920123]  [<c05c8cd2>] user_path_at_empty+0x52/0xa0 
[  259.969386]  [<c05bbd6b>] ? cp_new_stat64+0x12b/0x150 
[  260.059023]  [<c05c8d3f>] user_path_at+0x1f/0x30 
[  260.136043]  [<c05bb7a8>] vfs_fstatat+0x58/0xb0 
[  260.179088]  [<c05bc381>] SyS_stat64+0x31/0x60 
[  260.223297]  [<c0733944>] ? trace_hardirqs_on_thunk+0xc/0x10 
[  260.277393]  [<c0af39df>] sysenter_do_call+0x12/0x38 
[  260.324970] INFO: lockdep is turned off. 
[  260.361480] INFO: task NetworkManager:1261 blocked for more than 120 seconds. 
[  260.427981]       Not tainted 3.15.0-0.rc0.git13.1.fc21.i686 #1 
[  260.484716] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[  260.606364] NetworkManager  D 00000000  4744  1261      1 0x00000000 
[  260.697437]  df54bb74 00200096 00000000 00000000 00000000 c1058500 df484a80 c048a5de 
[  260.770891]  c1058500 f11bf500 df4847e0 00000000 00000000 00000000 814ff4a9 df54bb74 
[  260.853225]  814ff4a9 00000000 00200246 00000000 df54bb7c df54bb7c 00200086 00000001 
[  260.922701] Call Trace: 
[  260.948268]  [<c048a5de>] ? update_rq_clock.part.86+0x23e/0x260 
[  261.006657]  [<c0600b21>] ? inotify_poll+0x31/0x50 
[  261.049743]  [<c0ae5a3a>] schedule_preempt_disabled+0x2a/0x80 
[  261.153024]  [<c0ae787a>] mutex_lock_nested+0x16a/0x3d0 
[  261.244768]  [<c0600b21>] ? inotify_poll+0x31/0x50 
[  261.289857]  [<c0600b21>] ? inotify_poll+0x31/0x50 
[  261.335722]  [<c0600b21>] inotify_poll+0x31/0x50 
[  261.377732]  [<c05ce20d>] do_sys_poll+0x2fd/0x560 
[  261.422350]  [<c099a8cd>] ? sock_sendmsg+0x7d/0xc0 
[  261.467362]  [<c05d71bd>] ? __fget+0x10d/0x2b0 
[  261.509281]  [<c099b8fe>] ? SYSC_sendto+0x10e/0x130 
[  261.555379]  [<c0578b41>] ? might_fault+0x51/0xb0 
[  261.614134]  [<c0578b41>] ? might_fault+0x51/0xb0 
[  261.705171]  [<c0578b97>] ? might_fault+0xa7/0xb0 
[  261.766303]  [<c0733f24>] ? _copy_from_user+0x54/0x60 
[  261.812414]  [<c099cbb4>] ? SYSC_socketcall+0x514/0x9c0 
[  261.859168]  [<c05cca10>] ? poll_select_copy_remaining+0x130/0x130 
[  261.918132]  [<c05cca10>] ? poll_select_copy_remaining+0x130/0x130 
[  261.976254]  [<c05cca10>] ? poll_select_copy_remaining+0x130/0x130 
[  262.030905]  [<c04ab036>] ? lock_release_holdtime.part.28+0x96/0xf0 
[  262.084699]  [<c0578b41>] ? might_fault+0x51/0xb0 
[  262.128325]  [<c0578b41>] ? might_fault+0x51/0xb0 
[  262.256548]  [<c0578b97>] ? might_fault+0xa7/0xb0 
[  262.337737]  [<c0733eb0>] ? _copy_to_user+0x40/0x60 
[  262.382325]  [<c05ce53a>] SyS_poll+0x5a/0x110 
[  262.422818]  [<c0af39df>] sysenter_do_call+0x12/0x38 
[  262.466898] INFO: lockdep is turned off. 
[  350.394510] INFO: rcu_sched detected stalls on CPUs/tasks: {} (detected by 6, t=260087 jiffies, g=4371, c=4370, q=700) 
[  350.553683] INFO: Stall ended before state dump start 
[-- MARK -- Tue Apr 15 09:35:00 2014] 
[  545.304839] INFO: rcu_sched detected stalls on CPUs/tasks: {} (detected by 2, t=455114 jiffies, g=4371, c=4370, q=1194) 
[  545.460324] INFO: Stall ended before state dump start 
[-- MARK -- Tue Apr 15 09:40:00 2014] 
[-- MARK -- Tue Apr 15 09:45:00 2014] 
[-- MARK -- Tue Apr 15 09:50:00 2014] 
[-- MARK -- Tue Apr 15 09:55:00 2014] 
[-- MARK -- Tue Apr 15 10:00:00 2014] 
[-- MARK -- Tue Apr 15 10:05:00 2014] 
[-- MARK -- Tue Apr 15 10:10:00 2014]

Comment 2 Tej Parkash 2014-04-24 06:14:26 UTC
Created attachment 889190 [details]
RCU Lockdep Issue

Hi All, 

I have attached a proposed patch to fix the rcu warning issue with cnic driver. As we are not able to create the issue internally, we request the redhat team to test the same and let us know if it fixes this issue.

Apple the patch as follows:
cd /path/to/top/linux/source/dir
git am /path/to/0001-cnic-Fix-RCU-dereference-usage.patch

Hope this helps

Thanks
Tej

Comment 3 Tej Parkash 2014-05-22 04:44:36 UTC
Hi All, 

Do we have any update on test result with the patch provided.

Thanks
Tej

Comment 4 Jaroslav Reznik 2015-03-03 15:42:16 UTC
This bug appears to have been reported against 'rawhide' during the Fedora 22 development cycle.
Changing version to '22'.

More information and reason for this action is here:
https://fedoraproject.org/wiki/Fedora_Program_Management/HouseKeeping/Fedora22

Comment 5 Justin M. Forbes 2015-10-20 19:32:18 UTC
*********** MASS BUG UPDATE **************

We apologize for the inconvenience.  There is a large number of bugs to go through and several of them have gone stale.  Due to this, we are doing a mass bug update across all of the Fedora 22 kernel bugs.

Fedora 22 has now been rebased to 4.2.3-200.fc22.  Please test this kernel update (or newer) and let us know if you issue has been resolved or if it is still present with the newer kernel.

If you have moved on to Fedora 23, and are still experiencing this issue, please change the version to Fedora 23.

If you experience different issues, please open a new bug report for those.

Comment 6 Fedora Kernel Team 2015-11-23 17:18:25 UTC
*********** MASS BUG UPDATE **************
This bug is being closed with INSUFFICIENT_DATA as there has not been a response in over 4 weeks. If you are still experiencing this issue, please reopen and attach the relevant data from the latest kernel you are running and any data that might have been requested previously.


Note You need to log in before you can comment on or make changes to this bug.