Attachment 626006 Details for Bug 865813 – soft lockup

soft lockup

bnx2i_soft_lockup.txt (text/plain), 37.70 KB, created by Bruno Goncalves on 2012-10-12 13:51:19 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Bruno Goncalves

Created: 2012-10-12 13:51:19 UTC

Size: 37.70 KB

patch

obsolete

>scsi: host 4 channel 0 id 1 lun1019 has a LUN larger than allowed by the host adapter
>scsi: host 4 channel 0 id 1 lun1020 has a LUN larger than allowed by the host adapter
>scsi: host 4 channel 0 id 1 lun1021 has a LUN larger than allowed by the host adapter
>scsi: host 4 channel 0 id 1 lun1022 has a LUN larger than allowed by the host adapter
>scsi: host 4 channel 0 id 1 lun1023 has a LUN larger than allowed by the host adapter
>sd 4:0:0:23: [sdy] 2097152 512-byte logical blocks: (1.07 GB/1.00 GiB)
>sd 4:0:0:23: [sdy] 4096-byte physical blocks
>sd 4:0:0:23: [sdy] Write Protect is off
>sd 4:0:0:23: [sdy] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
>sd 4:0:0:24: [sdz] 2097152 512-byte logical blocks: (1.07 GB/1.00 GiB)
>sd 4:0:0:24: [sdz] 4096-byte physical blocks
>sd 4:0:0:24: [sdz] Write Protect is off
>sd 4:0:0:24: [sdz] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
> connection1:0: ping timeout of 5 secs expired, recv timeout 5, last rx 4294720959, last ping 4294725959, now 4294730959
> connection1:0: detected conn error (1011)
>BUG: soft lockup - CPU#0 stuck for 67s! [async/24:3353]
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>CPU 0 
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>
>Pid: 3353, comm: async/24 Not tainted 2.6.32-330.el6.x86_64 #1 HP ProLiant DL385 G7
>RIP: 0010:[<ffffffff8151f67a>]  [<ffffffff8151f67a>] lock_kernel+0x2a/0x50
>RSP: 0018:ffff88082b99dd20  EFLAGS: 00000283
>RAX: 0000000000000000 RBX: ffff88082b99dd20 RCX: 0000000000001cff
>RDX: 0000000000001d13 RSI: 0000000000000004 RDI: ffff88083fc23940
>RBP: ffffffff8100bc0e R08: 0000000000000004 R09: ffff88203f804ba0
>R10: 0000000000000004 R11: 0000000000000000 R12: 0000000000000001
>R13: ffffffff8121f760 R14: ffff88082b99dcb0 R15: ffff88103fc26800
>FS:  00007f4ed4a5d700(0000) GS:ffff880028200000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
>CR2: 00007f171021a750 CR3: 000000102afaa000 CR4: 00000000000006f0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Process async/24 (pid: 3353, threadinfo ffff88082b99c000, task ffff88082ad72040)
>Stack:
> ffff88082b99dd80 ffffffff811bde90 ffff88082be30470 0000000100000000
><d> ffff88082b99dd60 ffffffff8127df77 ffff88082b99dd70 ffff88082be30400
><d> ffff880819f26bc0 ffff88082be30470 ffff880829784138 ffff88082b99de80
>Call Trace:
> [<ffffffff811bde90>] ? __blkdev_get+0x50/0x3b0
> [<ffffffff8127df77>] ? kobject_put+0x27/0x60
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811f7005>] ? register_disk+0x155/0x170
> [<ffffffff81269f96>] ? add_disk+0xa6/0x1a0
> [<ffffffffa03baa1b>] ? sd_probe_async+0x13b/0x210 [sd_mod]
> [<ffffffff810946d6>] ? add_wait_queue+0x46/0x60
> [<ffffffff8109c6d8>] ? async_thread+0x108/0x280
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8109c5d0>] ? async_thread+0x0/0x280
> [<ffffffff81094006>] ? kthread+0x96/0xa0
> [<ffffffff8100c14a>] ? child_rip+0xa/0x20
> [<ffffffff81093f70>] ? kthread+0x0/0xa0
> [<ffffffff8100c140>] ? child_rip+0x0/0x20
>Code: 00 55 65 48 8b 04 25 c0 cb 00 00 8b 40 1c 48 89 e5 83 c0 01 75 2d ba 00 00 01 00 f0 0f c1 15 0e 4b 56 00 0f b7 ca c1 ea 10 39 d1 <74> 16 f3 90 0f b7 0d fb 4a 56 00 eb f1 83 3d f2 4a 56 00 00 75 
>Call Trace:
> [<ffffffff811bde90>] ? __blkdev_get+0x50/0x3b0
> [<ffffffff8127df77>] ? kobject_put+0x27/0x60
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811f7005>] ? register_disk+0x155/0x170
> [<ffffffff81269f96>] ? add_disk+0xa6/0x1a0
> [<ffffffffa03baa1b>] ? sd_probe_async+0x13b/0x210 [sd_mod]
> [<ffffffff810946d6>] ? add_wait_queue+0x46/0x60
> [<ffffffff8109c6d8>] ? async_thread+0x108/0x280
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8109c5d0>] ? async_thread+0x0/0x280
> [<ffffffff81094006>] ? kthread+0x96/0xa0
> [<ffffffff8100c14a>] ? child_rip+0xa/0x20
> [<ffffffff81093f70>] ? kthread+0x0/0xa0
> [<ffffffff8100c140>] ? child_rip+0x0/0x20
>
>sd 4:0:1:342: [sdafy] Write Protect is off
>sd 4:0:1:342: [sdafy] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
> sdaex:
> sdadt: unknown partition table
> sdaem:
>BUG: soft lockup - CPU#5 stuck for 67s! [scsi_id:4434]
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>CPU 5 
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>
>Pid: 4434, comm: scsi_id Not tainted 2.6.32-330.el6.x86_64 #1 HP ProLiant DL385 G7
>RIP: 0010:[<ffffffff8151f6e8>]  [<ffffffff8151f6e8>] __reacquire_kernel_lock+0x48/0x87
>RSP: 0018:ffff88080d7a5b08  EFLAGS: 00000246
>RAX: 0000000000000000 RBX: ffff88080d7a5b08 RCX: 000000005ab25a00
>RDX: ffff88080d7a5fd8 RSI: ffff88202bb70aa0 RDI: ffff88080d77c080
>RBP: ffffffff8100bc0e R08: ffff88080d7a4000 R09: 0000000000000000
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff88185c496768
>R13: ffff88082abc60c8 R14: ffffffff81282bde R15: ffff88080d7a5a78
>FS:  00007f4b3c4b9700(0000) GS:ffff88185c480000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f171095ef56 CR3: 000000202b860000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Process scsi_id (pid: 4434, threadinfo ffff88080d7a4000, task ffff88080d77c080)
>Stack:
> ffff88080d7a5bc8 ffffffff8151d183 ffff88080d7a5b88 ffffffff81167f07
><d> ffff881840010e40 ffff880800000040 ffff880800000009 0000000000000003
><d> ffff88080d77c638 ffff88080d7a5fd8 000000000000fb88 ffff88080d77c640
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffff81167f07>] ? cache_grow+0x217/0x320
> [<ffffffff81169132>] ? kmem_cache_alloc+0x182/0x190
> [<ffffffff8106231a>] ? __cond_resched+0x2a/0x40
> [<ffffffff8151d4e0>] ? _cond_resched+0x30/0x40
> [<ffffffff8151e00e>] ? mutex_lock+0x1e/0x50
> [<ffffffff8136ae49>] ? kobj_lookup+0x59/0x1f0
> [<ffffffff81269b6b>] ? get_gendisk+0xcb/0xf0
> [<ffffffff811bdf6a>] ? __blkdev_get+0x12a/0x3b0
> [<ffffffff811be210>] ? blkdev_open+0x0/0xc0
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811be281>] ? blkdev_open+0x71/0xc0
> [<ffffffff8117f12a>] ? __dentry_open+0x10a/0x360
> [<ffffffff81227402>] ? selinux_inode_permission+0x72/0xb0
> [<ffffffff8121f43f>] ? security_inode_permission+0x1f/0x30
> [<ffffffff8117f494>] ? nameidata_to_filp+0x54/0x70
> [<ffffffff81194000>] ? do_filp_open+0x710/0xdd0
> [<ffffffff8104476c>] ? __do_page_fault+0x1ec/0x480
> [<ffffffff8127bfd1>] ? cpumask_any_but+0x31/0x50
> [<ffffffff811499a0>] ? unmap_region+0x110/0x130
> [<ffffffff811a0752>] ? alloc_fd+0x92/0x160
> [<ffffffff8117eed9>] ? do_sys_open+0x69/0x140
> [<ffffffff8117eff0>] ? sys_open+0x20/0x30
> [<ffffffff8100b0f2>] ? system_call_fastpath+0x16/0x1b
>Code: bf 4a 56 00 0f 94 c2 0f b6 c2 85 c0 75 51 65 48 8b 14 25 c8 cb 00 00 48 8b 82 38 e0 ff ff a8 08 74 14 eb 3f 0f 1f 80 00 00 00 00 <48> 8b 82 38 e0 ff ff a8 08 75 2d f3 90 8b 05 85 4a 56 00 89 c1 
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffff81167f07>] ? cache_grow+0x217/0x320
> [<ffffffff81169132>] ? kmem_cache_alloc+0x182/0x190
> [<ffffffff8106231a>] ? __cond_resched+0x2a/0x40
> [<ffffffff8151d4e0>] ? _cond_resched+0x30/0x40
> [<ffffffff8151e00e>] ? mutex_lock+0x1e/0x50
> [<ffffffff8136ae49>] ? kobj_lookup+0x59/0x1f0
> [<ffffffff81269b6b>] ? get_gendisk+0xcb/0xf0
> [<ffffffff811bdf6a>] ? __blkdev_get+0x12a/0x3b0
> [<ffffffff811be210>] ? blkdev_open+0x0/0xc0
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811be281>] ? blkdev_open+0x71/0xc0
> [<ffffffff8117f12a>] ? __dentry_open+0x10a/0x360
> [<ffffffff81227402>] ? selinux_inode_permission+0x72/0xb0
> [<ffffffff8121f43f>] ? security_inode_permission+0x1f/0x30
> [<ffffffff8117f494>] ? nameidata_to_filp+0x54/0x70
> [<ffffffff81194000>] ? do_filp_open+0x710/0xdd0
> [<ffffffff8104476c>] ? __do_page_fault+0x1ec/0x480
> [<ffffffff8127bfd1>] ? cpumask_any_but+0x31/0x50
> [<ffffffff811499a0>] ? unmap_region+0x110/0x130
> [<ffffffff811a0752>] ? alloc_fd+0x92/0x160
> [<ffffffff8117eed9>] ? do_sys_open+0x69/0x140
> [<ffffffff8117eff0>] ? sys_open+0x20/0x30
> [<ffffffff8100b0f2>] ? system_call_fastpath+0x16/0x1b
>BUG: soft lockup - CPU#7 stuck for 67s! [scsi_id:3992]
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>CPU 7 
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>
>Pid: 3992, comm: scsi_id Not tainted 2.6.32-330.el6.x86_64 #1 HP ProLiant DL385 G7
>RIP: 0010:[<ffffffff8151f6e8>]  [<ffffffff8151f6e8>] __reacquire_kernel_lock+0x48/0x87
>RSP: 0018:ffff88080f12d8a8  EFLAGS: 00000246
>RAX: 0000000000000000 RBX: ffff88080f12d8a8 RCX: 000000005ab25a00
>RDX: ffff88080f12dfd8 RSI: ffff88201577a080 RDI: ffff880828c4b500
>RBP: ffffffff8100bc0e R08: ffff88080f12c000 R09: 0000000000000000
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff88185c4d6768
>R13: ffff882004a11548 R14: ffffffff81282bde R15: ffff88080f12d818
>FS:  00007f67e42f3700(0000) GS:ffff88185c4c0000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007fef38fdf06d CR3: 000000182a1c8000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Process scsi_id (pid: 3992, threadinfo ffff88080f12c000, task ffff880828c4b500)
>Stack:
> ffff88080f12d968 ffffffff8151d183 ffff88080f12d938 ffffffffa001b9d4
><d> ffff881040010e00 0000000000000000 ffff88080f12d928 ffffffff8107f6b4
><d> ffff880828c4bab8 ffff88080f12dfd8 000000000000fb88 ffff880828c4bab8
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8107f6b4>] ? mod_timer+0x144/0x220
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8107e6fd>] ? del_timer+0x7d/0xe0
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff81266ca0>] ? blk_rq_map_user+0x1a0/0x280
> [<ffffffff8126b7b2>] ? sg_io+0x212/0x3d0
> [<ffffffff8126bd70>] ? scsi_cmd_ioctl+0x400/0x470
> [<ffffffffa03b63c6>] ? __scsi_disk_get+0x46/0x50 [sd_mod]
> [<ffffffff811bdfe9>] ? __blkdev_get+0x1a9/0x3b0
> [<ffffffff811be210>] ? blkdev_open+0x0/0xc0
> [<ffffffff8126be31>] ? scsi_cmd_blk_ioctl+0x51/0x70
> [<ffffffffa03b718f>] ? sd_ioctl+0xaf/0x110 [sd_mod]
> [<ffffffff8151f67a>] ? lock_kernel+0x2a/0x50
> [<ffffffff81268a77>] ? __blkdev_driver_ioctl+0x67/0x80
> [<ffffffff81268efd>] ? blkdev_ioctl+0x1ed/0x6e0
> [<ffffffff811bccbc>] ? block_ioctl+0x3c/0x40
> [<ffffffff81196062>] ? vfs_ioctl+0x22/0xa0
> [<ffffffff81196204>] ? do_vfs_ioctl+0x84/0x580
> [<ffffffff81196781>] ? sys_ioctl+0x81/0xa0
> [<ffffffff8100b0f2>] ? system_call_fastpath+0x16/0x1b
>Code: bf 4a 56 00 0f 94 c2 0f b6 c2 85 c0 75 51 65 48 8b 14 25 c8 cb 00 00 48 8b 82 38 e0 ff ff a8 08 74 14 eb 3f 0f 1f 80 00 00 00 00 <48> 8b 82 38 e0 ff ff a8 08 75 2d f3 90 8b 05 85 4a 56 00 89 c1 
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8107f6b4>] ? mod_timer+0x144/0x220
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8107e6fd>] ? del_timer+0x7d/0xe0
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff81266ca0>] ? blk_rq_map_user+0x1a0/0x280
> [<ffffffff8126b7b2>] ? sg_io+0x212/0x3d0
> [<ffffffff8126bd70>] ? scsi_cmd_ioctl+0x400/0x470
> [<ffffffffa03b63c6>] ? __scsi_disk_get+0x46/0x50 [sd_mod]
> [<ffffffff811bdfe9>] ? __blkdev_get+0x1a9/0x3b0
> [<ffffffff811be210>] ? blkdev_open+0x0/0xc0
> [<ffffffff8126be31>] ? scsi_cmd_blk_ioctl+0x51/0x70
> [<ffffffffa03b718f>] ? sd_ioctl+0xaf/0x110 [sd_mod]
> [<ffffffff8151f67a>] ? lock_kernel+0x2a/0x50
> [<ffffffff81268a77>] ? __blkdev_driver_ioctl+0x67/0x80
> [<ffffffff81268efd>] ? blkdev_ioctl+0x1ed/0x6e0
> [<ffffffff811bccbc>] ? block_ioctl+0x3c/0x40
> [<ffffffff81196062>] ? vfs_ioctl+0x22/0xa0
> [<ffffffff81196204>] ? do_vfs_ioctl+0x84/0x580
> [<ffffffff81196781>] ? sys_ioctl+0x81/0xa0
> [<ffffffff8100b0f2>] ? system_call_fastpath+0x16/0x1b
>BUG: soft lockup - CPU#21 stuck for 67s! [async/155:3489]
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>CPU 21 
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>
>Pid: 3489, comm: async/155 Not tainted 2.6.32-330.el6.x86_64 #1 HP ProLiant DL385 G7
>RIP: 0010:[<ffffffff8151f6f5>]  [<ffffffff8151f6f5>] __reacquire_kernel_lock+0x55/0x87
>RSP: 0018:ffff8820075a1760  EFLAGS: 00000246
>RAX: 0000000000000080 RBX: ffff8820075a1760 RCX: 000000005ab25a00
>RDX: ffff8820075a1fd8 RSI: ffff8818298dc040 RDI: ffff882004977500
>RBP: ffffffff8100bc0e R08: ffff8820075a0000 R09: 0000000000000000
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff8820075a16f0
>R13: ffff88105c716768 R14: ffff8818298dc088 R15: ffffffff81282bde
>FS:  00007f9374475700(0000) GS:ffff88105c700000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
>CR2: 00007fb1cb17b06d CR3: 000000182a11d000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Process async/155 (pid: 3489, threadinfo ffff8820075a0000, task ffff882004977500)
>Stack:
> ffff8820075a1820 ffffffff8151d183 ffff88182a06c0c8 ffff88182aae8060
><d> ffff881800000001 ffff88082b105000 ffff88182a195e80 0000002000000001
><d> ffff882004977ab8 ffff8820075a1fd8 000000000000fb88 ffff882004977ab8
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffff8137b840>] ? scsi_done+0x0/0x60
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8127df77>] ? kobject_put+0x27/0x60
> [<ffffffff81363b37>] ? put_device+0x17/0x20
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff812618a0>] ? blk_rq_bio_prep+0x30/0xc0
> [<ffffffff81266a86>] ? blk_rq_map_kern+0xd6/0x150
> [<ffffffff81384ec8>] ? scsi_execute+0xe8/0x180
> [<ffffffff81385158>] ? scsi_execute_req+0xb8/0x190
> [<ffffffffa03b759a>] ? read_capacity_16+0xba/0x3d0 [sd_mod]
> [<ffffffff81385173>] ? scsi_execute_req+0xd3/0x190
> [<ffffffffa03b9563>] ? sd_revalidate_disk+0x583/0x1900 [sd_mod]
> [<ffffffff811bc940>] ? bdev_test+0x0/0x20
> [<ffffffff8119f159>] ? iget5_locked+0x59/0x1b0
> [<ffffffff811840b1>] ? get_super+0x31/0xd0
> [<ffffffff81190000>] ? path_init+0x60/0x220
> [<ffffffff811f7a89>] ? rescan_partitions+0xb9/0x470
> [<ffffffff81363d09>] ? get_device+0x19/0x20
> [<ffffffffa03b7371>] ? sd_open+0x81/0x1f0 [sd_mod]
> [<ffffffff811bdff6>] ? __blkdev_get+0x1b6/0x3b0
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811f7005>] ? register_disk+0x155/0x170
> [<ffffffff81269f96>] ? add_disk+0xa6/0x1a0
> [<ffffffffa03baa1b>] ? sd_probe_async+0x13b/0x210 [sd_mod]
> [<ffffffff810946d6>] ? add_wait_queue+0x46/0x60
> [<ffffffff8109c6d8>] ? async_thread+0x108/0x280
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8109c5d0>] ? async_thread+0x0/0x280
> [<ffffffff81094006>] ? kthread+0x96/0xa0
> [<ffffffff8100c14a>] ? child_rip+0xa/0x20
> [<ffffffff81093f70>] ? kthread+0x0/0xa0
> [<ffffffff8100c140>] ? child_rip+0x0/0x20
>Code: 51 65 48 8b 14 25 c8 cb 00 00 48 8b 82 38 e0 ff ff a8 08 74 14 eb 3f 0f 1f 80 00 00 00 00 48 8b 82 38 e0 ff ff a8 08 75 2d f3 90 <8b> 05 85 4a 56 00 89 c1 c1 c0 10 39 c1 8d 88 00 00 01 00 75 08 
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffff8137b840>] ? scsi_done+0x0/0x60
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8127df77>] ? kobject_put+0x27/0x60
> [<ffffffff81363b37>] ? put_device+0x17/0x20
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff812618a0>] ? blk_rq_bio_prep+0x30/0xc0
> [<ffffffff81266a86>] ? blk_rq_map_kern+0xd6/0x150
> [<ffffffff81384ec8>] ? scsi_execute+0xe8/0x180
> [<ffffffff81385158>] ? scsi_execute_req+0xb8/0x190
> [<ffffffffa03b759a>] ? read_capacity_16+0xba/0x3d0 [sd_mod]
> [<ffffffff81385173>] ? scsi_execute_req+0xd3/0x190
> [<ffffffffa03b9563>] ? sd_revalidate_disk+0x583/0x1900 [sd_mod]
> [<ffffffff811bc940>] ? bdev_test+0x0/0x20
> [<ffffffff8119f159>] ? iget5_locked+0x59/0x1b0
> [<ffffffff811840b1>] ? get_super+0x31/0xd0
> [<ffffffff81190000>] ? path_init+0x60/0x220
> [<ffffffff811f7a89>] ? rescan_partitions+0xb9/0x470
> [<ffffffff81363d09>] ? get_device+0x19/0x20
> [<ffffffffa03b7371>] ? sd_open+0x81/0x1f0 [sd_mod]
> [<ffffffff811bdff6>] ? __blkdev_get+0x1b6/0x3b0
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811f7005>] ? register_disk+0x155/0x170
> [<ffffffff81269f96>] ? add_disk+0xa6/0x1a0
> [<ffffffffa03baa1b>] ? sd_probe_async+0x13b/0x210 [sd_mod]
> [<ffffffff810946d6>] ? add_wait_queue+0x46/0x60
> [<ffffffff8109c6d8>] ? async_thread+0x108/0x280
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8109c5d0>] ? async_thread+0x0/0x280
> [<ffffffff81094006>] ? kthread+0x96/0xa0
> [<ffffffff8100c14a>] ? child_rip+0xa/0x20
> [<ffffffff81093f70>] ? kthread+0x0/0xa0
> [<ffffffff8100c140>] ? child_rip+0x0/0x20
>BUG: soft lockup - CPU#22 stuck for 67s! [async/75:3408]
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>CPU 22 
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>
>Pid: 3408, comm: async/75 Not tainted 2.6.32-330.el6.x86_64 #1 HP ProLiant DL385 G7
>RIP: 0010:[<ffffffff8151f6f5>]  [<ffffffff8151f6f5>] __reacquire_kernel_lock+0x55/0x87
>RSP: 0018:ffff88200f841780  EFLAGS: 00000246
>RAX: 0000000000000080 RBX: ffff88200f841780 RCX: 000000005ab25a00
>RDX: ffff88200f841fd8 RSI: ffff88201341c040 RDI: ffff88202b766ae0
>RBP: ffffffff8100bc0e R08: ffff88200f840000 R09: 0000000000000000
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff88200f841710
>R13: ffff88085c556768 R14: ffff88200f994b28 R15: ffffffff81282bde
>FS:  00007f120dbae700(0000) GS:ffff88085c540000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
>CR2: 00007fee603f806d CR3: 000000102ad29000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Process async/75 (pid: 3408, threadinfo ffff88200f840000, task ffff88202b766ae0)
>Stack:
> ffff88200f841840 ffffffff8151d183 ffff88082bb432b8 ffff88102b7a15e0
><d> ffff881000000001 ffff880829ed4000 ffff88102ce29280 0000004000000001
><d> ffff88202b767098 ffff88200f841fd8 000000000000fb88 ffff88202b767098
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffff8137b840>] ? scsi_done+0x0/0x60
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8127df77>] ? kobject_put+0x27/0x60
> [<ffffffff81363b37>] ? put_device+0x17/0x20
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff81384ec8>] ? scsi_execute+0xe8/0x180
> [<ffffffff813851c0>] ? scsi_execute_req+0x120/0x190
> [<ffffffff8137b42e>] ? scsi_vpd_inquiry+0x6e/0xb0
> [<ffffffff8137b495>] ? scsi_get_vpd_page+0x25/0xa0
> [<ffffffffa03b98dc>] ? sd_revalidate_disk+0x8fc/0x1900 [sd_mod]
> [<ffffffff811bc940>] ? bdev_test+0x0/0x20
> [<ffffffff8119f159>] ? iget5_locked+0x59/0x1b0
> [<ffffffff811840b1>] ? get_super+0x31/0xd0
> [<ffffffff81190000>] ? path_init+0x60/0x220
> [<ffffffff811f7a89>] ? rescan_partitions+0xb9/0x470
> [<ffffffff81363d09>] ? get_device+0x19/0x20
> [<ffffffffa03b7371>] ? sd_open+0x81/0x1f0 [sd_mod]
> [<ffffffff811bdff6>] ? __blkdev_get+0x1b6/0x3b0
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811f7005>] ? register_disk+0x155/0x170
> [<ffffffff81269f96>] ? add_disk+0xa6/0x1a0
> [<ffffffffa03baa1b>] ? sd_probe_async+0x13b/0x210 [sd_mod]
> [<ffffffff810946d6>] ? add_wait_queue+0x46/0x60
> [<ffffffff8109c6d8>] ? async_thread+0x108/0x280
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8109c5d0>] ? async_thread+0x0/0x280
> [<ffffffff81094006>] ? kthread+0x96/0xa0
> [<ffffffff8100c14a>] ? child_rip+0xa/0x20
> [<ffffffff81093f70>] ? kthread+0x0/0xa0
> [<ffffffff8100c140>] ? child_rip+0x0/0x20
>Code: 51 65 48 8b 14 25 c8 cb 00 00 48 8b 82 38 e0 ff ff a8 08 74 14 eb 3f 0f 1f 80 00 00 00 00 48 8b 82 38 e0 ff ff a8 08 75 2d f3 90 <8b> 05 85 4a 56 00 89 c1 c1 c0 10 39 c1 8d 88 00 00 01 00 75 08 
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffff8137b840>] ? scsi_done+0x0/0x60
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8127df77>] ? kobject_put+0x27/0x60
> [<ffffffff81363b37>] ? put_device+0x17/0x20
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff81384ec8>] ? scsi_execute+0xe8/0x180
> [<ffffffff813851c0>] ? scsi_execute_req+0x120/0x190
> [<ffffffff8137b42e>] ? scsi_vpd_inquiry+0x6e/0xb0
> [<ffffffff8137b495>] ? scsi_get_vpd_page+0x25/0xa0
> [<ffffffffa03b98dc>] ? sd_revalidate_disk+0x8fc/0x1900 [sd_mod]
> [<ffffffff811bc940>] ? bdev_test+0x0/0x20
> [<ffffffff8119f159>] ? iget5_locked+0x59/0x1b0
> [<ffffffff811840b1>] ? get_super+0x31/0xd0
> [<ffffffff81190000>] ? path_init+0x60/0x220
> [<ffffffff811f7a89>] ? rescan_partitions+0xb9/0x470
> [<ffffffff81363d09>] ? get_device+0x19/0x20
> [<ffffffffa03b7371>] ? sd_open+0x81/0x1f0 [sd_mod]
> [<ffffffff811bdff6>] ? __blkdev_get+0x1b6/0x3b0
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811f7005>] ? register_disk+0x155/0x170
> [<ffffffff81269f96>] ? add_disk+0xa6/0x1a0
> [<ffffffffa03baa1b>] ? sd_probe_async+0x13b/0x210 [sd_mod]
> [<ffffffff810946d6>] ? add_wait_queue+0x46/0x60
> [<ffffffff8109c6d8>] ? async_thread+0x108/0x280
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8109c5d0>] ? async_thread+0x0/0x280
> [<ffffffff81094006>] ? kthread+0x96/0xa0
> [<ffffffff8100c14a>] ? child_rip+0xa/0x20
> [<ffffffff81093f70>] ? kthread+0x0/0xa0
> [<ffffffff8100c140>] ? child_rip+0x0/0x20
>BUG: soft lockup - CPU#23 stuck for 67s! [async/223:3557]
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>CPU 23 
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>
>Pid: 3557, comm: async/223 Not tainted 2.6.32-330.el6.x86_64 #1 HP ProLiant DL385 G7
>RIP: 0010:[<ffffffff8151f6f1>]  [<ffffffff8151f6f1>] __reacquire_kernel_lock+0x51/0x87
>RSP: 0018:ffff881ffffc3810  EFLAGS: 00000246
>RAX: 0000000000000080 RBX: ffff881ffffc3810 RCX: 000000005ab25a00
>RDX: ffff881ffffc3fd8 RSI: ffff88200f8d2aa0 RDI: ffff882007561540
>RBP: ffffffff8100bc0e R08: ffff881ffffc2000 R09: 0000000000000000
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff881ffffc37a0
>R13: ffff88105c756768 R14: ffff88080291d588 R15: ffffffff81282b4c
>FS:  00007fb33a95b740(0000) GS:ffff88105c740000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
>CR2: 00007f171095ef56 CR3: 000000182a4e5000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Process async/223 (pid: 3557, threadinfo ffff881ffffc2000, task ffff882007561540)
>Stack:
> ffff881ffffc38d0 ffffffff8151d183 ffff88082a338ab8 ffff88182acccd00
><d> 0000000000000000 ffff88082a1b1000 ffff88182abe1880 0000000000000000
><d> ffff882007561af8 ffff881ffffc3fd8 000000000000fb88 ffff882007561af8
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffff8137b840>] ? scsi_done+0x0/0x60
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8127df77>] ? kobject_put+0x27/0x60
> [<ffffffff81363b37>] ? put_device+0x17/0x20
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff81263326>] ? blk_get_request+0x46/0xa0
> [<ffffffff81384ec8>] ? scsi_execute+0xe8/0x180
> [<ffffffff81385158>] ? scsi_execute_req+0xb8/0x190
> [<ffffffffa03b9138>] ? sd_revalidate_disk+0x158/0x1900 [sd_mod]
> [<ffffffff811bc940>] ? bdev_test+0x0/0x20
> [<ffffffff8119f159>] ? iget5_locked+0x59/0x1b0
> [<ffffffff811840b1>] ? get_super+0x31/0xd0
> [<ffffffff81190000>] ? path_init+0x60/0x220
> [<ffffffff811f7a89>] ? rescan_partitions+0xb9/0x470
> [<ffffffff81363d09>] ? get_device+0x19/0x20
> [<ffffffffa03b7371>] ? sd_open+0x81/0x1f0 [sd_mod]
> [<ffffffff811bdff6>] ? __blkdev_get+0x1b6/0x3b0
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811f7005>] ? register_disk+0x155/0x170
> [<ffffffff81269f96>] ? add_disk+0xa6/0x1a0
> [<ffffffffa03baa1b>] ? sd_probe_async+0x13b/0x210 [sd_mod]
> [<ffffffff810946d6>] ? add_wait_queue+0x46/0x60
> [<ffffffff8109c6d8>] ? async_thread+0x108/0x280
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8109c5d0>] ? async_thread+0x0/0x280
> [<ffffffff81094006>] ? kthread+0x96/0xa0
> [<ffffffff8100c14a>] ? child_rip+0xa/0x20
> [<ffffffff81093f70>] ? kthread+0x0/0xa0
> [<ffffffff8100c140>] ? child_rip+0x0/0x20
>Code: c2 85 c0 75 51 65 48 8b 14 25 c8 cb 00 00 48 8b 82 38 e0 ff ff a8 08 74 14 eb 3f 0f 1f 80 00 00 00 00 48 8b 82 38 e0 ff ff a8 08 <75> 2d f3 90 8b 05 85 4a 56 00 89 c1 c1 c0 10 39 c1 8d 88 00 00 
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffff8137b840>] ? scsi_done+0x0/0x60
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8127df77>] ? kobject_put+0x27/0x60
> [<ffffffff81363b37>] ? put_device+0x17/0x20
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff81263326>] ? blk_get_request+0x46/0xa0
> [<ffffffff81384ec8>] ? scsi_execute+0xe8/0x180
> [<ffffffff81385158>] ? scsi_execute_req+0xb8/0x190
> [<ffffffffa03b9138>] ? sd_revalidate_disk+0x158/0x1900 [sd_mod]
> [<ffffffff811bc940>] ? bdev_test+0x0/0x20
> [<ffffffff8119f159>] ? iget5_locked+0x59/0x1b0
> [<ffffffff811840b1>] ? get_super+0x31/0xd0
> [<ffffffff81190000>] ? path_init+0x60/0x220
> [<ffffffff811f7a89>] ? rescan_partitions+0xb9/0x470
> [<ffffffff81363d09>] ? get_device+0x19/0x20
> [<ffffffffa03b7371>] ? sd_open+0x81/0x1f0 [sd_mod]
> [<ffffffff811bdff6>] ? __blkdev_get+0x1b6/0x3b0
> [<ffffffff811be200>] ? blkdev_get+0x10/0x20
> [<ffffffff811f7005>] ? register_disk+0x155/0x170
> [<ffffffff81269f96>] ? add_disk+0xa6/0x1a0
> [<ffffffffa03baa1b>] ? sd_probe_async+0x13b/0x210 [sd_mod]
> [<ffffffff810946d6>] ? add_wait_queue+0x46/0x60
> [<ffffffff8109c6d8>] ? async_thread+0x108/0x280
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8109c5d0>] ? async_thread+0x0/0x280
> [<ffffffff81094006>] ? kthread+0x96/0xa0
> [<ffffffff8100c14a>] ? child_rip+0xa/0x20
> [<ffffffff81093f70>] ? kthread+0x0/0xa0
> [<ffffffff8100c140>] ? child_rip+0x0/0x20
> connection1:0: ping timeout of 5 secs expired, recv timeout 5, last rx 4295158955, last ping 4295163955, now 4295168955
> connection1:0: detected conn error (1011)
>BUG: soft lockup - CPU#11 stuck for 67s! [scsi_id:3620]
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>CPU 11 
>Modules linked in: ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr power_meter hpilo hpwdt microcode serio_raw sg k10temp amd64_edac_mod edac_core edac_mce_amd i2c_piix4 shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa bnx2 pata_acpi ata_generic pata_atiixp ahci radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod iscsi_tcp iscsi_ibft be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: mperf]
>
>Pid: 3620, comm: scsi_id Not tainted 2.6.32-330.el6.x86_64 #1 HP ProLiant DL385 G7
>RIP: 0010:[<ffffffff8151f6fb>]  [<ffffffff8151f6fb>] __reacquire_kernel_lock+0x5b/0x87
>RSP: 0018:ffff88202aaeb8a8  EFLAGS: 00000246
>RAX: 000000005abd5ab1 RBX: ffff88202aaeb8a8 RCX: 000000005ab25a00
>RDX: ffff88202aaebfd8 RSI: ffff88200a42c040 RDI: ffff88200fb28aa0
>RBP: ffffffff8100bc0e R08: ffff88202aaea000 R09: 0000000000000000
>R10: 0000000000000000 R11: 0000000000000000 R12: ffff88185c556768
>R13: ffff88081e7a60c8 R14: ffffffff81282bde R15: ffff88202aaeb818
>FS:  00007f18737ca700(0000) GS:ffff88185c540000(0000) knlGS:0000000000000000
>CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>CR2: 00007f8473e8c000 CR3: 0000001fecde2000 CR4: 00000000000006e0
>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>Process scsi_id (pid: 3620, threadinfo ffff88202aaea000, task ffff88200fb28aa0)
>Stack:
> ffff88202aaeb968 ffffffff8151d183 ffff88202aaeb938 ffffffffa001b9d4
><d> ffff88202aaeb8d8 0000000000000086 ffff88202aaeb928 ffffffff8107f6b4
><d> ffff88200fb29058 ffff88202aaebfd8 000000000000fb88 ffff88200fb29058
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8107f6b4>] ? mod_timer+0x144/0x220
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8107e6fd>] ? del_timer+0x7d/0xe0
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff81266ca0>] ? blk_rq_map_user+0x1a0/0x280
> [<ffffffff8126b7b2>] ? sg_io+0x212/0x3d0
> [<ffffffff8126bd70>] ? scsi_cmd_ioctl+0x400/0x470
> [<ffffffffa03b63c6>] ? __scsi_disk_get+0x46/0x50 [sd_mod]
> [<ffffffff811bdfe9>] ? __blkdev_get+0x1a9/0x3b0
> [<ffffffff811be210>] ? blkdev_open+0x0/0xc0
> [<ffffffff8126be31>] ? scsi_cmd_blk_ioctl+0x51/0x70
> [<ffffffffa03b718f>] ? sd_ioctl+0xaf/0x110 [sd_mod]
> [<ffffffff81268a77>] ? __blkdev_driver_ioctl+0x67/0x80
> [<ffffffff81268efd>] ? blkdev_ioctl+0x1ed/0x6e0
> [<ffffffff811bccbc>] ? block_ioctl+0x3c/0x40
> [<ffffffff81196062>] ? vfs_ioctl+0x22/0xa0
> [<ffffffff81196204>] ? do_vfs_ioctl+0x84/0x580
> [<ffffffff81196781>] ? sys_ioctl+0x81/0xa0
> [<ffffffff8100b0f2>] ? system_call_fastpath+0x16/0x1b
>Code: c8 cb 00 00 48 8b 82 38 e0 ff ff a8 08 74 14 eb 3f 0f 1f 80 00 00 00 00 48 8b 82 38 e0 ff ff a8 08 75 2d f3 90 8b 05 85 4a 56 00 <89> c1 c1 c0 10 39 c1 8d 88 00 00 01 00 75 08 f0 0f b1 0d 6e 4a 
>Call Trace:
> [<ffffffff8151d183>] ? thread_return+0x6b1/0x76e
> [<ffffffffa001b9d4>] ? iscsi_queuecommand+0x334/0x520 [libiscsi]
> [<ffffffff8107f6b4>] ? mod_timer+0x144/0x220
> [<ffffffff8151d995>] ? schedule_timeout+0x215/0x2e0
> [<ffffffff8107e6fd>] ? del_timer+0x7d/0xe0
> [<ffffffff8151d613>] ? wait_for_common+0x123/0x180
> [<ffffffff81060370>] ? default_wake_function+0x0/0x20
> [<ffffffff8151d72d>] ? wait_for_completion+0x1d/0x20
> [<ffffffff81266f6c>] ? blk_execute_rq+0x8c/0xf0
> [<ffffffff81266ca0>] ? blk_rq_map_user+0x1a0/0x280
> [<ffffffff8126b7b2>] ? sg_io+0x212/0x3d0
> [<ffffffff8126bd70>] ? scsi_cmd_ioctl+0x400/0x470
> [<ffffffffa03b63c6>] ? __scsi_disk_get+0x46/0x50 [sd_mod]
> [<ffffffff811bdfe9>] ? __blkdev_get+0x1a9/0x3b0
> [<ffffffff811be210>] ? blkdev_open+0x0/0xc0
> [<ffffffff8126be31>] ? scsi_cmd_blk_ioctl+0x51/0x70
> [<ffffffffa03b718f>] ? sd_ioctl+0xaf/0x110 [sd_mod]
> [<ffffffff81268a77>] ? __blkdev_driver_ioctl+0x67/0x80
> [<ffffffff81268efd>] ? blkdev_ioctl+0x1ed/0x6e0
> [<ffffffff811bccbc>] ? block_ioctl+0x3c/0x40
> [<ffffffff81196062>] ? vfs_ioctl+0x22/0xa0
> [<ffffffff81196204>] ? do_vfs_ioctl+0x84/0x580
> [<ffffffff81196781>] ? sys_ioctl+0x81/0xa0
> [<ffffffff8100b0f2>] ? system_call_fastpath+0x16/0x1b
>Clocksource tsc unstable (delta = -8589930837 ns).  Enable clocksource failover by adding clocksource_failover kernel parameter.
> sdk:
> sdaag: unknown partition table
> unknown partition table
> unknown partition table
> sdacx:

Actions: View

Attachments on bug 865813: 626006 | 1118676