Bug 723196

Summary: [lvm] vgs command stuck in D+
Product: Red Hat Enterprise Linux 6 Reporter: Haim <hateya>
Component: device-mapper-multipathAssignee: Ben Marzinski <bmarzins>
Status: CLOSED INSUFFICIENT_DATA QA Contact: Storage QE <storage-qe>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 6.2CC: agk, bazulay, bmarzins, bsettle, dwysocha, heinzm, jbrassow, mgoldboi, prajnoha, prockai, qcai, thornber, yeylon, zkabelac
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-09-30 14:24:14 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
lvm filter - vgs command none

Description Haim 2011-07-19 11:09:19 UTC
Created attachment 513771 [details]
lvm filter - vgs command

Description of problem:

case: 

running vgs command with specific filter reviles that vgs is stuck in D+ till timeout:

enabled kernel logging and got the following:

INFO: task lvm:9568 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
lvm           D 0000000000000004     0  9568   9567 0x00000080
 ffff8803894efb88 0000000000000082 0000000000000000 ffffffffa00040bc
 ffff8803ca012000 ffff8803dad85200 0000000000000001 00000001044f9add
 ffff8803874485f8 ffff8803894effd8 000000000000f598 ffff8803874485f8
Call Trace:
 [<ffffffffa00040bc>] ? dm_table_unplug_all+0x5c/0xd0 [dm_mod]
 [<ffffffff814db013>] io_schedule+0x73/0xc0
 [<ffffffff811abe3e>] __blockdev_direct_IO+0x70e/0xc40
 [<ffffffff811a9a87>] blkdev_direct_IO+0x57/0x60
 [<ffffffff811a8c50>] ? blkdev_get_blocks+0x0/0xc0
 [<ffffffff8110f0db>] generic_file_aio_read+0x6bb/0x700
 [<ffffffff8120c531>] ? avc_has_perm+0x71/0x90
 [<ffffffff8120605f>] ? security_inode_permission+0x1f/0x30
 [<ffffffff811723ea>] do_sync_read+0xfa/0x140
 [<ffffffff8108e100>] ? autoremove_wake_function+0x0/0x40
 [<ffffffff811a901c>] ? block_ioctl+0x3c/0x40
 [<ffffffff81184d92>] ? vfs_ioctl+0x22/0xa0
 [<ffffffff81211a8b>] ? selinux_file_permission+0xfb/0x150
 [<ffffffff81204ef6>] ? security_file_permission+0x16/0x20
 [<ffffffff81172e15>] vfs_read+0xb5/0x1a0
 [<ffffffff810d1ac2>] ? audit_syscall_entry+0x272/0x2a0
 [<ffffffff81172f51>] sys_read+0x51/0x90
 [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b

[root@rhev-a24c-01 ~]# INFO: task lvm:9568 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
lvm           D 0000000000000004     0  9568   9567 0x00000080
 ffff8803894efb88 0000000000000082 0000000000000000 ffffffffa00040bc
 ffff8803ca012000 ffff8803dad85200 0000000000000001 00000001044f9add
 ffff8803874485f8 ffff8803894effd8 000000000000f598 ffff8803874485f8
Call Trace:
 [<ffffffffa00040bc>] ? dm_table_unplug_all+0x5c/0xd0 [dm_mod]
 [<ffffffff814db013>] io_schedule+0x73/0xc0
 [<ffffffff811abe3e>] __blockdev_direct_IO+0x70e/0xc40
 [<ffffffff811a9a87>] blkdev_direct_IO+0x57/0x60
 [<ffffffff811a8c50>] ? blkdev_get_blocks+0x0/0xc0
 [<ffffffff8110f0db>] generic_file_aio_read+0x6bb/0x700
 [<ffffffff8120c531>] ? avc_has_perm+0x71/0x90
 [<ffffffff8120605f>] ? security_inode_permission+0x1f/0x30
 [<ffffffff811723ea>] do_sync_read+0xfa/0x140
 [<ffffffff8108e100>] ? autoremove_wake_function+0x0/0x40
 [<ffffffff811a901c>] ? block_ioctl+0x3c/0x40
 [<ffffffff81184d92>] ? vfs_ioctl+0x22/0xa0
 [<ffffffff81211a8b>] ? selinux_file_permission+0xfb/0x150
 [<ffffffff81204ef6>] ? security_file_permission+0x16/0x20
 [<ffffffff81172e15>] vfs_read+0xb5/0x1a0
 [<ffffffff810d1ac2>] ? audit_syscall_entry+0x272/0x2a0
 [<ffffffff81172f51>] sys_read+0x51/0x90
 [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b
INFO: task vgs:10339 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
vgs           D 0000000000000002     0 10339  30973 0x00000084
 ffff8803834bbb88 0000000000000086 ffff8803834bbb48 ffffffffa00040bc
 ffff8803ca012000 ffff8803dad85200 0000000000000001 000000000000000c
 ffff88038b45e6b8 ffff8803834bbfd8 000000000000f598 ffff88038b45e6b8
Call Trace:
 [<ffffffffa00040bc>] ? dm_table_unplug_all+0x5c/0xd0 [dm_mod]
 [<ffffffff81098c99>] ? ktime_get_ts+0xa9/0xe0
 [<ffffffff814db013>] io_schedule+0x73/0xc0
 [<ffffffff811abe3e>] __blockdev_direct_IO+0x70e/0xc40
 [<ffffffff811a9a87>] blkdev_direct_IO+0x57/0x60
 [<ffffffff811a8c50>] ? blkdev_get_blocks+0x0/0xc0
 [<ffffffff8110f0db>] generic_file_aio_read+0x6bb/0x700
 [<ffffffff8120c531>] ? avc_has_perm+0x71/0x90
 [<ffffffff8120605f>] ? security_inode_permission+0x1f/0x30
 [<ffffffff811723ea>] do_sync_read+0xfa/0x140
 [<ffffffff8108e100>] ? autoremove_wake_function+0x0/0x40
 [<ffffffff811a901c>] ? block_ioctl+0x3c/0x40
 [<ffffffff81184d92>] ? vfs_ioctl+0x22/0xa0
 [<ffffffff81211a8b>] ? selinux_file_permission+0xfb/0x150
 [<ffffffff81204ef6>] ? security_file_permission+0x16/0x20
 [<ffffffff81172e15>] vfs_read+0xb5/0x1a0
 [<ffffffff810d1ac2>] ? audit_syscall_entry+0x272/0x2a0
 [<ffffffff81172f51>] sys_read+0x51/0x90
 [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b


vgs       10339      root  cwd       DIR              253,0        4096    2228225 /root
vgs       10339      root  rtd       DIR              253,0        4096          2 /
vgs       10339      root  txt       REG              253,0      820456    2883630 /sbin/lvm
vgs       10339      root  mem       REG              253,0      155696    2621834 /lib64/ld-2.12.so
vgs       10339      root  mem       REG              253,0       22536    2621836 /lib64/libdl-2.12.so
vgs       10339      root  mem       REG              253,0     1912928    2621835 /lib64/libc-2.12.so
vgs       10339      root  mem       REG              253,0       21848    2621809 /lib64/libdevmapper-event.so.1.02
vgs       10339      root  mem       REG              253,0      124624    2621851 /lib64/libselinux.so.1
vgs       10339      root  mem       REG              253,0      271976    2621877 /lib64/libreadline.so.6.0
vgs       10339      root  mem       REG              253,0      248304    2621873 /lib64/libsepol.so.1
vgs       10339      root  mem       REG              253,0      138280    2621808 /lib64/libtinfo.so.5.7
vgs       10339      root  mem       REG              253,0       61504    2621523 /lib64/libudev.so.0.5.1
vgs       10339      root  mem       REG              253,0      158912    2621574 /lib64/libdevmapper.so.1.02
vgs       10339      root  mem       REG              253,0    99158752     788542 /usr/lib/locale/locale-archive
vgs       10339      root  mem       REG              253,0       26050     788798 /usr/lib64/gconv/gconv-modules.cache
vgs       10339      root    0u      CHR              136,0         0t0          3 /dev/pts/0
vgs       10339      root    1u      CHR              136,0         0t0          3 /dev/pts/0
vgs       10339      root    2u      CHR              136,0         0t0          3 /dev/pts/0
vgs       10339      root    3u      CHR              10,58         0t0       5640 /dev/mapper/control
vgs       10339      root    4r      BLK            253,256 0x27fff0000     173240 /dev/dm-256

repro steps:

1) host connected via FC to X devices
2) disconnect host from those devices
3) rescan bus 
4) connect host to new devices
5) rescan bus 
6) multipath returns fine 
7) running vgs command: see attached file

Comment 3 Zdenek Kabelac 2011-08-03 10:03:15 UTC
This looks like some multipath relate issue.

Comment 4 Ben Marzinski 2011-08-04 19:06:05 UTC
It looks like the multipath devices are not working properly. Can you please post the output of

# multipath -ll

Comment 5 Suzanne Logcher 2011-10-06 18:42:22 UTC
Since RHEL 6.2 External Beta has begun, and this bug remains
unresolved, it has been rejected as it is not proposed as
exception or blocker.
               
Red Hat invites you to ask your support representative to
propose this request, if appropriate and relevant, in the
next release of Red Hat Enterprise Linux.

Comment 7 Ben Marzinski 2015-09-30 14:24:14 UTC
It's been 4 years since I asked for more information on this bug.