Bug 1472002 - Trying to use user:glfs with vmware
Trying to use user:glfs with vmware
Status: NEW
Product: GlusterFS
Classification: Community
Component: unclassified (Show other bugs)
3.10
x86_64 Linux
unspecified Severity high
: ---
: ---
Assigned To: bugs@gluster.org
:
Depends On:
Blocks:
  Show dependency treegraph
 
Reported: 2017-07-17 18:51 EDT by Mike Ciccarelli
Modified: 2017-07-18 11:04 EDT (History)
3 users (show)

See Also:
Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed:
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)

  None (edit)
Description Mike Ciccarelli 2017-07-17 18:51:55 EDT
Hello,

Not sure this is even supported but trying to connect VMware ESX to an iscsi target that uses user:glfs. Just an FYI I was able to mount this volume on a windows 10 system to test but it continues to fail on VMware ESXi (version 5.5 and 6.5). Please let me know of anything else you would want me to collect.

Here is the entry in the targetcli:

| o- user:glfs ............................................................................................. [Storage Objects: 1]
| | o- vol1 ................................................................... [gv0@media1-be/iscsi.disk.1 (100.0GiB) activated]

The only output I see on the Linux server side is:
Jul 17 18:14:05 media1 tcmu-runner[15156]: generic_handle_cmd:284 : unknown command 16

and on the ESX server side I see this:
2017-07-17T22:18:36.605Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500b02d00) 0x1a, CmdSN 0x12ad from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.614Z cpu3:66120)NMP: nmp_ThrottleLogForDevice:3546: last error status from device naa.6001405fc65b3e55557495ba9c92bda3 repeated 20 times
2017-07-17T22:18:36.614Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500bd9d80) 0x1a, CmdSN 0x12af from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.615Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500bd9d80) 0x1a, CmdSN 0x12b3 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.753Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500b6af00) 0x1a, CmdSN 0x12b5 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.754Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500b6af00) 0x1a, CmdSN 0x12b9 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.754Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500b6af00) 0x1a, CmdSN 0x12bb from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.756Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500b6af00) 0x1a, CmdSN 0x12bf from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.762Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500b72600) 0x1a, CmdSN 0x12c1 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.763Z cpu3:66120)ScsiDeviceIO: 2962: Cmd(0x439500b72600) 0x1a, CmdSN 0x12c5 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.872Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500b67a80) 0x1a, CmdSN 0x12c7 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.873Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500b67a80) 0x1a, CmdSN 0x12cb from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.905Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bc2700) 0x1a, CmdSN 0x12cd from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.907Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bc2700) 0x1a, CmdSN 0x12d1 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.907Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bc2700) 0x1a, CmdSN 0x12d3 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.908Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bc2700) 0x1a, CmdSN 0x12d7 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.914Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bea780) 0x1a, CmdSN 0x12d9 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:36.915Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bea780) 0x1a, CmdSN 0x12dd from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.066Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500b06c00) 0x1a, CmdSN 0x12df from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.068Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500b06c00) 0x1a, CmdSN 0x12e3 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.068Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500b06c00) 0x1a, CmdSN 0x12e5 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.069Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500b06c00) 0x1a, CmdSN 0x12e9 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.075Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500bb1980) 0x1a, CmdSN 0x12eb from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.076Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500bb1980) 0x1a, CmdSN 0x12ef from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.179Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500bc8c80) 0x1a, CmdSN 0x12f1 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.180Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bc8c80) 0x1a, CmdSN 0x12f5 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.529Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bff780) 0x1a, CmdSN 0x12fa from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.530Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bff780) 0x1a, CmdSN 0x12fe from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.531Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bff780) 0x1a, CmdSN 0x1300 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.532Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bff780) 0x1a, CmdSN 0x1304 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.532Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bff780) 0x1a, CmdSN 0x1306 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.533Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500bff780) 0x1a, CmdSN 0x130a from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.534Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500b2ad80) 0x1a, CmdSN 0x130c from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.535Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500b2ad80) 0x1a, CmdSN 0x1310 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.535Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500b2ad80) 0x1a, CmdSN 0x1312 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.536Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500b2ad80) 0x1a, CmdSN 0x1316 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.536Z cpu0:67775 opID=865547b)World: 12230: VC opID A49E068B-000001BE-4cd2 maps to vmkernel opID 865547b
2017-07-17T22:18:37.536Z cpu0:67775 opID=865547b)LVM: 12525: LVMProbeDevice failed with status "Device does not contain a logical volume".
2017-07-17T22:18:37.537Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500acb780) 0x1a, CmdSN 0x1318 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.538Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500acb780) 0x1a, CmdSN 0x131c from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.538Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500acb780) 0x1a, CmdSN 0x131e from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.539Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500acb780) 0x1a, CmdSN 0x1322 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.539Z cpu2:66120)ScsiDeviceIO: 2962: Cmd(0x439500acb780) 0x16, CmdSN 0x1323 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.539Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500acb780) 0x1a, CmdSN 0x1325 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.540Z cpu0:66120)NMP: nmp_ThrottleLogForDevice:3546: last error status from device naa.6001405fc65b3e55557495ba9c92bda3 repeated 40 times
2017-07-17T22:18:37.540Z cpu0:66120)ScsiDeviceIO: 2962: Cmd(0x439500acb780) 0x1a, CmdSN 0x1329 from world 0 to dev "naa.6001405fc65b3e55557495ba9c92bda3" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x8 0x0.
2017-07-17T22:18:37.540Z cpu0:67775 opID=865547b)LVM: 10306: LVMProbeDevice failed on (3620265024, naa.6001405fc65b3e55557495ba9c92bda3:1): Device does not contain a logical volume
2017-07-17T22:18:37.540Z cpu0:67775 opID=865547b)FSS: 2295: Failed to create FS on dev [naa.6001405fc65b3e55557495ba9c92bda3:1] fs [wef] type [vmfs3] fbSize 1048576 => I/O error
Comment 1 Niels de Vos 2017-07-18 04:13:34 EDT
This seems like a tcmu-runner problem (it does not know about certain events?). What version of tcmu-runner are you using, and do you have the same problem if you use a non-Gluster storage backend?
Comment 2 Mike Ciccarelli 2017-07-18 11:04:15 EDT
1) I had similar issues with tcmu-running versions 1.1.3-2.fc26 and 1.2. I compiled 1.2 from source.

2) I do not have the same issue if I use fileio backstore in targetcli.

I actually opened a github issue for tcmu-runner as well and it looks like they have acknowledged the issue and are aware of it. I opened the tcmu-runner issue first but then I thought it might actually be related to glusterfs as they wrote the user:glfs module?

thanks,
Mike Ciccarelli

Note You need to log in before you can comment on or make changes to this bug.