Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 890813

Summary: [rhevm] [FC] NPE Failed in GetDeviceListVDS method on editing SD in FC DC environment only
Product: Red Hat Enterprise Virtualization Manager Reporter: vvyazmin <vvyazmin>
Component: ovirt-engineAssignee: Tal Nisan <tnisan>
Status: CLOSED CURRENTRELEASE QA Contact: Elad <ebenahar>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 3.1.0CC: abaron, dyasny, ewarszaw, hateya, iheim, lpeer, Rhev-m-bugs, scohen, sgrinber, yeylon, ykaul
Target Milestone: ---Flags: scohen: Triaged+
Target Release: 3.2.0   
Hardware: x86_64   
OS: Linux   
Whiteboard: storage
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
## Logs vdsm, rhevm none

Description vvyazmin@redhat.com 2012-12-30 11:16:05 UTC
Created attachment 670396 [details]
## Logs vdsm, rhevm

Description of problem:
Get an error: Failed in GetDeviceListVDS method on editing SD in FC DC environment only

Version-Release number of selected component (if applicable):
RHEVM 3.2 - SF02 environment 

RHEVM: rhevm-3.2.0-2.el6ev.noarch
VDSM: vdsm-4.10.2-2.0.el6.x86_64
LIBVIRT: libvirt-0.10.2-13.el6.x86_64
QEMU & KVM: qemu-kvm-rhev-0.12.1.2-2.348.el6.x86_64
SANLOCK: sanlock-2.6-2.el6.x86_64

How reproducible:
100 %

Steps to Reproduce:
1. Create FC DC environment with one hosts
2. Create a new SD (master) 
3. Successfully create SD
  
Actual results:
Get an error: Failed in GetDeviceListVDS method 

Expected results:
No errors found

Additional info:

/var/log/ovirt-engine/engine.log
2012-12-30 15:15:51,374 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-3) START, GetDeviceListVDSCommand(HostName = green-vdsa, H
ostId = c610737d-fca9-4595-8da4-83d9be1cd755, storageType=null), log id: 7683dc7f
2012-12-30 15:15:51,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (ajp-/127.0.0.1:8702-3) Failed in GetDeviceListVDS method, for vds: green-vdsa; host: green-vdsa.qa.lab.tlv.redhat.com
2012-12-30 15:15:51,374 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp-/127.0.0.1:8702-3) Command GetDeviceListVDS execution failed. Exception: NullPointerException: 
2012-12-30 15:15:51,374 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GetDeviceListVDSCommand, log id: 7683dc7f
2012-12-30 15:15:51,375 ERROR [org.ovirt.engine.core.bll.GetLunsByVgIdQuery] (ajp-/127.0.0.1:8702-3) Query GetLunsByVgIdQuery failed. Exception message is VdcBLLException: java.lang.NullPointerException
2012-12-30 15:15:51,377 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetDeviceListVDSCommand(HostName = green-vdsa, HostId = c610737d-fca9-4595-8da4-83d9be1cd755, storageType=FCP), log id: 10cc87a

/var/log/vdsm/vdsm.log

Comment 1 Ayal Baron 2012-12-30 11:57:37 UTC
The reproduce steps are obviously wrong as you never reached step number 2.

Comment 2 Ayal Baron 2012-12-30 11:58:01 UTC
Please provide proper reproduction steps.

Comment 3 vvyazmin@redhat.com 2012-12-30 12:02:35 UTC
(In reply to comment #2)
> Please provide proper reproduction steps.

Steps to Reproduce:
1. Create FC DC environment with one hosts
2. Create a new SD
3. Edit SD


2012-12-30 16:44:22,093 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-6) START, GetDeviceListVDSCommand(HostName = green-vdsa, H
ostId = c610737d-fca9-4595-8da4-83d9be1cd755, storageType=null), log id: 2f54d3ae
2012-12-30 16:44:22,093 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (ajp-/127.0.0.1:8702-6) Failed in GetDeviceListVDS method, for vds: green-vdsa; host: 
green-vdsa.qa.lab.tlv.redhat.com
2012-12-30 16:44:22,093 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp-/127.0.0.1:8702-6) Command GetDeviceListVDS execution failed. Exception: NullPointerException: 
2012-12-30 16:44:22,093 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-6) FINISH, GetDeviceListVDSCommand, log id: 2f54d3ae
2012-12-30 16:44:22,093 ERROR [org.ovirt.engine.core.bll.GetLunsByVgIdQuery] (ajp-/127.0.0.1:8702-6) Query GetLunsByVgIdQuery failed. Exception message is VdcBLLException: java.lang.NullPointerException
2012-12-30 16:44:22,096 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-3) START, GetDeviceListVDSCommand(HostName = green-vdsa, HostId = c610737d-fca9-4595-8da4-83d9be1cd755, storageType=FCP), log id: 15a4be68
2012-12-30 16:44:31,162 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@a898c839, org.ovirt.engine.core.common.businessentities.LUNs@bffcc96b, org.ovirt.engine.core.common.businessentities.LUNs@f1393bb7, org.ovirt.engine.core.common.businessentities.LUNs@dd7cfd92, org.ovirt.engine.core.common.businessentities.LUNs@42cfe951, org.ovirt.engine.core.common.businessentities.LUNs@53d546c5, org.ovirt.engine.core.common.businessentities.LUNs@ba42df48, org.ovirt.engine.core.common.businessentities.LUNs@ef62213b, org.ovirt.engine.core.common.businessentities.LUNs@1db9ac79, org.ovirt.engine.core.common.businessentities.LUNs@f5d9a649], log id: 15a4be68

Comment 4 Eduardo Warszawski 2013-02-14 06:49:10 UTC
As you can see below, all getDeviceList requests were honored by vdsm.
No one of the FC returned an empty list.
IMHO will be convinient to reduce the number of identical requests, specially the concurrent ones.

Thread-195603::INFO::2012-12-30 14:02:50,519::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-195603::INFO::2012-12-30 14:02:57,854::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList
Thread-197229::INFO::2012-12-30 14:44:44,368::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-197229::INFO::2012-12-30 14:44:51,617::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList
Thread-197244::INFO::2012-12-30 14:45:03,168::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-197244::INFO::2012-12-30 14:45:11,448::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList
Thread-197375::INFO::2012-12-30 14:47:44,286::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-197375::INFO::2012-12-30 14:47:51,420::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList
Thread-197390::INFO::2012-12-30 14:48:03,727::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-197390::INFO::2012-12-30 14:48:10,979::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList
Thread-197420::INFO::2012-12-30 14:48:38,115::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-197420::INFO::2012-12-30 14:48:45,325::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList
Thread-197434::INFO::2012-12-30 14:48:54,783::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-197434::INFO::2012-12-30 14:49:01,936::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList
Thread-27::INFO::2012-12-30 14:58:45,583::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-27::INFO::2012-12-30 14:58:53,551::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [
Thread-55::INFO::2012-12-30 14:59:26,762::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-55::INFO::2012-12-30 14:59:49,675::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [
Thread-202::INFO::2012-12-30 15:01:58,505::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-202::INFO::2012-12-30 15:02:07,517::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-340::INFO::2012-12-30 15:04:46,819::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-341::INFO::2012-12-30 15:04:46,835::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-340::INFO::2012-12-30 15:04:56,278::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-341::INFO::2012-12-30 15:05:06,763::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-423::INFO::2012-12-30 15:06:41,426::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-424::INFO::2012-12-30 15:06:41,427::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-423::INFO::2012-12-30 15:06:49,241::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-424::INFO::2012-12-30 15:06:58,724::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-439::INFO::2012-12-30 15:07:06,391::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-439::INFO::2012-12-30 15:07:15,508::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-523::INFO::2012-12-30 15:08:51,855::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-524::INFO::2012-12-30 15:08:51,855::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
Thread-523::INFO::2012-12-30 15:09:00,882::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-524::INFO::2012-12-30 15:09:11,089::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-618::INFO::2012-12-30 15:13:06,017::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-618::INFO::2012-12-30 15:13:15,014::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-762::INFO::2012-12-30 15:15:44,460::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-762::INFO::2012-12-30 15:15:52,711::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-786::INFO::2012-12-30 15:16:12,174::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-786::INFO::2012-12-30 15:16:20,511::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': 
Thread-1613::INFO::2012-12-30 15:33:47,009::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=2, options={})
Thread-1613::INFO::2012-12-30 15:33:55,090::logUtils::39::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList':

Comment 5 Elad 2013-04-10 14:05:56 UTC
Reproduce on: RHEVM-3.2 - SF13, and didn't get (Failed in GetDeviceListVDS method) error.

release components version checked:

rhevm-3.2.0-10.18.beta2.el6ev.noarch
rhevm-backend-3.2.0-10.18.beta2.el6ev.noarch
vdsm-4.10.2-13.0.el6ev.x86_64



2013-04-10 16:56:05,716 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetDeviceListVDSCommand(HostName = green-vdsb, HostId = de3f3932-b5fb-41f6-84b7-20360fe6d016, storageType=FCP), log id: 6c8638b
2013-04-10 16:56:05,756 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetDeviceListVDSCommand(HostName = green-vdsb, HostId = de3f3932-b5fb-41f6-84b7-20360fe6d016, storageType=FCP), log id: 17522b86
2013-04-10 16:56:11,425 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@dec0ea37, org.ovirt.engine.core.common.businessentities.LUNs@c3fed263, org.ovirt.engine.core.common.businessentities.LUNs@d8255aae, org.ovirt.engine.core.common.businessentities.LUNs@498118ea, org.ovirt.engine.core.common.businessentities.LUNs@9704323c, org.ovirt.engine.core.common.businessentities.LUNs@3c1fd51f, org.ovirt.engine.core.common.businessentities.LUNs@5201adfd], log id: 6c8638b
2013-04-10 16:56:15,593 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@dec0ea37, org.ovirt.engine.core.common.businessentities.LUNs@c3fed263, org.ovirt.engine.core.common.businessentities.LUNs@d8255aae, org.ovirt.engine.core.common.businessentities.LUNs@498118ea, org.ovirt.engine.core.common.businessentities.LUNs@9704323c, org.ovirt.engine.core.common.businessentities.LUNs@3c1fd51f, org.ovirt.engine.core.common.businessentities.LUNs@5201adfd], log id: 17522b86
2013-04-10 16:56:35,106 INFO  [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-14) Running command: LoginUserCommand internal: false.

Comment 6 Itamar Heim 2013-06-11 09:41:53 UTC
3.2 has been released

Comment 7 Itamar Heim 2013-06-11 09:42:04 UTC
3.2 has been released

Comment 8 Itamar Heim 2013-06-11 09:54:18 UTC
3.2 has been released