Description of problem: Add support to force detach a volume from all hosts on Unity when run RHOSP12 certification, we found this exception when run force_detach case: 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager [req-18ed4f4a-8098-46b1-9ec3-783ea4d95815 9c4a73d0d44a4d78a63dbbd1e60731dd 8dbef48343d14ca7b76aca5b61f48aa1 - default default] Terminate volume connection failed: 'NoneType' object has no attribute '__getitem__': TypeError: 'NoneType' object has no attribute '__getitem__' 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager Traceback (most recent call last): 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1763, in terminate_connection 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager force=force) 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/zonemanager/utils.py", line 104, in decorator 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager conn_info = terminate_connection(self, *args, **kwargs) 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/dell_emc/unity/driver.py", line 166, in terminate_connection 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager return self.adapter.terminate_connection(volume, connector) 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 883, in trace_logging_wrapper 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager result = f(*args, **kwargs) 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/dell_emc/unity/adapter.py", line 317, in terminate_connection 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager return self._terminate_connection(lun, connector) 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 883, in trace_logging_wrapper 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager result = f(*args, **kwargs) 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/dell_emc/unity/adapter.py", line 311, in _terminate_connection 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager host = self.client.get_host(connector['host']) 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager TypeError: 'NoneType' object has no attribute '__getitem__' 2018-01-08 06:08:55.422 946881 ERROR cinder.volume.manager 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server [req-18ed4f4a-8098-46b1-9ec3-783ea4d95815 9c4a73d0d44a4d78a63dbbd1e60731dd 8dbef48343d14ca7b76aca5b61f48aa1 - default default] Exception during message handling: VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Terminate volume connection failed: 'NoneType' object has no attribute '__getitem__' 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1768, in terminate_connection 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server raise exception.VolumeBackendAPIException(data=err_msg) 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Terminate volume connection failed: 'NoneType' object has no attribute '__getitem__' 2018-01-08 06:08:55.423 946881 ERROR oslo_messaging.rpc.server Version-Release number of selected component (if applicable): How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
Hi, It looks like the Unity driver is skipping the test_force_detach_volume test in upstream Unity Cinder driver CI. As this is a normal tempest volume test, it should be enabled and functioning for this driver. Required changes for the driver to pass this test should be made upstream, and then we can consider backporting those changes to OSP12. Thanks, Eric
(In reply to Eric Harney from comment #2) > Hi, > > It looks like the Unity driver is skipping the test_force_detach_volume test > in upstream Unity Cinder driver CI. As this is a normal tempest volume > test, it should be enabled and functioning for this driver. > > Required changes for the driver to pass this test should be made upstream, > and then we can consider backporting those changes to OSP12. > > Thanks, > Eric Hi this bug is fixed on upstream and we have enabled it on our upstream CI. https://review.openstack.org/#/c/534691/
(In reply to Zhimou Peng from comment #3) > Hi this bug is fixed on upstream and we have enabled it on our upstream CI. > > https://review.openstack.org/#/c/534691/ Please propose this for stable/pike upstream as well.
(In reply to Eric Harney from comment #4) > (In reply to Zhimou Peng from comment #3) > > Hi this bug is fixed on upstream and we have enabled it on our upstream CI. > > > > https://review.openstack.org/#/c/534691/ > > Please propose this for stable/pike upstream as well. Hi, our dev will fix this on stable/pike later, thanks.
Hi, The patch is merged on pike. https://review.openstack.org/#/c/551831/ Please fix this on RHOSP12
Ready for Dell EMC to QA this on openstack-cinder-11.1.0-9.el7ost or later. Let me know if you need assistance getting the package.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2018:2516
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days