Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1873563

Summary: Unauthorized exceptions raised from queued casts to detach_volume result in volumes being left in a detaching status
Product: Red Hat OpenStack Reporter: jhardee
Component: openstack-novaAssignee: Lee Yarwood <lyarwood>
Status: CLOSED DUPLICATE QA Contact: OSP DFG:Compute <osp-dfg-compute>
Severity: high Docs Contact:
Priority: high    
Version: 13.0 (Queens)CC: abishop, akaiser, dasmith, dhill, eglynn, jhakimra, kchamart, lyarwood, sbauza, sgordon, vromanso
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-09-11 13:07:02 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version: Wallaby
Embargoed:

Description jhardee 2020-08-28 15:51:33 UTC
Description of problem:
Volume not detaching from instance. Volume hangs in 'detaching' state

In database I see the following:

MariaDB [nova]> select created_at,updated_at,id,device_name,deleted,instance_uuid from block_device_mapping where volume_id ='bcb5e18d-29f7-46dc-afbc-557f72d83658';
+---------------------+---------------------+-----+-------------+---------+--------------------------------------+
| created_at          | updated_at          | id  | device_name | deleted | instance_uuid                        |
+---------------------+---------------------+-----+-------------+---------+--------------------------------------+
| 2020-05-11 15:44:01 | 2020-08-26 17:25:56 | 323 | /dev/vdb    |       0 | b6ec7dd3-a904-4610-8648-ff099ef46ccf |
| 2020-08-20 04:04:05 | 2020-08-20 04:04:07 | 492 | /dev/vdb    |       0 | c833fb08-77ca-4233-b020-f94fbc0446a1 |
| 2020-08-20 05:43:56 | 2020-08-20 05:43:58 | 495 | /dev/vdc    |       0 | 6e62cab1-9f45-4c5a-978e-469774961b08 |
+---------------------+---------------------+-----+-------------+---------+--------------------------------------+

But when running the command for server show for c833fb08-77ca-4233-b020-f94fbc0446a1 and 6e62cab1-9f45-4c5a-978e-469774961b08, volume bcb5e18d-29f7-46dc-afbc-557f72d83658 is not attached.
We also saw the following:

    <disk type='network' device='cdrom'>
      <driver name='qemu' type='raw' cache='writeback' discard='unmap'/>
      <auth username='mo_ceph001_openstack'>
        <secret type='ceph' uuid='df413d9c-507f-48c9-98d1-4697656a93b7'/>
      </auth>
      <source protocol='rbd' name='mo_ceph001_vms/b6ec7dd3-a904-4610-8648-ff099ef46ccf_disk.config'>
        <host name='192.168.100.10' port='6789'/>
        <host name='192.168.100.11' port='6789'/>
        <host name='192.168.100.20' port='6789'/>
        <host name='192.168.100.21' port='6789'/>
        <host name='192.168.100.30' port='6789'/>
      </source>
      <target dev='hda' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>

It seems that the volume is not vda but hda.  

Version-Release number of selected component (if applicable): OSP13


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results: 
Detaching volume bcb5e18d-29f7-46dc-afbc-557f72d83658 from the instance hangs in 'detaching' state.


Expected results:
Detaching volume from instance successfully.


Additional info:

Comment 13 Lee Yarwood 2020-09-11 13:07:02 UTC

*** This bug has been marked as a duplicate of bug 1847958 ***