Bug 1016216 - cinder: detach of volume is stuck in detach when sent during fail to mount gluster
cinder: detach of volume is stuck in detach when sent during fail to mount gl...
Status: CLOSED ERRATA
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-cinder (Show other bugs)
4.0
x86_64 Linux
unspecified Severity high
: rc
: 5.0 (RHEL 6)
Assigned To: Jon Bernard
Yogev Rabl
storage
:
Depends On: 1016224 1035891 1051605 1066955
Blocks:
  Show dependency treegraph
 
Reported: 2013-10-07 13:49 EDT by Dafna Ron
Modified: 2016-04-26 17:51 EDT (History)
4 users (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed: 2014-07-29 11:34:31 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)
logs (14.49 MB, application/x-gzip)
2013-10-07 13:49 EDT, Dafna Ron
no flags Details


External Trackers
Tracker ID Priority Status Summary Last Updated
Launchpad 1236482 None None None Never

  None (edit)
Description Dafna Ron 2013-10-07 13:49:43 EDT
Created attachment 808971 [details]
logs

Description of problem:

we had an outage and gluster storage went down
after the storage came back we still had a problem mounting the storage because of a problem in gluster. 
since I did not know we still had a problem I sent detach of volume while the storage was unavailable. 
even after we fixed the issue in the storage, the detach was still stuck 
only after I terminated the instance the detach completed. 

Version-Release number of selected component (if applicable):

openstack-cinder-2013.2-0.9.b3.el6ost.noarch

How reproducible:


Steps to Reproduce:
1. configure cinder to work with glance 
2. boot instance from volume
3. hard shut down gluster so that mount will fail
4. send detach command from UI
5. start gluster 


Actual results:

detach is stuck until we destroy the instance 

Expected results:

we should fail the detach until we can actually send the command or be able to continue the detach once the storage is mounted again. 

Additional info: logs 

[root@cougar06 ~(keystone_admin)]# cinder list 
+--------------------------------------+-----------+--------------+------+-------------+----------+--------------------------------------+
|                  ID                  |   Status  | Display Name | Size | Volume Type | Bootable |             Attached to              |
+--------------------------------------+-----------+--------------+------+-------------+----------+--------------------------------------+
| 1560fa00-752b-4d7b-a747-3ef9bf483692 | available |     new      |  1   |     None    |   True   |                                      |
| 22c3e84c-1d9b-4a45-9244-06b3ab6c401a |  creating |     bla      |  10  |     None    |  False   |                                      |
| aadc9c04-17ab-42c4-8bce-c2f63cd287fa | detaching |  image_new   |  1   |     None    |   True   | 5a225901-5394-42f2-b974-538257ef2818 |
+--------------------------------------+-----------+--------------+------+-------------+----------+--------------------------------------+
[root@cougar06 ~(keystone_admin)]# less /var/log/nova/compute.log
[root@cougar06 ~(keystone_admin)]# cinder list 
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
|                  ID                  |   Status  | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| 1560fa00-752b-4d7b-a747-3ef9bf483692 | available |     new      |  1   |     None    |   True   |             |
| 22c3e84c-1d9b-4a45-9244-06b3ab6c401a |  creating |     bla      |  10  |     None    |  False   |             |
| aadc9c04-17ab-42c4-8bce-c2f63cd287fa | available |  image_new   |  1   |     None    |   True   |             |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
[root@cougar06 ~(keystone_admin)]# mkdir /tmp/cinder
Comment 1 Dafna Ron 2013-10-07 13:55:35 EDT
https://bugs.launchpad.net/cinder/+bug/1236482
Comment 2 Eric Harney 2013-11-20 11:14:48 EST
Sounds pretty similar to bug 1016224.
Comment 3 Flavio Percoco 2014-01-15 02:17:38 EST
Indeed, it's pretty similar to the other bugs. Hopefully, the patch will land soon upstream.
Comment 6 Jon Bernard 2014-07-15 16:07:21 EDT
This is working as expected with the latest build
Comment 7 Yogev Rabl 2014-07-22 10:53:42 EDT
verified on: 

python-novaclient-2.17.0-2.el6ost.noarch
openstack-cinder-2014.1.1-1.el6ost.noarch
python-nova-2014.1.1-2.el6ost.noarch
openstack-nova-compute-2014.1.1-2.el6ost.noarch
openstack-nova-scheduler-2014.1.1-2.el6ost.noarch
openstack-nova-novncproxy-2014.1.1-2.el6ost.noarch
openstack-nova-cert-2014.1.1-2.el6ost.noarch
openstack-nova-api-2014.1.1-2.el6ost.noarch
openstack-nova-conductor-2014.1.1-2.el6ost.noarch
openstack-nova-console-2014.1.1-2.el6ost.noarch
openstack-nova-common-2014.1.1-2.el6ost.noarch
openstack-nova-network-2014.1.1-2.el6ost.noarch
python-cinderclient-1.0.9-1.el6ost.noarch
python-cinder-2014.1.1-1.el6ost.noarch
Comment 8 Scott Lewis 2014-07-29 11:34:31 EDT
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHEA-2014-0955.html

Note You need to log in before you can comment on or make changes to this bug.