Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
RDO tickets are now tracked in Jira https://issues.redhat.com/projects/RDO/issues/

Bug 1148251

Summary: LVM - Unable to delete snapshots and volumes
Product: [Community] RDO Reporter: bkopilov <bkopilov>
Component: openstack-cinderAssignee: Eric Harney <eharney>
Status: CLOSED CURRENTRELEASE QA Contact: nlevinki <nlevinki>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: unspecifiedCC: apevec, bkopilov, eharney, yeylon
Target Milestone: ---   
Target Release: Juno   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-10-28 12:36:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
cinder-logs
none
/var/log/messages
none
nova logs none

Description bkopilov 2014-10-01 05:14:53 UTC
Description of problem:
RHEL 7 with packstack install .
openstack version - RDO :
backend - LVM 

Running tempest code , delete snapshot from volume fails.
tempest tests :
tempest.api.volume.admin.test_snapshots_actions.SnapshotsActionsTest.test_snapshot_force_delete_when_snapshot_is_creating


from cinder logs :
6 - - -] Result was 1 execute /usr/lib/python2.7/site-packages/cinder/openstack/common/processutils.py:192
2014-10-01 00:30:03.938 18507 DEBUG cinder.openstack.common.lockutils [req-620c4cac-6c04-4929-ad15-50f8bc0ebfdf 53c3658a914b4e4e95a8004429ed953e 00ceae3c44d64cfeb5148e6de6693aa6 -
 - -] Released file lock "70d2424a-4b7b-4b9c-9769-89a4e14fc538-delete_snapshot" at /var/lib/cinder/tmp/cinder-70d2424a-4b7b-4b9c-9769-89a4e14fc538-delete_snapshot for method "lso_
inner2"... inner /usr/lib/python2.7/site-packages/cinder/openstack/common/lockutils.py:239
2014-10-01 00:30:03.938 18507 ERROR oslo.messaging.rpc.dispatcher [req-620c4cac-6c04-4929-ad15-50f8bc0ebfdf 53c3658a914b4e4e95a8004429ed953e 00ceae3c44d64cfeb5148e6de6693aa6 - - -
] Exception during message handling: 'ascii' codec can't decode byte 0xe2 in position 24: ordinal not in range(128)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 105, in wrapper
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     return f(*args, **kwargs)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 149, in lso_inner1
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     return lso_inner2(inst, context, snapshot_id, **kwargs)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/openstack/common/lockutils.py", line 233, in inner
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     retval = f(*args, **kwargs)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 148, in lso_inner2
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     return f(*_args, **_kwargs)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 598, in delete_snapshot
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     {'status': 'error_deleting'})
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/openstack/common/excutils.py", line 82, in __exit__
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 586, in delete_snapshot
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     self.driver.delete_snapshot(snapshot_ref)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 105, in wrapper
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     return f(*args, **kwargs)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 253, in delete_snapshot
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     self._delete_volume(snapshot, is_snapshot=True)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 129, in _delete_volume
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     self._clear_volume(volume, is_snapshot)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 172, in _clear_volume
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     volume_clear_size=self.configuration.volume_clear_size)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/utils.py", line 361, in clear_volume
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     ionice=volume_clear_ionice)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/utils.py", line 296, in copy_volume
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     flag, run_as_root=True)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 134, in execute
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     return processutils.execute(*cmd, **kwargs)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/openstack/common/processutils.py", line 196, in execute
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     sanitized_stderr = strutils.mask_password(stderr)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/openstack/common/strutils.py", line 295, in mask_password
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher     message = six.text_type(message)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 24: ordinal not in range(128)
2014-10-01 00:30:03.938 18507 TRACE oslo.messaging.rpc.dispatcher 
2014-10-01 00:30:03.942 18507 ERROR oslo.messaging._drivers.common [req-620c4cac-6c04-4929-ad15-50f8bc0ebfdf 53c3658a914b4e4e95a8004429ed953e 00ceae3c44d64cfeb5148e6de6693aa6 - - 
-

Version-Release number of selected component (if applicable):
openstack-packstack-puppet-2014.2-0.3.dev1266.g63d9c50.el7.centos.noarch
openstack-nova-console-2014.2-0.4.b3.el7.centos.noarch
openstack-neutron-openvswitch-2014.2-0.7.b3.el7.centos.noarch
openstack-swift-plugin-swift3-1.7-4.el7.centos.noarch
openstack-utils-2014.1-3.el7.centos.1.noarch
openstack-nova-scheduler-2014.2-0.4.b3.el7.centos.noarch
openstack-neutron-2014.2-0.7.b3.el7.centos.noarch
openstack-swift-account-2.1.0-1.el7.centos.noarch
openstack-packstack-puppet-2014.2-0.3.dev1266.g63d9c50.el7.centos.noarch
openstack-nova-novncproxy-2014.2-0.4.b3.el7.centos.noarch
openstack-packstack-2014.2-0.3.dev1266.g63d9c50.el7.centos.noarch
openstack-nova-api-2014.2-0.4.b3.el7.centos.noarch
openstack-nova-cert-2014.2-0.4.b3.el7.centos.noarch
python-django-openstack-auth-1.1.6-1.el7.centos.noarch
openstack-swift-container-2.1.0-1.el7.centos.noarch
openstack-neutron-ml2-2014.2-0.7.b3.el7.centos.noarch
openstack-dashboard-2014.2-0.4.b3.el7.centos.noarch
openstack-swift-object-2.1.0-1.el7.centos.noarch
openstack-keystone-2014.2-0.4.b3.el7.centos.noarch
openstack-cinder-2014.2-0.2.b3.el7.centos.noarch
openstack-puppet-modules-2014.2-0.3.el7.centos.noarch
openstack-glance-2014.2-0.7.b3.el7.centos.noarch
openstack-nova-common-2014.2-0.4.b3.el7.centos.noarch
openstack-swift-2.1.0-1.el7.centos.noarch
openstack-selinux-0.5.15-1.el7ost.noarch
openstack-nova-conductor-2014.2-0.4.b3.el7.centos.noarch
openstack-swift-proxy-2.1.0-1.el7.centos.noarch
openstack-nova-compute-2014.2-0.4.b3.el7.centos.noarch


How reproducible:


Steps to Reproduce:
1. install openstack with packstack based on RDO
2. install tempest
3. Run create volume and snapshot.
4. Try to delete the snapshot.

Actual results:


Expected results:


Additional info:

Comment 1 bkopilov 2014-10-01 05:31:41 UTC
Created attachment 942916 [details]
cinder-logs

Comment 2 bkopilov 2014-10-01 05:32:09 UTC
Created attachment 942917 [details]
/var/log/messages

Comment 3 bkopilov 2014-10-01 05:34:56 UTC
Created attachment 942921 [details]
nova logs

Comment 4 bkopilov 2014-10-13 07:10:20 UTC
Hi , 
Hit on similar issue on latest puddle rhel7 and puddle 2014-10-10.4/RH7-RHOS-5.0/

Comment 5 Alan Pevec 2014-10-28 12:36:23 UTC
> Hit on similar issue on latest puddle rhel7 and puddle
> 2014-10-10.4/RH7-RHOS-5.0/

Please report this for RHOS5, issue reported here has been fixed in RDO Juno GA.