Bug 1154534 - LVM - Unable to delete snapshots and volumes due to UnicodeDecodeError
Summary: LVM - Unable to delete snapshots and volumes due to UnicodeDecodeError
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-cinder
Version: 5.0 (RHEL 7)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: z3
: 5.0 (RHEL 7)
Assignee: hguemar
QA Contact: bkopilov
URL:
Whiteboard:
Depends On:
Blocks: 1165849
TreeView+ depends on / blocked
 
Reported: 2014-10-20 06:21 UTC by bkopilov
Modified: 2018-12-09 18:54 UTC (History)
9 users (show)

Fixed In Version: openstack-cinder-2014.1.3-2.el7ost
Doc Type: Bug Fix
Doc Text:
Previously, deleting a LVM snapshot or volume in Block Storage (cinder) could fail due an internal exception when processing byte strings. As a result, certain LVM snapshots or volumes could not be deleted in some cases. This update resolves this issue by catching a spurious exception. As a result, these LVM snapshots and volumes can now be successfully deleted.
Clone Of:
: 1165849 (view as bug list)
Environment:
Last Closed: 2014-12-02 15:14:03 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Launchpad 1368527 0 None None None Never
OpenStack gerrit 129613 0 None None None Never
Red Hat Product Errata RHBA-2014:1926 0 normal SHIPPED_LIVE openstack-cinder bug fix advisory 2014-12-02 20:12:53 UTC

Description bkopilov 2014-10-20 06:21:20 UTC 
Description of problem:

Hi , 
Installed openstack on rhel 7  with packstack installer .
storage backend is LVM.
We are not able to delete snapshots volumes  , the root cause is : 

was 1 execute /usr/lib/python2.7/site-packages/cinder/openstack/common/processutils.py:171
2014-10-20 00:53:11.386 18219 DEBUG cinder.openstack.common.lockutils [req-7016d6a8-5b2f-4406-bc42-83ddebb6bf97 741a6c5d10a34bc0affd06e4546ae6f2 f9cef2db57774dcc9a273962eeece093 - - -] Released f
ile lock "3bbed04b-9552-4ac7-83f1-76904a516d76-delete_snapshot" at /var/lib/cinder/tmp/cinder-3bbed04b-9552-4ac7-83f1-76904a516d76-delete_snapshot for method "lso_inner2"... inner /usr/lib/python
2.7/site-packages/cinder/openstack/common/lockutils.py:239
2014-10-20 00:53:11.386 18219 ERROR oslo.messaging.rpc.dispatcher [req-7016d6a8-5b2f-4406-bc42-83ddebb6bf97 741a6c5d10a34bc0affd06e4546ae6f2 f9cef2db57774dcc9a273962eeece093 - - -] Exception duri
ng message handling: 'ascii' codec can't decode byte 0xe2 in position 24: ordinal not in range(128)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 166, in lso_inner1
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     return lso_inner2(inst, context, snapshot_id, **kwargs)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/openstack/common/lockutils.py", line 233, in inner
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     retval = f(*args, **kwargs)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 165, in lso_inner2
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     return f(*_args, **_kwargs)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 542, in delete_snapshot
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     {'status': 'error_deleting'})
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/openstack/common/excutils.py", line 68, in __exit__
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 530, in delete_snapshot
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     self.driver.delete_snapshot(snapshot_ref)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 252, in delete_snapshot
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     self._delete_volume(snapshot, is_snapshot=True)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 128, in _delete_volume
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     self._clear_volume(volume, is_snapshot)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 171, in _clear_volume
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     volume_clear_size=self.configuration.volume_clear_size)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/utils.py", line 182, in clear_volume
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     ionice=volume_clear_ionice)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/volume/utils.py", line 138, in copy_volume
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     *extra_flags, run_as_root=True)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 136, in execute
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     return processutils.execute(*cmd, **kwargs)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/openstack/common/processutils.py", line 175, in execute
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     sanitized_stderr = strutils.mask_password(stderr)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/openstack/common/strutils.py", line 300, in mask_password
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher     message = six.text_type(message)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 24: ordinal not in range(128)
2014-10-20 00:53:11.386 18219 TRACE oslo.messaging.rpc.dispatcher 


Version-Release number of selected component (if applicable):
rhel version : Red Hat Enterprise Linux Server release 7.0 (Maipo)
Linux test2745 3.10.0-123.8.1.el7.x86_64 #1 SMP Mon Aug 11 13:37:49 EDT 2014 
x86_64 x86_64 x86_64 GNU/Linux


openstack-cinder-2014.1.3-1.el7ost.noarch
python-cinder-2014.1.3-1.el7ost.noarch
python-cinderclient-1.0.9-1.el7ost.noarch


How reproducible:
1. Create snapshot from volume 
2. Try to delete the snapshot.

Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 2 bkopilov 2014-10-20 06:24:51 UTC 
See bugzilla bug - 1148251 , we got the same issue on RDO too .
Comment 3 Eric Harney 2014-10-20 13:19:11 UTC 
This was fixed in Juno but not in Icehouse yet.
Comment 8 bkopilov 2014-11-23 18:04:37 UTC 
Hi , 
Run automation with latest puddle , 
the issue was solved.

Benny
Comment 9 bkopilov 2014-11-23 18:09:55 UTC 
Run with 2014-11-21.2 version 
Bennt
Comment 10 bkopilov 2014-11-23 18:10:09 UTC 
Run with 2014-11-21.2 version 
Benny
Comment 13 errata-xmlrpc 2014-12-02 15:14:03 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2014-1926.html
Note You need to log in before you can comment on or make changes to this bug.