1072240 – cannot take a snapshot of an attached volume with Gluster libfgapi

Bug 1072240 - cannot take a snapshot of an attached volume with Gluster libfgapi

Summary: cannot take a snapshot of an attached volume with Gluster libfgapi

Keywords:
Status:	CLOSED DUPLICATE of bug 1017288
Alias:	None
Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openstack-cinder
Sub Component:
Version:	5.0 (RHEL 7)
Hardware:	Unspecified
OS:	Unspecified
Priority:	urgent
Severity:	urgent
Target Milestone:	---
Target Release:	5.0 (RHEL 7)
Assignee:	RHOS Maint
QA Contact:	Dafna Ron
Docs Contact:
URL:
Whiteboard:	storage
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2014-03-04 07:42 UTC by Yogev Rabl
Modified:	2016-04-26 19:45 UTC (History)
CC List:	2 users (show)
Fixed In Version:
Doc Type:	Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:	2014-03-05 22:04:42 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Launchpad	1287572	0	None	None	None	Never

Description Yogev Rabl 2014-03-04 07:42:43 UTC

Description of problem:
While testing around bug 1020979 , the snapshot creation of volumes attached to an instance using the --force True flag fails due to the errors: 

from volume.log:

2014-03-04 09:22:24.883 8815 ERROR cinder.openstack.common.rpc.amqp [req-c7819ffb-505d-4426-9e22-728bb4ef1e58 24a40da737084f6a96f4bfbadfb41704 11976f316804438bb19d721c5b5ee80c] Exception during message handling
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last):
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp     **args)
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp     return getattr(proxyobj, method)(ctxt, **kwargs)
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line 378, in create_snapshot
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp     {'status': 'error'})
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp   File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp     self.gen.next()
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line 369, in create_snapshot
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp     model_update = self.driver.create_snapshot(snapshot_ref)
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/cinder/openstack/common/lockutils.py", line 247, in inner
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp     retval = f(*args, **kwargs)
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/cinder/volume/drivers/glusterfs.py", line 295, in create_snapshot
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp     return self._create_snapshot(snapshot)
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/cinder/volume/drivers/glusterfs.py", line 435, in _create_snapshot
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp     raise exception.GlusterfsException(msg)
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp GlusterfsException: Nova returned "error" status while creating snapshot.
2014-03-04 09:22:24.883 8815 TRACE cinder.openstack.common.rpc.amqp 

from the compute.log:

2014-03-04 09:30:47.521 3135 ERROR nova.virt.libvirt.driver [req-8805f451-4b1d-4d69-86d1-20b2ed4d1222 24a40da737084f6a96f4bfbadfb41704 11976f316804438bb19d721c5b5ee80c] Error occurred during volume_snapshot_create, sending error status to Cinder.
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver Traceback (most recent call last):
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 1675, in volume_snapshot_create
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver     create_info['new_file'])
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 1584, in _volume_snapshot_create
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver     new_file_path = os.path.join(os.path.dirname(current_file),
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver   File "/usr/lib64/python2.6/posixpath.py", line 119, in dirname
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver     i = p.rfind('/') + 1
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver AttributeError: 'NoneType' object has no attribute 'rfind'
2014-03-04 09:30:47.521 3135 TRACE nova.virt.libvirt.driver 
2014-03-04 09:30:47.523 3135 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.35.104.17
2014-03-04 09:30:47.644 3135 ERROR nova.openstack.common.rpc.amqp [req-8805f451-4b1d-4d69-86d1-20b2ed4d1222 24a40da737084f6a96f4bfbadfb41704 11976f316804438bb19d721c5b5ee80c] Exception during message handling
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     **args)
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/common.py", line 439, in inner
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     return catch_client_exception(exceptions, func, *args, **kwargs)
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/common.py", line 420, in catch_client_exception
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     return func(*args, **kwargs)
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 2366, in volume_snapshot_create
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     create_info)
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 1682, in volume_snapshot_create
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     context, snapshot_id, 'error')
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 1675, in volume_snapshot_create
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     create_info['new_file'])
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 1584, in _volume_snapshot_create
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     new_file_path = os.path.join(os.path.dirname(current_file),
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib64/python2.6/posixpath.py", line 119, in dirname
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp     i = p.rfind('/') + 1
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp AttributeError: 'NoneType' object has no attribute 'rfind'
2014-03-04 09:30:47.644 3135 TRACE nova.openstack.common.rpc.amqp 

Version-Release number of selected component (if applicable):
openstack-nova-cert-2013.2.2-2.el6ost.noarch
python-novaclient-2.15.0-2.el6ost.noarch
openstack-nova-common-2013.2.2-2.el6ost.noarch
openstack-nova-api-2013.2.2-2.el6ost.noarch
openstack-nova-compute-2013.2.2-2.el6ost.noarch
openstack-nova-conductor-2013.2.2-2.el6ost.noarch
openstack-nova-novncproxy-2013.2.2-2.el6ost.noarch
openstack-nova-scheduler-2013.2.2-2.el6ost.noarch
python-nova-2013.2.2-2.el6ost.noarch
openstack-nova-console-2013.2.2-2.el6ost.noarch
openstack-nova-network-2013.2.2-2.el6ost.noarch



How reproducible:
100%

Steps to Reproduce:
1. Configure the nova-compute to work with Gluster's libfgapi
2. Attach a volume to an instance (or boot an instance from a volume)
3. Take a snapshot of the attached volume with the force flag:
 # cinder snapshot-create <volume-uid> --force True

Actual results:
The snapshot is created in error state.

Expected results:
The snapshot is available.

Additional info:

Note You need to log in before you can comment on or make changes to this bug.