Created attachment 777221 [details] logs Description of problem: i tried creating a backup to volumes in external nfs storage. the volumes get stuck in creating forever, we cannot delete the backup or the volumes because of invalid state. Version-Release number of selected component (if applicable): openstack-cinder-2013.1.2-3.el6ost.noarch How reproducible: 100% Steps to Reproduce: 1. install AIO and change the local tgt storage to external nfs 2. create a volume: cinder create 10 --display-name bla 3. create a backup to the volume : cinder backup-create <vol_id> --display-name <name> --display-description <description> Actual results: the volume is stuck in backing-up state forever and the backup is stuck in creating state forever. we cannot delete or stop the process. **I created 2 backups and left it for a whole night but they are still creating and the volumes are stuck - adding list of all backups** Expected results: if we do not support this for nfs we need to block this. if we do support this for nfs we need to complete the backup create Additional info:logs attached [root@opens-vdsb ~(keystone_admin)]# cinder list +--------------------------------------+------------+--------------+------+-------------+----------+-------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+------------+--------------+------+-------------+----------+-------------+ | 3a888ac1-395a-4082-973e-139be9de97d9 | backing-up | bla1 | 10 | bla | false | | | 58adbbd4-628b-4137-a609-abca2cfffd38 | backing-up | dafna | 10 | None | false | | | 5fb0c74a-9540-4793-b386-d45ab5e4765a | available | blaaa | 11 | dafna | false | | | b4b10bd5-fa66-41a5-a206-91c72dfd258b | available | bla | 10 | None | false | | | fb596f0d-30ff-4f74-b68e-41d14b791d9b | backing-up | bla | 10 | dafna | false | | +--------------------------------------+------------+--------------+------+-------------+----------+-------------+ [root@opens-vdsb ~(keystone_admin)]# cinder delete fb596f0d-30ff-4f74-b68e-41d14b791d9b ERROR: Invalid volume: Volume status must be available or error [root@opens-vdsb ~(keystone_admin)]# cinder backup-list +--------------------------------------+--------------------------------------+----------+-------------+------+--------------+-----------+ | ID | Volume ID | Status | Name | Size | Object Count | Container | +--------------------------------------+--------------------------------------+----------+-------------+------+--------------+-----------+ | 38a27122-4019-4f29-9ebd-701b35ef45ac | 3a888ac1-395a-4082-973e-139be9de97d9 | creating | backup_bla1 | 10 | None | None | | 7c4acfd5-d91a-4aad-84db-6fedbf968dbb | fb596f0d-30ff-4f74-b68e-41d14b791d9b | creating | None | 10 | None | None | | bc8b6b86-2b61-48da-b18d-b47caf7f806f | 58adbbd4-628b-4137-a609-abca2cfffd38 | creating | BACKUP | 10 | None | None | +--------------------------------------+--------------------------------------+----------+-------------+------+--------------+-----------+ [root@opens-vdsb ~(keystone_admin)]# cinder backup-delete bc8b6b86-2b61-48da-b18d-b47caf7f806f ERROR: Invalid backup: Backup status must be available or error
Maybe related to bug 966124.
Hi, This was fixed by this patch here https://review.openstack.org/#/c/36612/ I tested it and it works as expected now.
Actually, that's not the right patch, however, I'm still unable to replicate this bug. [fedora@cinder-987305 devstack]$ grep volume_driver /etc/cinder/cinder.conf volume_driver=cinder.volume.drivers.nfs.NfsDriver [fedora@cinder-987305 devstack]$ cinder list +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | 90426225-6b66-4802-bdf8-12e24fb7e3fd | available | None | 1 | None | False | | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ [fedora@cinder-987305 devstack]$ cinder backup-list +--------------------------------------+--------------------------------------+--------+------+------+--------------+-----------+ | ID | Volume ID | Status | Name | Size | Object Count | Container | +--------------------------------------+--------------------------------------+--------+------+------+--------------+-----------+ | c96b77c6-c9f5-45e0-bcbf-3739444badf3 | 90426225-6b66-4802-bdf8-12e24fb7e3fd | error | None | 1 | None | None | +--------------------------------------+--------------------------------------+--------+------+------+--------------+-----------+ [fedora@cinder-987305 devstack]$
(In reply to Flavio Percoco from comment #3) > Actually, that's not the right patch, however, I'm still unable to replicate > this bug. > > [fedora@cinder-987305 devstack]$ grep volume_driver /etc/cinder/cinder.conf > volume_driver=cinder.volume.drivers.nfs.NfsDriver > > > [fedora@cinder-987305 devstack]$ cinder list > +--------------------------------------+-----------+--------------+------+--- > ----------+----------+-------------+ > | ID | Status | Display Name | Size | > Volume Type | Bootable | Attached to | > +--------------------------------------+-----------+--------------+------+--- > ----------+----------+-------------+ > | 90426225-6b66-4802-bdf8-12e24fb7e3fd | available | None | 1 | > None | False | | > +--------------------------------------+-----------+--------------+------+--- > ----------+----------+-------------+ > [fedora@cinder-987305 devstack]$ cinder backup-list > +--------------------------------------+------------------------------------- > -+--------+------+------+--------------+-----------+ > | ID | Volume ID > | Status | Name | Size | Object Count | Container | > +--------------------------------------+------------------------------------- > -+--------+------+------+--------------+-----------+ > | c96b77c6-c9f5-45e0-bcbf-3739444badf3 | > 90426225-6b66-4802-bdf8-12e24fb7e3fd | error | None | 1 | None | > None | > +--------------------------------------+------------------------------------- > -+--------+------+------+--------------+-----------+ > [fedora@cinder-987305 devstack]$ I reproduce 100%. perhaps its the nfs version on your remote server? can you confirm the configurations on /etc/cinder/shares.conf and on target server?
Auto adding >= MODIFIED bugs to beta
verified on: python-cinderclient-1.0.6-2.el6ost.noarch openstack-cinder-2013.2-2.el6ost.noarch python-cinder-2013.2-2.el6ost.noarch
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. http://rhn.redhat.com/errata/RHEA-2013-1859.html