Description of problem:


- Cinder retype operation successds but the changes are not reflected in `cinder show` output.

[root@dhcp200-208 ~(keystone_admin)]# cinder create --volume-type iscsi --name iscsi_vol1 1
+--------------------------------+--------------------------------------+
|            Property            |                Value                 |
+--------------------------------+--------------------------------------+
|          attachments           |                  []                  |
|       availability_zone        |                 nova                 |
|            bootable            |                false                 |
|      consistencygroup_id       |                 None                 |
|           created_at           |      2016-08-20T15:33:35.000000      |
|          description           |                 None                 |
|           encrypted            |                False                 |
|               id               | f0faecce-7b71-4d9b-89de-85bb90b850b0 |  <==
|            metadata            |                  {}                  |
|        migration_status        |                 None                 |
|          multiattach           |                False                 |
|              name              |              iscsi_vol1              |
|     os-vol-host-attr:host      |                 None                 |
| os-vol-mig-status-attr:migstat |                 None                 |
| os-vol-mig-status-attr:name_id |                 None                 |
|  os-vol-tenant-attr:tenant_id  |   84df9e408f454a74ac746c9e3af0abd6   |
|       replication_status       |               disabled               |
|              size              |                  1                   |
|          snapshot_id           |                 None                 |
|          source_volid          |                 None                 |
|             status             |               creating               |
|           updated_at           |                 None                 |
|            user_id             |   aa2bc39017904b7ea83b479af68ca1c7   |
|          volume_type           |                iscsi                 |  <==
+--------------------------------+--------------------------------------+


[root@dhcp200-208 ~(keystone_admin)]# lvs
  LV                                          VG             Attr       LSize Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  volume-f0faecce-7b71-4d9b-89de-85bb90b850b0 cinder-volumes -wi-a----- 1.00g     <===                                                
  volume-f6296b85-9c58-4eb6-a3d1-a61bdd0594b1 cinder-volumes -wi-a----- 1.00g   


[root@dhcp200-208 ~(keystone_admin)]# cinder extra-specs-list
+--------------------------------------+-------+-----------------------------------+
|                  ID                  |  Name |            extra_specs            |
+--------------------------------------+-------+-----------------------------------+
| 1ddc813e-bd65-4b93-adff-df562416e0fc | iscsi |   {'volume_backend_name': 'lvm'}  |
| 4a44b750-5937-4569-9c0e-1409e6106cef |  nfs  | {'volume_backend_name': 'nfs123'} |
| 561ca32b-a241-4d32-a809-ecb8338c6981 |  lvm  |   {'volume_backend_name': 'lvm'}  |
+--------------------------------------+-------+-----------------------------------+


[root@dhcp200-208 ~(keystone_admin)]# cinder retype f0faecce-7b71-4d9b-89de-85bb90b850b0 nfs --migration-policy on-demand

[root@dhcp200-208 ~(keystone_admin)]# cinder show f0faecce-7b71-4d9b-89de-85bb90b850b0
+--------------------------------+------------------------------------------------------+
|            Property            |                        Value                         |
+--------------------------------+------------------------------------------------------+
|          attachments           |                          []                          |
|       availability_zone        |                         nova                         |
|            bootable            |                        false                         |
|      consistencygroup_id       |                         None                         |
|           created_at           |              2016-08-20T15:33:35.000000              |
|          description           |                         None                         |
|           encrypted            |                        False                         |
|               id               |         f0faecce-7b71-4d9b-89de-85bb90b850b0         |
|            metadata            |                          {}                          |
|        migration_status        |                       success                        |
|          multiattach           |                        False                         |
|              name              |                      iscsi_vol1                      |
|     os-vol-host-attr:host      | dhcp200-208.gsslab.pnq.redhat.com@development#nfs123 |
| os-vol-mig-status-attr:migstat |                       success                        |
| os-vol-mig-status-attr:name_id |                         None                         |
|  os-vol-tenant-attr:tenant_id  |           84df9e408f454a74ac746c9e3af0abd6           |
|       replication_status       |                       disabled                       |
|              size              |                          1                           |
|          snapshot_id           |                         None                         |
|          source_volid          |                         None                         |
|             status             |                      available                       |
|           updated_at           |              2016-08-20T15:47:59.000000              |
|            user_id             |           aa2bc39017904b7ea83b479af68ca1c7           |
|          volume_type           |                        iscsi                         |  <===
+--------------------------------+------------------------------------------------------+



[root@dhcp200-208 ~(keystone_admin)]# lvs


[root@dhcp200-208 23bd9281402ef955f41e97f8acd037e0(keystone_admin)]# ls /var/lib/cinder/mnt/23bd9281402ef955f41e97f8acd037e0/volume-f0faecce-7b71-4d9b-89de-85bb90b850b0 
/var/lib/cinder/mnt/23bd9281402ef955f41e97f8acd037e0/volume-f0faecce-7b71-4d9b-89de-85bb90b850b0


[root@dhcp200-208 23bd9281402ef955f41e97f8acd037e0(keystone_admin)]# mount |grep -i 23bd9281402ef9
10.65.200.45:/home/rhos_export/rhos9_cinder1 on /var/lib/cinder/mnt/23bd9281402ef955f41e97f8acd037e0 type nfs4 (rw,relatime,vers=4.1,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=10.65.200.208,local_lock=none,addr=10.65.200.45)


+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


2016-08-20 11:47:44.305 13273 DEBUG oslo_concurrency.processutils [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] u'sudo cinder-rootwrap /etc/cinder/rootwrap.conf systool -c fc_host -v' failed. Not Retrying. execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:422


2016-08-20 11:47:42.939 13279 DEBUG cinder.volume.manager [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15917628-d5c5-4526-9dd0-6519a35bedac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,consistencygroup=<?>,consistencygroup_id=None,created_at=2016-08-20T15:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='iscsi_vol1',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,host='dhcp200-208.gsslab.pnq.redhat.com@development#nfs123',id=bf3f1636-2ed5-40db-a2cc-68946ad17a3a,launched_at=2016-08-20T15:33:36Z,metadata={},migration_status='target:f0faecce-7b71-4d9b-89de-85bb90b850b0',multiattach=False,previous_status='available',project_id=84df9e408f454a74ac746c9e3af0abd6,provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status='disabled',scheduled_at=2016-08-20T15:33:35Z,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2016-08-20T15:47:42Z,user_id=aa2bc39017904b7ea83b479af68ca1c7,volume_attachment=<?>,volume_type=VolumeType(4a44b750-5937-4569-9c0e-1409e6106cef),volume_type_id=4a44b750-5937-4569-9c0e-1409e6106cef)' _task_receiver /usr/lib/python2.7/site-packages/taskflow/listeners/logging.py:178


2016-08-20 11:47:42.950 13279 DEBUG cinder.volume.manager [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919f7fce-933e-4a03-a4e7-30bb4af0a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': u'creating', 'volume_size': 1, 'volume_name': 'volume-bf3f1636-2ed5-40db-a2cc-68946ad17a3a', 'type': 'raw', 'volume_id': 'bf3f1636-2ed5-40db-a2cc-68946ad17a3a'}' _task_receiver /usr/lib/python2.7/site-packages/taskflow/listeners/logging.py:178




2016-08-20 11:47:43.076 13279 INFO cinder.volume.flows.manager.create_volume [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] Volume bf3f1636-2ed5-40db-a2cc-68946ad17a3a: being created as raw with specification: {'status': u'creating', 'volume_size': 1, 'volume_name': 'volume-bf3f1636-2ed5-40db-a2cc-68946ad17a3a'}


2016-08-20 11:47:43.579 13279 INFO cinder.volume.flows.manager.create_volume [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] Volume volume-bf3f1636-2ed5-40db-a2cc-68946ad17a3a (bf3f1636-2ed5-40db-a2cc-68946ad17a3a): created successfully




2016-08-20 11:47:48.443 13273 DEBUG oslo_concurrency.processutils [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/disk/by-path/ip-10.65.200.208:3260-iscsi-iqn.2010-10.org.openstack:volume-f0faecce-7b71-4d9b-89de-85bb90b850b0-lun-0 of=/var/lib/cinder/mnt/23bd9281402ef955f41e97f8acd037e0/volume-bf3f1636-2ed5-40db-a2cc-68946ad17a3a count=1024 bs=1M iflag=direct oflag=direct conv=sparse execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:344


2016-08-20 11:47:55.083 13273 DEBUG os_brick.initiator.linuxscsi [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] Checking to see if SCSI volume /dev/disk/by-path/ip-10.65.200.208:3260-iscsi-iqn.2010-10.org.openstack:volume-f0faecce-7b71-4d9b-89de-85bb90b850b0-lun-0 has been removed. wait_for_volume_removal /usr/lib/python2.7/site-packages/os_brick/initiator/linuxscsi.py:82



Logout of [sid: 2, target: iqn.2010-10.org.openstack:volume-f0faecce-7b71-4d9b-89de-85bb90b850b0, portal: 10.65.200.208,3260] successful.


2016-08-20 11:47:59.695 13273 INFO cinder.volume.manager [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] Complete-Migrate volume completed successfully.
2016-08-20 11:47:59.696 13273 INFO cinder.volume.manager [req-7ed12831-5ec1-4c9d-ba40-98ac6867dfad aa2bc39017904b7ea83b479af68ca1c7 84df9e408f454a74ac746c9e3af0abd6 - - -] Migrate volume completed successfully.


Version-Release number of selected component (if applicable):
RHOS9

How reproducible:
100%

Steps to Reproduce:
1.
2.
3.

Actual results:
Cinder retype operation succeeds but the changes are not reflected in `cinder show` output.

Expected results:
operation should update cinder db.

Additional info:

upstream bz: https://bugs.launchpad.net/cinder/+bug/1565133
patch: https://review.openstack.org/#/c/301366/