Bug 1180138
| Summary: | cinder-volumes (LVM) are not availabe until cinder service restart | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Martin Pavlásek <mpavlase> | ||||||
| Component: | openstack-packstack | Assignee: | Martin Magr <mmagr> | ||||||
| Status: | CLOSED WORKSFORME | QA Contact: | yeylon <yeylon> | ||||||
| Severity: | unspecified | Docs Contact: | |||||||
| Priority: | unspecified | ||||||||
| Version: | 5.0 (RHEL 6) | CC: | aortega, derekh, srevivo, yeylon | ||||||
| Target Milestone: | --- | Keywords: | Automation, ZStream | ||||||
| Target Release: | 6.0 (Juno) | ||||||||
| Hardware: | Unspecified | ||||||||
| OS: | Unspecified | ||||||||
| Whiteboard: | |||||||||
| Fixed In Version: | Doc Type: | Bug Fix | |||||||
| Doc Text: | Story Points: | --- | |||||||
| Clone Of: | Environment: | ||||||||
| Last Closed: | 2015-10-29 12:56:57 UTC | Type: | Bug | ||||||
| Regression: | --- | Mount Type: | --- | ||||||
| Documentation: | --- | CRM: | |||||||
| Verified Versions: | Category: | --- | |||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||
| Embargoed: | |||||||||
| Attachments: |
|
||||||||
Created attachment 977809 [details]
packstack log
The bug was recognized only on RHEL 6.6 (rhos4+5). Applying Puppet manifests [ DONE ] Finalizing [ DONE ] **** Installation completed successfully ****** Additional information: * Time synchronization installation was skipped. Please note that unsynchronized time on server instances might be problem for some OpenStack components. * Warning: NetworkManager is active on 192.168.122.19, 192.168.122.77. OpenStack networking currently does not work on systems that have the Network Manager service enabled. * File /root/keystonerc_admin has been created on OpenStack client host 192.168.122.19. To use the command line tools you need to source the file. * Copy of keystonerc_admin file has been created for non-root user in /home/para. * To access the OpenStack Dashboard browse to http://192.168.122.19/dashboard . Please, find your login credentials stored in the keystonerc_admin in your home directory. * To use Nagios, browse to http://192.168.122.19/nagios username: nagiosadmin, password: a5a696894c8c44db * The installation log file is available at: /var/tmp/packstack/20151029-082817-_VnT4k/openstack-setup.log * The generated manifests are available at: /var/tmp/packstack/20151029-082817-_VnT4k/manifests [para@localhost ~]$ rpm -qa openstack-packstack openstack-packstack-2014.2-0.25.dev1474.gd85ee76.el7ost.noarch [para@localhost ~]$ cat packstack-answers-20151029-081800.txt | grep -i volumes # Create Cinder's volumes group. This should only be done for testing CONFIG_CINDER_VOLUMES_CREATE=y # Cinder's volumes group size. Note that actual volume size will be CONFIG_CINDER_VOLUMES_SIZE=20G # restrict provisioning to the specified controller volumes. Specify # volumes will be done. This parameter is only used by the driver when # storage volumes should occur. If using the NFS storage protocol, # only be used for provisioning in the future. Block storage volumes [para@localhost ~]$ source keystonerc_admin [para@localhost ~(keystone_admin)]$ cinder create 1 +---------------------+--------------------------------------+ | Property | Value | +---------------------+--------------------------------------+ | attachments | [] | | availability_zone | nova | | bootable | false | | created_at | 2015-10-29T12:55:22.573316 | | display_description | None | | display_name | None | | encrypted | False | | id | 1665dfea-81ec-4661-89d8-70bc39820804 | | metadata | {} | | size | 1 | | snapshot_id | None | | source_volid | None | | status | creating | | volume_type | None | +---------------------+--------------------------------------+ [para@localhost ~(keystone_admin)]$ cinder backup-create usage: cinder backup-create [--container <container>] [--display-name <display-name>] [--display-description <display-description>] <volume> error: too few arguments Try 'cinder help backup-create' for more information. [para@localhost ~(keystone_admin)]$ cinder backup-create 1665dfea-81ec-4661-89d8-70bc39820804 +-----------+--------------------------------------+ | Property | Value | +-----------+--------------------------------------+ | id | 9e2eb26a-84a6-4a68-9947-7b92279883bd | | name | None | | volume_id | 1665dfea-81ec-4661-89d8-70bc39820804 | +-----------+--------------------------------------+ [para@localhost ~(keystone_admin)]$ cinder backup-list +--------------------------------------+--------------------------------------+-----------+------+------+--------------+----------------+ | ID | Volume ID | Status | Name | Size | Object Count | Container | +--------------------------------------+--------------------------------------+-----------+------+------+--------------+----------------+ | 9e2eb26a-84a6-4a68-9947-7b92279883bd | 1665dfea-81ec-4661-89d8-70bc39820804 | available | None | 1 | 22 | volumes_backup | +--------------------------------------+--------------------------------------+-----------+------+------+--------------+----------------+ [para@localhost ~(keystone_admin)]$ rpm -qa openstack-packstack openstack-packstack-2014.2-0.25.dev1474.gd85ee76.el7ost.noarch [para@localhost ~(keystone_admin)]$ |
Created attachment 977805 [details] volume.log Description of problem: After full AIO deployment by packstack are cinder/cinder-backup services running, but cinder-volumes LVM volume-grou was not found. It seems that cinder service was restarted anyway, so it doesn't suffer this issue, but cinder-backup wasn't and it cause ERROR status after requesting backup of some volume. See all logs as attachements. INFO cinder.service [-] Starting 1 workers INFO cinder.service [-] Started child 2120 AUDIT cinder.service [-] Starting cinder-backup node (version 2013.2.4) INFO cinder.openstack.common.rpc.impl_qpid [req-10ad5728-130c-46b8-adda-edd6b51174cb None None] Connected to AMQP server on 172.16.42.7:5672 INFO cinder.backup.manager [req-10ad5728-130c-46b8-adda-edd6b51174cb None None] Starting volume driver LVMISCSIDriver (2.0.0). ERROR cinder.brick.local_dev.lvm [req-10ad5728-130c-46b8-adda-edd6b51174cb None None] Unable to locate Volume Group cinder-volumes ERROR cinder.backup.manager [req-10ad5728-130c-46b8-adda-edd6b51174cb None None] Error encountered during initialization of driver: LVMISCSIDriver. ERROR cinder.backup.manager [req-10ad5728-130c-46b8-adda-edd6b51174cb None None] Bad or unexpected response from the storage volume backend API: Volume Group cinder-volumes does not exist TRACE cinder.backup.manager Traceback (most recent call last): TRACE cinder.backup.manager File "/usr/lib/python2.6/site-packages/cinder/backup/manager.py", line 163, in _init_volume_driver TRACE cinder.backup.manager driver.check_for_setup_error() TRACE cinder.backup.manager File "/usr/lib/python2.6/site-packages/cinder/volume/drivers/lvm.py", line 94, in check_for_setup_error TRACE cinder.backup.manager raise exception.VolumeBackendAPIException(data=message) TRACE cinder.backup.manager VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Volume Group cinder-volumes does not exist TRACE cinder.backup.manager INFO cinder.backup.manager [req-10ad5728-130c-46b8-adda-edd6b51174cb None None] Cleaning up incomplete backup operations. Workaround: Restart cinder services (mayby only cinder-backup would be enough) manually after packstack run. Version-Release number of selected component (if applicable): openstack-cinder-2014.1.3-2.el6ost.noarch openstack-packstack-2014.1.1-0.44.dev1251.el6ost.noarch RHEL 6.6, LVM Note: The same issue was recognized in RHOS4 and patch should be backported. How reproducible: always Steps to Reproduce: 1. deploy AIO via packstack, with cinder-volumes-create: yes,cinder-volumes-size: 20G 2. source ~/keystone_admin 3. cinder create 1 4. cinder backup-create 5. cinder backup-list Actual results: backup volume get into ERROR Status Expected results: backup volume get into available Status Additional info: