Bug 1393657 - Instance can not be launched because of permission error [NEEDINFO]
Summary: Instance can not be launched because of permission error
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-packstack
Version: 7.0 (Kilo)
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: ---
Assignee: Alfredo Moralejo
QA Contact: nlevinki
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-11-10 06:02 UTC by Shinobu KINJO
Modified: 2017-01-17 13:19 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-01-17 13:19:09 UTC
Target Upstream Version:
mburns: needinfo? (skinjo)


Attachments (Terms of Use)

Description Shinobu KINJO 2016-11-10 06:02:52 UTC
Description of problem:

 * Instance can not be launched because of permission error

 * Command
 **
 # nova --debug boot --flavor 1 --image `glance image-list | grep -i cirros | awk '{print $2}'` --nic net-id=`neutron net-list | grep private | awk '{print $2}'` --key_name super_secure_key tester


 * Log
 **
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup [-] dictionary changed size during iteration
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup Traceback (most recent call last):
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/oslo_service/threadgroup.py", line 154, in wait
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     x.wait()
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/oslo_service/threadgroup.py", line 51, in wait
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     return self.thread.wait()
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 175, in wait
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     return self._exit_event.wait()
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/event.py", line 121, in wait
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     return hubs.get_hub().switch()
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/hubs/hub.py", line 294, in switch
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     return self.greenlet.switch()
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/hubs/hub.py", line 346, in run
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     self.wait(sleep_time)
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/hubs/poll.py", line 85, in wait
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     presult = self.do_poll(seconds)
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/hubs/epolls.py", line 62, in do_poll
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     return self.poll.poll(seconds)
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 160, in _handle_signals
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     handler(signo, frame)
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 355, in _sigterm
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     self.signal_handler.clear()
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 143, in clear
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup     for sig in self._signal_handlers:
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup RuntimeError: dictionary changed size during iteration
/var/log/nova/nova-api.log:2016-11-10 00:16:57.421 43776 ERROR oslo_service.threadgroup 
/var/log/nova/nova-conductor.log:2016-11-10 00:11:42.733 44770 ERROR nova.scheduler.utils [req-99f25423-08ea-4d8b-9e18-fa9404b1ee38 4d89be86dae546c7a724f4e97b9076bc b3bb779bd8774cf4be1c2f7d05e85140 - - -] [instance: 7e814339-3336-4d61-b570-f77838207456] Error from last host: dell-r530-9.gsslab.pnq2.redhat.com (node dell-r530-9.gsslab.pnq2.redhat.com): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1905, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2082, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 7e814339-3336-4d61-b570-f77838207456 was re-scheduled: Unable to open file: /var/lib/nova/instances/7e814339-3336-4d61-b570-f77838207456/console.log: Permission denied\n']

Version-Release number of selected component (if applicable):

OSP7, 8, 9 base openstack-packstack

** Using CentOS, there is no problem **

[root@localhost ~(keystone_admin)]# nova boot --flavor 1 --image `glance image-list | grep -i cirros | awk '{print $2}'` --nic net-id=`neutron net-list | grep private | awk '{print $2}'` --key-name super_secure_key tester
+--------------------------------------+-----------------------------------------------+
| Property                             | Value                                         |
+--------------------------------------+-----------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                        |
| OS-EXT-AZ:availability_zone          |                                               |
| OS-EXT-SRV-ATTR:host                 | -                                             |
| OS-EXT-SRV-ATTR:hostname             | tester                                        |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                             |
| OS-EXT-SRV-ATTR:instance_name        |                                               |
| OS-EXT-SRV-ATTR:kernel_id            |                                               |
| OS-EXT-SRV-ATTR:launch_index         | 0                                             |
| OS-EXT-SRV-ATTR:ramdisk_id           |                                               |
| OS-EXT-SRV-ATTR:reservation_id       | r-ptdr85ty                                    |
| OS-EXT-SRV-ATTR:root_device_name     | -                                             |
| OS-EXT-SRV-ATTR:user_data            | -                                             |
| OS-EXT-STS:power_state               | 0                                             |
| OS-EXT-STS:task_state                | scheduling                                    |
| OS-EXT-STS:vm_state                  | building                                      |
| OS-SRV-USG:launched_at               | -                                             |
| OS-SRV-USG:terminated_at             | -                                             |
| accessIPv4                           |                                               |
| accessIPv6                           |                                               |
| adminPass                            | gmn4oPyTjgKL                                  |
| config_drive                         |                                               |
| created                              | 2016-11-10T05:56:10Z                          |
| description                          | -                                             |
| flavor                               | m1.tiny (1)                                   |
| hostId                               |                                               |
| host_status                          |                                               |
| id                                   | 05ddd0b0-426c-4efc-89b8-77abec84d47d          |
| image                                | cirros (aae04586-4cde-48db-82b2-8b5cb5e05268) |
| key_name                             | super_secure_key                              |
| locked                               | False                                         |
| metadata                             | {}                                            |
| name                                 | tester                                        |
| os-extended-volumes:volumes_attached | []                                            |
| progress                             | 0                                             |
| security_groups                      | default                                       |
| status                               | BUILD                                         |
| tags                                 | []                                            |
| tenant_id                            | e9e3a22cca2e45128f13628dbdb9b1ca              |
| updated                              | 2016-11-10T05:56:11Z                          |
| user_id                              | 2119d9cddf5f48ac913a4b148840608e              |
+--------------------------------------+-----------------------------------------------+
[root@localhost ~(keystone_admin)]# nova list
+--------------------------------------+--------+--------+------------+-------------+-------------------+
| ID                                   | Name   | Status | Task State | Power State | Networks          |
+--------------------------------------+--------+--------+------------+-------------+-------------------+
| 05ddd0b0-426c-4efc-89b8-77abec84d47d | tester | BUILD  | spawning   | NOSTATE     | private=10.0.0.11 |
+--------------------------------------+--------+--------+------------+-------------+-------------------+
[root@localhost ~(keystone_admin)]# nova list
+--------------------------------------+--------+--------+------------+-------------+-------------------+
| ID                                   | Name   | Status | Task State | Power State | Networks          |
+--------------------------------------+--------+--------+------------+-------------+-------------------+
| 05ddd0b0-426c-4efc-89b8-77abec84d47d | tester | ACTIVE | -          | Running     | private=10.0.0.11 |
+--------------------------------------+--------+--------+------------+-------------+-------------------+
[root@localhost ~(keystone_admin)]# rpm -qa | grep packstack
openstack-packstack-9.0.0-0.2.0rc2.el7.noarch
openstack-packstack-puppet-9.0.0-0.2.0rc2.el7.noarch

How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 1 Mike Burns 2017-01-13 21:44:43 UTC
Are there selinux errors?  Is this still a problem?

Comment 2 Alfredo Moralejo 2017-01-14 12:52:17 UTC
I've tested with RHEL 7.3 and OSP7 and worked fine. 

I think this must be related to selinux issues with virtlogd, duplicated of issue https://bugzilla.redhat.com/show_bug.cgi?id=1377272

Comment 3 Mike Burns 2017-01-17 13:19:09 UTC
Since tests seem to be passing, closing this currentrelease.  If it's still a problem, please reopen


Note You need to log in before you can comment on or make changes to this bug.