Description of problem: I ran the following command on a freshly installed minimal rhel-6.5 server # packstack --install-hosts=192.168.122.84,192.168.122.82 After install completed, I ran the following to test if services were active # nova-manage service list It spewed debug log messages to the console which made it impossible to see the real output. Version-Release number of selected component (if applicable): openstack-packstack-2013.2.1-0.13.dev876.el6ost.noarch openstack-nova-common-2013.2-9.el6ost.noarch How reproducible: Always Steps to Reproduce: 1. # packstack --install-hosts=192.168.122.84,192.168.122.82 2. # nova-manage service list 3. Actual results: # nova-manage service list 2013-12-09 17:08:52.778 18941 DEBUG nova.servicegroup.api [-] ServiceGroup driver defined as an instance of db __new__ /usr/lib/python2.6/site-packages/nova/servicegroup/api.py:62 2013-12-09 17:08:52.883 18941 DEBUG stevedore.extension [-] found extension EntryPoint.parse('file = nova.image.download.file') _load_plugins /usr/lib/python2.6/site-packages/stevedore/extension.py:84 2013-12-09 17:08:52.890 18941 DEBUG stevedore.extension [-] found extension EntryPoint.parse('file = nova.image.download.file') _load_plugins /usr/lib/python2.6/site-packages/stevedore/extension.py:84 2013-12-09 17:08:52.891 18941 DEBUG nova.openstack.common.lockutils [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] Got semaphore "dbapi_backend" lock /usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py:166 2013-12-09 17:08:52.891 18941 DEBUG nova.openstack.common.lockutils [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] Got semaphore / lock "__get_backend" inner /usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py:245 Binary Host Zone Status State Updated_At 2013-12-09 17:08:53.131 18941 DEBUG nova.servicegroup.api [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] Check if the given member [{'binary': u'nova-consoleauth', 'availability_zone': 'internal', 'deleted': 0L, 'created_at': datetime.datetime(2013, 12, 9, 16, 44, 21), 'updated_at': datetime.datetime(2013, 12, 9, 17, 8, 51), 'report_count': 147L, 'topic': u'consoleauth', 'host': u'localhost.localdomain', 'disabled': False, 'deleted_at': None, 'disabled_reason': None, 'id': 1L}] is part of the ServiceGroup, is up service_is_up /usr/lib/python2.6/site-packages/nova/servicegroup/api.py:94 2013-12-09 17:08:53.132 18941 DEBUG nova.servicegroup.drivers.db [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] DB_Driver.is_up last_heartbeat = 2013-12-09 17:08:51 elapsed = 2.132065 is_up /usr/lib/python2.6/site-packages/nova/servicegroup/drivers/db.py:71 nova-consoleauth localhost.localdomain internal enabled :-) 2013-12-09 17:08:51 2013-12-09 17:08:53.132 18941 DEBUG nova.servicegroup.api [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] Check if the given member [{'binary': u'nova-scheduler', 'availability_zone': 'internal', 'deleted': 0L, 'created_at': datetime.datetime(2013, 12, 9, 16, 44, 21), 'updated_at': datetime.datetime(2013, 12, 9, 17, 8, 52), 'report_count': 147L, 'topic': u'scheduler', 'host': u'localhost.localdomain', 'disabled': False, 'deleted_at': None, 'disabled_reason': None, 'id': 2L}] is part of the ServiceGroup, is up service_is_up /usr/lib/python2.6/site-packages/nova/servicegroup/api.py:94 2013-12-09 17:08:53.132 18941 DEBUG nova.servicegroup.drivers.db [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] DB_Driver.is_up last_heartbeat = 2013-12-09 17:08:52 elapsed = 1.132582 is_up /usr/lib/python2.6/site-packages/nova/servicegroup/drivers/db.py:71 nova-scheduler localhost.localdomain internal enabled :-) 2013-12-09 17:08:52 2013-12-09 17:08:53.133 18941 DEBUG nova.servicegroup.api [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] Check if the given member [{'binary': u'nova-conductor', 'availability_zone': 'internal', 'deleted': 0L, 'created_at': datetime.datetime(2013, 12, 9, 16, 44, 21), 'updated_at': datetime.datetime(2013, 12, 9, 17, 8, 52), 'report_count': 147L, 'topic': u'conductor', 'host': u'localhost.localdomain', 'disabled': False, 'deleted_at': None, 'disabled_reason': None, 'id': 3L}] is part of the ServiceGroup, is up service_is_up /usr/lib/python2.6/site-packages/nova/servicegroup/api.py:94 2013-12-09 17:08:53.133 18941 DEBUG nova.servicegroup.drivers.db [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] DB_Driver.is_up last_heartbeat = 2013-12-09 17:08:52 elapsed = 1.133204 is_up /usr/lib/python2.6/site-packages/nova/servicegroup/drivers/db.py:71 nova-conductor localhost.localdomain internal enabled :-) 2013-12-09 17:08:52 2013-12-09 17:08:53.133 18941 DEBUG nova.servicegroup.api [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] Check if the given member [{'binary': u'nova-cert', 'availability_zone': 'internal', 'deleted': 0L, 'created_at': datetime.datetime(2013, 12, 9, 16, 44, 24), 'updated_at': datetime.datetime(2013, 12, 9, 17, 8, 45), 'report_count': 146L, 'topic': u'cert', 'host': u'localhost.localdomain', 'disabled': False, 'deleted_at': None, 'disabled_reason': None, 'id': 4L}] is part of the ServiceGroup, is up service_is_up /usr/lib/python2.6/site-packages/nova/servicegroup/api.py:94 2013-12-09 17:08:53.133 18941 DEBUG nova.servicegroup.drivers.db [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] DB_Driver.is_up last_heartbeat = 2013-12-09 17:08:45 elapsed = 8.133657 is_up /usr/lib/python2.6/site-packages/nova/servicegroup/drivers/db.py:71 nova-cert localhost.localdomain internal enabled :-) 2013-12-09 17:08:45 2013-12-09 17:08:53.134 18941 DEBUG nova.servicegroup.api [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] Check if the given member [{'binary': u'nova-compute', 'availability_zone': 'nova', 'deleted': 0L, 'created_at': datetime.datetime(2013, 12, 9, 16, 51, 4), 'updated_at': datetime.datetime(2013, 12, 9, 17, 8, 43), 'report_count': 93L, 'topic': u'compute', 'host': u'localhost.localdomain', 'disabled': False, 'deleted_at': None, 'disabled_reason': None, 'id': 5L}] is part of the ServiceGroup, is up service_is_up /usr/lib/python2.6/site-packages/nova/servicegroup/api.py:94 2013-12-09 17:08:53.134 18941 DEBUG nova.servicegroup.drivers.db [req-4843d35a-3cdc-4921-a61c-2847a1730786 None None] DB_Driver.is_up last_heartbeat = 2013-12-09 17:08:43 elapsed = 10.134278 is_up /usr/lib/python2.6/site-packages/nova/servicegroup/drivers/db.py:71 nova-compute localhost.localdomain nova enabled :-) 2013-12-09 17:08:43 Expected results: # nova-manage service list Binary Host Zone Status State Updated_At nova-consoleauth localhost.localdomain internal enabled :-) 2013-12-09 17:09:01 nova-scheduler localhost.localdomain internal enabled :-) 2013-12-09 17:09:02 nova-conductor localhost.localdomain internal enabled :-) 2013-12-09 17:09:02 nova-cert localhost.localdomain internal enabled :-) 2013-12-09 17:09:05 nova-compute localhost.localdomain nova enabled :-) 2013-12-09 17:09:03 Additional info: While I can hide the debug message spam with '2> /dev/null' I should not have to do this. Command line tools should only spew debug messages if explicitly requested, eg via a '--debug' flag
NB, unclear if this is packstack's fault for enabling debug messages by default, or nova's fault. Picked packstack as the initial victim for this bug, but reassign if appropriate
This bug has been brought up repeatedly in the past - and closed pretty much every time. It is basically caused by the fact that nova-manage loads parts of the nova component, including the logging configuration. Any time something enables debugging in nova.conf we are going to get repeats of this issue. While nova-manage is at death's door and not getting any attention except to rip parts out of it, I wonder if it would be worth it to fix this one issue so it never shows up again ;).
(In reply to Brent Eagles from comment #3) > This bug has been brought up repeatedly in the past - and closed pretty much > every time. It is basically caused by the fact that nova-manage loads parts > of the nova component, including the logging configuration. Any time > something enables debugging in nova.conf we are going to get repeats of this > issue. While nova-manage is at death's door and not getting any attention > except to rip parts out of it, I wonder if it would be worth it to fix this > one issue so it never shows up again ;). Indeed if it keeps getting reported this is a sure sign that people think we should fix it !
Packstack is enabling debugging in it's manifests, i'm gonna check if this is really needed or if we can disable it. What do you think martin?
(In reply to Ivan Chavero from comment #5) > Packstack is enabling debugging in it's manifests, i'm gonna check if this > is really needed or if we can disable it. Just disabling debugging globally isn't really a fix - it needs to be just for the CLI tool, not the services.
i'm gonna check if that can be configurable
Jakub, do you think this can be fixed on nova-manage side or is it configuration problem?
Checked, this can't be dealt by configuration it has to be modified in nova source.
The debug setting in nova.conf enables debugging for cli and for log files at the same time, you can't disable debugging for the cli without disabling it for the log files. I'm assgning ths bug nova since it's nova not packstack's scope.
*** This bug has been marked as a duplicate of bug 976327 ***